-- Logs begin at Wed 2022-10-12 12:27:51 UTC, end at Wed 2022-10-12 14:07:09 UTC. -- Oct 12 13:10:50.011832 n-d-861076-2 systemd[1]: Starting Devstack devstack@n-api.service... Oct 12 13:10:50.024922 n-d-861076-2 devstack@n-api.service[105058]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 12 13:10:50.031710 n-d-861076-2 devstack@n-api.service[105058]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 12 13:10:50 2022] *** Oct 12 13:10:50.031710 n-d-861076-2 devstack@n-api.service[105058]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 13:10:50.031710 n-d-861076-2 devstack@n-api.service[105058]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 13:10:50.031710 n-d-861076-2 devstack@n-api.service[105058]: nodename: n-d-861076-2 Oct 12 13:10:50.031710 n-d-861076-2 devstack@n-api.service[105058]: machine: x86_64 Oct 12 13:10:50.031710 n-d-861076-2 devstack@n-api.service[105058]: clock source: unix Oct 12 13:10:50.031710 n-d-861076-2 devstack@n-api.service[105058]: pcre jit disabled Oct 12 13:10:50.031710 n-d-861076-2 devstack@n-api.service[105058]: detected number of CPU cores: 4 Oct 12 13:10:50.031710 n-d-861076-2 devstack@n-api.service[105058]: current working directory: / Oct 12 13:10:50.031710 n-d-861076-2 devstack@n-api.service[105058]: detected binary path: /usr/bin/uwsgi-core Oct 12 13:10:50.031710 n-d-861076-2 devstack@n-api.service[105058]: your processes number limit is 47680 Oct 12 13:10:50.031710 n-d-861076-2 devstack@n-api.service[105058]: your memory page size is 4096 bytes Oct 12 13:10:50.031710 n-d-861076-2 devstack@n-api.service[105058]: detected max file descriptor number: 2048 Oct 12 13:10:50.031710 n-d-861076-2 devstack@n-api.service[105058]: lock engine: pthread robust mutexes Oct 12 13:10:50.031710 n-d-861076-2 devstack@n-api.service[105058]: thunder lock: enabled Oct 12 13:10:50.031710 n-d-861076-2 devstack@n-api.service[105058]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 12 13:10:50.031710 n-d-861076-2 devstack@n-api.service[105058]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 12 13:10:50.066466 n-d-861076-2 devstack@n-api.service[105058]: Python main interpreter initialized at 0x56267808c9c0 Oct 12 13:10:50.066466 n-d-861076-2 devstack@n-api.service[105058]: python threads support enabled Oct 12 13:10:50.066466 n-d-861076-2 devstack@n-api.service[105058]: your server socket listen backlog is limited to 100 connections Oct 12 13:10:50.066466 n-d-861076-2 devstack@n-api.service[105058]: your mercy for graceful operations on workers is 90 seconds Oct 12 13:10:50.066827 n-d-861076-2 devstack@n-api.service[105058]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 13:10:50.066901 n-d-861076-2 devstack@n-api.service[105058]: *** Operational MODE: preforking *** Oct 12 13:10:50.067137 n-d-861076-2 devstack@n-api.service[105058]: *** uWSGI is running in multiple interpreter mode *** Oct 12 13:10:50.067137 n-d-861076-2 devstack@n-api.service[105058]: spawned uWSGI master process (pid: 105058) Oct 12 13:10:50.067343 n-d-861076-2 systemd[1]: Started Devstack devstack@n-api.service. Oct 12 13:10:50.068410 n-d-861076-2 devstack@n-api.service[105058]: spawned uWSGI worker 1 (pid: 105059, cores: 1) Oct 12 13:10:50.068410 n-d-861076-2 devstack@n-api.service[105058]: spawned uWSGI worker 2 (pid: 105060, cores: 1) Oct 12 13:10:50.068410 n-d-861076-2 devstack@n-api.service[105058]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 13:10:50.723209 n-d-861076-2 devstack@n-api.service[105059]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 13:10:50.723803 n-d-861076-2 devstack@n-api.service[105060]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 13:10:51.806194 n-d-861076-2 devstack@n-api.service[105059]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 13:10:51.806194 n-d-861076-2 devstack@n-api.service[105059]: from cryptography.utils import int_from_bytes Oct 12 13:10:51.806764 n-d-861076-2 devstack@n-api.service[105059]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 13:10:51.806764 n-d-861076-2 devstack@n-api.service[105059]: from cryptography.utils import int_from_bytes Oct 12 13:10:51.807006 n-d-861076-2 devstack@n-api.service[105060]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 13:10:51.807006 n-d-861076-2 devstack@n-api.service[105060]: from cryptography.utils import int_from_bytes Oct 12 13:10:51.807423 n-d-861076-2 devstack@n-api.service[105060]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 13:10:51.807423 n-d-861076-2 devstack@n-api.service[105060]: from cryptography.utils import int_from_bytes Oct 12 13:10:54.294316 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 13:10:54.294963 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 13:10:54.295063 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 13:10:54.295386 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 13:10:54.295462 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 13:10:54.295534 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 13:10:54.295697 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 13:10:54.295785 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 13:10:54.296053 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 13:10:54.296147 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.296313 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 13:10:54.296399 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.296692 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.296783 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.297045 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.297135 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.297373 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.297468 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.297686 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.297786 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.298010 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.298096 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.298322 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.298412 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.298647 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.298732 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.299422 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.299518 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.299760 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.299835 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.300075 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.300166 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-861076-2 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.300397 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.300488 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.300703 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.300787 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-861076-2 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.301042 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.301141 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.301364 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.301473 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.301666 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.301749 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.301984 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.302067 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.302293 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.302386 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.302619 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.302785 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.302928 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.303239 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.303446 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.303558 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.303748 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.303847 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.304058 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.304207 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.304371 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.304470 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.304710 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.304804 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.305052 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.305177 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.305366 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.305459 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.305689 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.305781 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.305998 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.306092 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.306324 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.306416 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-861076-2 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.306640 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.306734 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.307005 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.307085 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-861076-2 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.307319 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.307420 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.307651 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.307748 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.307969 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.308078 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.308329 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.308422 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.308652 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.308746 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.309001 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.309104 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.309313 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.309406 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.309639 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.309724 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.309950 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.310044 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.310269 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.310363 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.310590 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.310676 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.310896 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.310989 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.311206 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.311291 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.311514 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.311598 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.311824 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.311917 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.312129 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.312224 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.312434 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.312519 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.312686 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.312772 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.313022 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.313116 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.313312 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.313408 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.313625 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.313710 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.313950 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.314044 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.314208 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.314354 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.314461 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.314672 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.315361 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.315449 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.315675 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.315762 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.315990 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.316074 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.316301 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.316386 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.316611 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.316700 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.316937 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.317040 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.317250 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.317344 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.317557 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.317705 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.317865 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.317965 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.318175 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.318281 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.318480 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.318565 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.318791 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.318883 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.319113 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.319206 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.319423 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.319521 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.319747 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.319831 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.320059 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.320154 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.320386 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.320471 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.320692 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.320783 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.321056 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.321158 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.321375 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.321461 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.321681 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.321769 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.322003 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.322090 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.322325 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.322409 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.322632 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.322715 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.322938 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.323031 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.323252 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.323337 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.323559 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.323645 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.323869 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.323956 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.324181 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.324266 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.324434 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.324527 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.324736 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.324829 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.325074 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.325207 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.325396 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.325507 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.325684 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.325786 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.325988 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.326072 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.326295 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.326389 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.326597 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.326689 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.326903 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.326986 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.327206 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.327303 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.327508 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.327591 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.327813 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.327897 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.328116 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.328207 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.328422 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.328522 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.328725 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.328809 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.329057 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.329157 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.329365 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.329457 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.329674 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.329759 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.329981 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.330067 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.330311 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.330394 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.330633 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.330718 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.330938 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.331023 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.331244 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.331329 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.331547 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.331663 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.331855 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.331952 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.332157 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.332249 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.332462 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.332554 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.332771 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.332855 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.333104 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.333190 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.333408 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.333501 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.333722 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.333806 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.334027 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.334117 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.334334 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.334419 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.334641 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.334727 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.334938 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.335035 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.335245 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.335329 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.335545 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.335644 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.335854 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.335938 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.336156 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.336247 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.336458 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.336544 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.336761 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.336845 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.337088 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.337189 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.337390 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.337475 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.337692 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.337777 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.337994 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.338091 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.338293 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.338411 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.338594 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.338677 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.338896 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.338990 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.339209 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.339295 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.339515 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.339600 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.339820 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.339912 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.340124 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.340207 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.340431 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.340516 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.340752 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:10:54.340838 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.341114 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.341211 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.341435 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.341525 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.341771 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.341858 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.342088 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.342171 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.342407 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.342505 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.342720 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.342805 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.343037 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.343123 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.343351 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.343514 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.343665 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.343759 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.343976 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.344060 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.344288 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.344385 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.344601 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.344696 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.344927 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.345040 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.345252 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.345345 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.345566 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.345649 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.345905 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.345989 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.346228 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.346327 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.346537 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.346624 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.346856 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.346942 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.347167 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.347258 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.347488 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.347583 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.347799 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.347889 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.348130 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.348221 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.348446 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.348530 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.348779 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.348862 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.349129 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.349217 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.349452 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.349548 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.349767 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.349851 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.350081 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.350173 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.350394 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.350477 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.350707 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.350790 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.351023 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.351109 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.351346 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.351428 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.351666 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.351756 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.351980 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.352065 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.352301 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.352384 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.352614 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.352710 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.352950 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.353038 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.353271 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.353356 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.353586 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.353681 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.353896 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.353979 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.354210 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.354292 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.354526 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.354619 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.354851 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.354934 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.355172 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.355255 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.355486 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.355580 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.355809 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.355898 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.356122 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.356206 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.356438 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.356531 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.356752 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.356837 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.357102 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.357199 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.357415 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.357501 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.357724 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.357809 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.358037 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.358121 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.358344 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.358438 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.358667 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.358751 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.358973 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.359063 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.359295 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.359379 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.359623 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.359714 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.359933 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.360017 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.360246 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.360338 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.360559 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.360649 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.360872 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.361017 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.361203 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.361296 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.362037 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.362135 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.362348 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.362440 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.362656 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.362741 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.362969 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.363058 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.363280 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.363374 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.363592 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.363674 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.363908 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.363993 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.364218 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.364309 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.364527 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.364611 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.364832 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.364979 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.365170 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.365258 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.365486 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.365575 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.365797 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.365925 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.366108 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.366193 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.366420 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.366511 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.366733 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.366825 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.367043 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.367129 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.367364 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.367456 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.367678 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.367763 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.367996 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.368080 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.368328 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.368420 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.368636 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.368762 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.368983 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.369083 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.369294 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.369380 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.369606 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.369699 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.369911 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.370003 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.370215 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.370300 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.370518 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.370609 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.370825 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.370909 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.371128 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.371212 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.371436 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.371530 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.371740 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.371823 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.372044 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.372164 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.372348 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.372432 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.372655 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.372740 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.372986 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.373074 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.373293 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.373378 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.373604 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.373690 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.373907 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.374041 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.374214 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.374300 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.374519 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.374605 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.374864 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.374949 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.375173 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.375275 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.375505 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.375595 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.375831 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.375924 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.376146 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.376239 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.376463 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.376548 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.376773 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.376868 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.377643 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.377736 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.377964 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.378048 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.378277 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.378381 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.378586 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.378670 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.378898 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.378991 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.379215 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.379307 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.379524 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.379609 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.379843 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.379927 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.380152 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.380243 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.380471 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.380556 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.380777 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.380862 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.381118 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.381212 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.381424 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.381507 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.381740 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.381831 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.382084 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.382170 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.382406 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.382506 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.382719 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.382806 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.383036 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.383123 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.383349 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.383432 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.383665 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.383755 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.383974 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.384059 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.384282 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.384373 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.384592 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.384687 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.384921 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.385008 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.385242 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.385329 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.385553 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.385650 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.385872 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.385955 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.386184 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.386278 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.386502 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.386594 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.386810 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.386893 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.387124 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.387208 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.387431 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.387527 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.387747 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.387832 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.388071 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.388162 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.388386 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.388479 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.388702 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.388796 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.389040 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.389147 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.389350 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.389435 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.389662 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.389746 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.389967 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.390052 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.390274 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.390367 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.390581 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.390665 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.390892 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.391025 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.391201 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.391292 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.391513 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.391607 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.391818 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.391915 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.392129 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.392226 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.392458 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.392572 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.392772 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.392874 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.393106 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.393195 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.393412 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.393498 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.393722 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.393822 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.394036 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.394131 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.394358 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.394442 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.394671 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.394770 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.394983 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.395067 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.395292 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.395401 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.395608 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.395708 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.395917 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.396002 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.396223 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.396319 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.396529 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.396618 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.396837 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.396957 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.397175 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.397261 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.397488 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.397574 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.397815 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.397900 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.398135 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.398247 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.398444 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.398530 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.398760 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.398844 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.399082 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.399180 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.399393 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.399486 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.399705 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.399790 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.400017 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.400120 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.400332 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.400418 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.400642 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.400726 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.400978 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.401096 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.401298 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.401396 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.401609 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.401696 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.401925 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.402020 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.402243 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.402329 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.402555 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.402660 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.402866 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.402966 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.403179 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.403266 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.403488 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.403574 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.403800 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.403892 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.404111 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.404197 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.404424 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.404681 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.404776 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.405042 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.405333 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.405483 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.405669 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.405797 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.405989 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.406372 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.406567 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.406705 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.406901 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.407034 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.407230 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.407382 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.407548 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.407683 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.407855 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.407990 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.408169 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.408319 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.408505 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.408634 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.408817 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.408966 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.409151 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.409280 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.409465 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.409599 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.409771 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.409904 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.410079 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.410211 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.410389 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.410521 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.410697 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.410837 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.411001 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.411146 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.411310 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.411441 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.411616 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.411749 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.411926 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.412069 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.412231 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.412363 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.412544 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.412676 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.412852 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.412972 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.413193 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.413286 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.413501 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.413587 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.413812 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.413905 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.414120 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.414205 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.414426 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.414517 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.414734 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.414820 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.415043 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.415128 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.415389 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.415520 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.415698 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.415785 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.416038 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.416130 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.416344 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.416429 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.416652 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.416739 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.417005 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.417094 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.417316 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.417415 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.417625 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.417717 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.417931 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.418016 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.418234 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.418326 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.418542 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.418634 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.418846 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.418931 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.419154 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.419291 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.419460 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.419546 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.419768 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.419851 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.420075 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.420167 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.420376 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.420460 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.420685 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.420769 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.421011 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.421098 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.421322 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.421406 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.421631 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.421732 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.421933 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.422018 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.422240 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.422332 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.422543 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.422627 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.422849 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.422944 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.423154 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.423240 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.423463 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.423547 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.423770 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.423862 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.424610 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.424696 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.424930 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.425018 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.425240 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.425343 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.425546 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.425637 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.425851 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.425945 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.426158 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.426244 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.426462 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.426545 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.426771 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.426863 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.427077 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.427172 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.427380 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.427464 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.427711 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.427803 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.428019 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.428103 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.428324 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.428408 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.428627 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.428727 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.428946 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.429034 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.429258 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.429389 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.429572 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.429659 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.429876 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.429968 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.430188 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.430274 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.430494 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.430579 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.430800 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.430886 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.431106 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.431189 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.431413 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.431504 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.431718 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.431813 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.432021 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.432150 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.432326 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.432411 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.432630 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.432713 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.432955 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.433060 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.433265 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.433458 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.433576 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.433662 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.433878 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.433970 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.434189 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.434281 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.434493 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.434577 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.434800 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.434894 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.435106 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.435192 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.435456 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.435542 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.435766 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.435861 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.436082 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.436173 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.436404 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.436490 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.436716 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.436803 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.437055 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.437156 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.437369 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.437452 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.437673 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.437758 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.437990 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.438074 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.438294 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.438378 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.438607 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.438692 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.438913 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.438998 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.439220 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.439306 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.439547 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.439640 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.440383 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.440469 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.440695 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.440787 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.441039 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.441126 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.441357 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.441452 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.441681 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.441776 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.441990 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.442086 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.442300 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.442386 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.442607 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.442706 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.442915 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.442998 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.443227 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.443316 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.443535 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.443627 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.443845 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.443929 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.444159 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.444251 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.444468 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.444554 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.444778 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.444861 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.445113 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.445200 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.445421 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.445507 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.445732 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.445815 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.446040 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.446123 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.446347 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.446434 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.446656 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.446739 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.446964 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.447057 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.447267 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.447358 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.447577 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.447662 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.447882 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.447979 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.448190 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.448282 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.448495 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.448579 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.448806 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.448945 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.449137 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.449261 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.449567 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.449652 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.449873 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.449973 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.450183 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.450274 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.450493 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.450585 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.450806 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.450967 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.451121 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.451213 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.451428 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.451514 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.451745 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.451837 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.452054 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.452139 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.452438 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.452535 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.452751 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.452837 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.453083 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.453170 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.453391 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.453475 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.453695 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.453780 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.454005 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.454097 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.454316 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.454407 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.454620 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.454713 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.454927 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.455019 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.455277 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.455370 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.455585 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.455669 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.455909 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.455994 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.456238 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.456329 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.456564 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.456657 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.456935 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.457022 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.457309 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.457402 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.457625 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.457710 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.457953 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.458118 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.458280 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.458440 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.458605 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.458755 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.458931 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.459082 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.459238 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.459409 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.459553 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.459738 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.459864 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.460049 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.460191 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.460369 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.460519 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.460682 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.460831 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.461033 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.461172 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.461361 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.461526 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.461676 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.461789 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.461994 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.462112 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.462301 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.462427 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.462627 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.462752 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.462953 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.463167 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.463261 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.463491 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.463576 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.463804 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.463989 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.464134 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.464317 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.464464 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.464630 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.464773 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.464978 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.465109 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.465312 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.465423 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.465625 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.465732 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.465935 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.466042 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.466251 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.466368 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.466559 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.466675 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.466869 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.466989 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.467196 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.467302 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.467505 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.467612 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.467827 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.467920 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.468141 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.468227 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.468454 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.468539 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.468764 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.468933 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.469097 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.469184 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.469427 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.469514 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.469737 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.469832 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.470067 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.470153 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.470382 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.470473 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.470708 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.471307 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.471552 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.471637 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.471862 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.471945 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.472168 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.472262 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.472473 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.472559 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.472787 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.472878 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.473121 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.473216 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.473434 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.473536 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.473774 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.473859 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.474081 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.474212 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.474406 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.474491 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.474739 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.474830 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.475064 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.475149 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.475376 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.475461 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.475685 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.475780 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.476004 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.476124 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.476333 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.476418 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.476640 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.476734 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.476969 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.477057 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.477284 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.477371 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.477592 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.477691 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.477898 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.477984 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.478204 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.478289 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.478515 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.478612 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.478816 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.478901 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.479120 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.479204 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.479424 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.479511 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.479730 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.479849 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.480040 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.480125 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.480349 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.480447 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.480657 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.480741 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.480983 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.481073 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.481291 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.481378 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.481598 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.481691 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.481914 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.481999 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.482226 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.482315 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.482535 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.482620 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.482851 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.482947 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.483177 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.483261 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.483494 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.483594 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.483811 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.483905 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.484129 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.484215 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.484445 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.484530 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.484763 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.484856 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.485106 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.485193 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.485424 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.485507 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.485733 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.485826 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.486051 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.486136 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.486365 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.487065 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.487224 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.487310 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.487544 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.487748 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.487862 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.488078 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.488172 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.488394 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.488702 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.488788 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.489040 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.489140 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.489357 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.489444 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.489673 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.489759 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.489988 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.490072 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.490297 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.490382 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.490610 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.490696 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.490923 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.491015 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.491238 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.491325 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.491555 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.491640 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.491869 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.492026 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.492202 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.492288 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.492519 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.492612 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.492836 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.492938 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.493182 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.493269 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.493499 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.493585 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.493817 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.493903 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.494137 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.494223 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.494453 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.494544 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.494775 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.494861 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.495095 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.495181 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.495413 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.495510 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.495725 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.495816 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.496038 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.496124 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.496354 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.496446 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.496666 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.496750 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.497006 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.497095 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.497320 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.497409 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.497635 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.497718 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.497948 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.498032 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.498265 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.498357 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.498582 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.498669 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.498901 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.498996 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.499215 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.499304 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.499533 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.499619 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.499853 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.499947 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.500168 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.500380 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.500468 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.500698 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.500784 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.501059 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.501336 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.501422 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.501656 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.501741 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.501996 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.502094 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.502337 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.502422 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.502664 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.502749 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.502971 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.503069 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.503280 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.503372 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.503591 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.503677 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.503904 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.503990 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.504211 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.504297 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.504522 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.504615 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.504836 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.504963 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.505166 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.505251 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.505487 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.505574 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.505797 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.505883 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.506103 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.506337 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.506418 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.506691 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.506786 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.507012 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.507251 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.507336 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.507599 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.507692 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.507918 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.508011 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.508252 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.508339 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.508582 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.508679 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.508889 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.509005 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.509224 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.509309 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.509542 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.509634 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.509851 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.509935 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.510157 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.510241 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.510465 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.510558 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.510777 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.510869 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.511084 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.511169 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.511389 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.511474 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.511700 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.511793 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.512004 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.512089 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.512309 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.512437 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.512621 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.512716 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.512946 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.513035 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.513257 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.513345 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.513570 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.513692 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.513874 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.513966 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.514178 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.514264 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.514485 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.514578 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.514788 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.514881 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.515093 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.515179 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.515397 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.515480 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.515698 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.515794 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.516003 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.516087 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.516306 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.516390 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.516618 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.516718 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.516947 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.517036 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.517262 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.517349 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.517590 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.517764 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.517926 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.518012 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.518237 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.518323 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.518557 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.518651 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.518864 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.518955 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.519174 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.519259 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.519485 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.519569 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.519794 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.519877 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.520119 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.520204 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.520433 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.520527 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.520744 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.520991 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.521130 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.521331 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.521534 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.521656 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.521976 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.522061 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.522310 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.522403 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.522622 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.522710 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.522931 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.523016 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.523238 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.523336 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.523563 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.523649 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.523872 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.523964 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.524179 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.524274 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.524489 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.524574 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.524804 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.524889 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.525143 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.525239 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.525452 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.525536 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.525760 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.525845 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.526071 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.526156 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.526381 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.526466 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.526691 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.526791 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.526999 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.527084 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.527307 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.527398 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.527614 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.527700 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.527923 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.528010 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.528239 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.528324 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.528549 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.528643 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.528860 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.528965 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.529201 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.529294 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.529516 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.529617 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.529835 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.529921 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.530147 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.530233 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.530461 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.530565 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.530772 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.530858 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.531084 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.531421 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.531651 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.531740 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.531966 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.532052 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.532277 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.532371 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.532583 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.532668 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.532934 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.533256 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.533834 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.534082 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.534193 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.534403 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.534727 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.534820 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.535045 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.535140 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.535369 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.535453 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.535694 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.535779 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.536008 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.536103 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.536332 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.536425 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.536644 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.536731 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.536997 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.537096 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.537328 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.537414 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.537648 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.537739 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.537974 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.538060 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.538285 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.538370 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.538593 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.538679 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.538900 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.538994 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.539212 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.539298 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.539535 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.539622 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.539842 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.539927 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.540145 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.540229 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.540451 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.540548 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.540762 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.540847 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.541094 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.541187 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.541396 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.541489 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.541704 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.541799 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.542007 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.542091 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.542314 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.542408 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.542616 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.542737 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.542921 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.543005 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.543224 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.543316 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.543527 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.543612 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.543832 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.543915 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.544135 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.544228 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.544479 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.544577 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.544739 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.544823 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.545067 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.545165 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.545374 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.545458 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.545678 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.545762 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.545980 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.546065 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.546284 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.546368 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.546593 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.546678 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.546899 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.546985 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.547232 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.547318 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.547548 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.547664 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.547872 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.547958 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.548183 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.548270 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.548495 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.548587 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.548815 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.549022 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.549695 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.549793 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.550006 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.550100 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.550338 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.550421 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.550648 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.550741 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.550958 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.551051 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.551269 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.551360 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.551580 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.551666 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.551893 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.551981 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.552202 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.552287 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.552512 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.552603 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.552824 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.552930 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.553162 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.553247 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.553488 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.553574 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.553806 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.553893 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.554112 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.554202 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.554432 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.554525 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.554746 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.554832 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.555066 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.555151 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.555384 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.555476 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.555695 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.555779 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.556005 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.556089 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.556316 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.556409 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.556625 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.556710 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.556959 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.557047 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.557273 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.557359 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.557584 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.557668 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.557899 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.557983 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.558212 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.558304 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.558526 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.558612 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.558852 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.558944 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.559160 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.559247 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.559490 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.559575 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.559822 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.559917 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.560170 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.560261 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.560485 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.560570 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.560814 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.560924 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.561189 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.561274 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.561505 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.561588 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.561817 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.561915 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.562125 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.562210 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.562369 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 13:10:54.562478 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.562793 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.563102 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:10:54.563347 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 13:10:54.714144 n-d-861076-2 devstack@n-api.service[105060]: INFO dbcounter [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] Registered counter for database nova_api Oct 12 13:10:54.715518 n-d-861076-2 devstack@n-api.service[105059]: INFO dbcounter [None req-a62bd337-6583-4816-91fe-bd2b0dc0b5f8 None None] Registered counter for database nova_api Oct 12 13:10:54.734592 n-d-861076-2 devstack@n-api.service[105060]: DEBUG oslo_db.sqlalchemy.engines [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 13:10:54.737786 n-d-861076-2 devstack@n-api.service[105059]: DEBUG oslo_db.sqlalchemy.engines [None req-a62bd337-6583-4816-91fe-bd2b0dc0b5f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 13:10:54.741946 n-d-861076-2 devstack@n-api.service[105060]: DEBUG dbcounter [-] [105060] Writer thread running {{(pid=105060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 13:10:54.744443 n-d-861076-2 devstack@n-api.service[105059]: DEBUG dbcounter [-] [105059] Writer thread running {{(pid=105059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 13:10:54.798403 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.context [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c7d37a9d-54da-4741-8e88-e51a0f3ae3d5(cell1) {{(pid=105060) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 13:10:54.801308 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.context [None req-a62bd337-6583-4816-91fe-bd2b0dc0b5f8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c7d37a9d-54da-4741-8e88-e51a0f3ae3d5(cell1) {{(pid=105059) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 13:10:54.802789 n-d-861076-2 devstack@n-api.service[105060]: DEBUG oslo_concurrency.lockutils [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:10:54.803264 n-d-861076-2 devstack@n-api.service[105060]: DEBUG oslo_concurrency.lockutils [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:10:54.804838 n-d-861076-2 devstack@n-api.service[105060]: DEBUG oslo_concurrency.lockutils [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:10:54.805207 n-d-861076-2 devstack@n-api.service[105059]: DEBUG oslo_concurrency.lockutils [None req-a62bd337-6583-4816-91fe-bd2b0dc0b5f8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:10:54.805582 n-d-861076-2 devstack@n-api.service[105060]: DEBUG oslo_concurrency.lockutils [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:10:54.805722 n-d-861076-2 devstack@n-api.service[105059]: DEBUG oslo_concurrency.lockutils [None req-a62bd337-6583-4816-91fe-bd2b0dc0b5f8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:10:54.806041 n-d-861076-2 devstack@n-api.service[105060]: DEBUG oslo_concurrency.lockutils [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:10:54.807240 n-d-861076-2 devstack@n-api.service[105059]: DEBUG oslo_concurrency.lockutils [None req-a62bd337-6583-4816-91fe-bd2b0dc0b5f8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:10:54.807963 n-d-861076-2 devstack@n-api.service[105059]: DEBUG oslo_concurrency.lockutils [None req-a62bd337-6583-4816-91fe-bd2b0dc0b5f8 None None] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:10:54.808076 n-d-861076-2 devstack@n-api.service[105060]: DEBUG oslo_concurrency.lockutils [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:10:54.808421 n-d-861076-2 devstack@n-api.service[105059]: DEBUG oslo_concurrency.lockutils [None req-a62bd337-6583-4816-91fe-bd2b0dc0b5f8 None None] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:10:54.809987 n-d-861076-2 devstack@n-api.service[105060]: INFO dbcounter [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] Registered counter for database nova_cell0 Oct 12 13:10:54.810421 n-d-861076-2 devstack@n-api.service[105059]: DEBUG oslo_concurrency.lockutils [None req-a62bd337-6583-4816-91fe-bd2b0dc0b5f8 None None] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:10:54.812398 n-d-861076-2 devstack@n-api.service[105059]: INFO dbcounter [None req-a62bd337-6583-4816-91fe-bd2b0dc0b5f8 None None] Registered counter for database nova_cell0 Oct 12 13:10:54.814009 n-d-861076-2 devstack@n-api.service[105060]: INFO dbcounter [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] Registered counter for database nova_cell1 Oct 12 13:10:54.816404 n-d-861076-2 devstack@n-api.service[105059]: INFO dbcounter [None req-a62bd337-6583-4816-91fe-bd2b0dc0b5f8 None None] Registered counter for database nova_cell1 Oct 12 13:10:54.821470 n-d-861076-2 devstack@n-api.service[105060]: DEBUG oslo_db.sqlalchemy.engines [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 13:10:54.823219 n-d-861076-2 devstack@n-api.service[105060]: DEBUG oslo_db.sqlalchemy.engines [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 13:10:54.825821 n-d-861076-2 devstack@n-api.service[105059]: DEBUG oslo_db.sqlalchemy.engines [None req-a62bd337-6583-4816-91fe-bd2b0dc0b5f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 13:10:54.827490 n-d-861076-2 devstack@n-api.service[105059]: DEBUG oslo_db.sqlalchemy.engines [None req-a62bd337-6583-4816-91fe-bd2b0dc0b5f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 13:10:54.829258 n-d-861076-2 devstack@n-api.service[105060]: DEBUG dbcounter [-] [105060] Writer thread running {{(pid=105060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 13:10:54.832077 n-d-861076-2 devstack@n-api.service[105060]: DEBUG dbcounter [-] [105060] Writer thread running {{(pid=105060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 13:10:54.834282 n-d-861076-2 devstack@n-api.service[105059]: DEBUG dbcounter [-] [105059] Writer thread running {{(pid=105059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 13:10:54.835751 n-d-861076-2 devstack@n-api.service[105059]: DEBUG dbcounter [-] [105059] Writer thread running {{(pid=105059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 13:10:54.975473 n-d-861076-2 devstack@n-api.service[105060]: INFO dbcounter [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] Registered counter for database nova_cell0 Oct 12 13:10:54.979289 n-d-861076-2 devstack@n-api.service[105059]: INFO dbcounter [None req-a62bd337-6583-4816-91fe-bd2b0dc0b5f8 None None] Registered counter for database nova_cell0 Oct 12 13:10:54.984218 n-d-861076-2 devstack@n-api.service[105060]: DEBUG oslo_db.sqlalchemy.engines [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 13:10:54.987789 n-d-861076-2 devstack@n-api.service[105059]: DEBUG oslo_db.sqlalchemy.engines [None req-a62bd337-6583-4816-91fe-bd2b0dc0b5f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 13:10:54.989101 n-d-861076-2 devstack@n-api.service[105060]: DEBUG dbcounter [-] [105060] Writer thread running {{(pid=105060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 13:10:54.992423 n-d-861076-2 devstack@n-api.service[105059]: DEBUG dbcounter [-] [105059] Writer thread running {{(pid=105059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 13:10:55.387107 n-d-861076-2 devstack@n-api.service[105060]: WARNING keystonemiddleware.auth_token [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 13:10:55.394967 n-d-861076-2 devstack@n-api.service[105060]: WARNING keystonemiddleware.auth_token [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 13:10:55.418461 n-d-861076-2 devstack@n-api.service[105059]: WARNING keystonemiddleware.auth_token [None req-a62bd337-6583-4816-91fe-bd2b0dc0b5f8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 13:10:55.426255 n-d-861076-2 devstack@n-api.service[105059]: WARNING keystonemiddleware.auth_token [None req-a62bd337-6583-4816-91fe-bd2b0dc0b5f8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 13:10:55.733140 n-d-861076-2 devstack@n-api.service[105060]: WARNING keystonemiddleware.auth_token [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 13:10:55.739563 n-d-861076-2 devstack@n-api.service[105060]: WARNING keystonemiddleware.auth_token [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 13:10:55.744891 n-d-861076-2 devstack@n-api.service[105060]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56267808c9c0 pid: 105060 (default app) Oct 12 13:10:55.746980 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] Calling method '>' {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:10:55.748160 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001714 Oct 12 13:10:55.748577 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Wed Oct 12 13:10:55 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:10:55.764479 n-d-861076-2 devstack@n-api.service[105059]: WARNING keystonemiddleware.auth_token [None req-a62bd337-6583-4816-91fe-bd2b0dc0b5f8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 13:10:55.770464 n-d-861076-2 devstack@n-api.service[105059]: WARNING keystonemiddleware.auth_token [None req-a62bd337-6583-4816-91fe-bd2b0dc0b5f8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 13:10:55.775699 n-d-861076-2 devstack@n-api.service[105059]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56267808c9c0 pid: 105059 (default app) Oct 12 13:12:19.550304 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] Calling method '>' {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:12:19.551326 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 12 13:12:19.551734 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 12 13:12:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:12:19.563716 n-d-861076-2 devstack@n-api.service[105059]: DEBUG dbcounter [-] [105059] Writing DB stats nova_api:SELECT=3 {{(pid=105059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:12:19.564566 n-d-861076-2 devstack@n-api.service[105059]: DEBUG dbcounter [-] [105059] Writing DB stats nova_cell0:SELECT=3 {{(pid=105059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:12:19.565797 n-d-861076-2 devstack@n-api.service[105059]: DEBUG dbcounter [-] [105059] Writing DB stats nova_cell1:SELECT=3 {{(pid=105059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:12:19.567937 n-d-861076-2 devstack@n-api.service[105059]: DEBUG dbcounter [-] [105059] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:12:20.454452 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-c13954b1-71e0-4b1e-b72a-e5befc924e5f admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:12:20.488014 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-c13954b1-71e0-4b1e-b72a-e5befc924e5f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.929400 Oct 12 13:12:20.488765 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Oct 12 13:12:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:12:23.088290 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] Calling method '>' {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:12:23.089326 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-301bf647-00ec-4b72-8e19-5871acc3e7c5 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Oct 12 13:12:23.089882 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 12 13:12:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:12:23.524315 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-deabceda-6d07-4908-9f22-f5c58a802653 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 256, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "c1", "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true}} {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:12:23.618622 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-deabceda-6d07-4908-9f22-f5c58a802653 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.522705 Oct 12 13:12:23.619509 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Oct 12 13:12:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:12:23.633149 n-d-861076-2 devstack@n-api.service[105060]: DEBUG dbcounter [-] [105060] Writing DB stats nova_api:SELECT=3 {{(pid=105060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:12:23.634468 n-d-861076-2 devstack@n-api.service[105060]: DEBUG dbcounter [-] [105060] Writing DB stats nova_cell0:SELECT=3 {{(pid=105060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:12:23.635843 n-d-861076-2 devstack@n-api.service[105060]: DEBUG dbcounter [-] [105060] Writing DB stats nova_cell1:SELECT=3 {{(pid=105060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:12:23.636932 n-d-861076-2 devstack@n-api.service[105060]: DEBUG dbcounter [-] [105060] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:12:23.839492 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-9b3cbbd1-a01f-4669-ad54-4c4674bb9a79 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:12:23.988656 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-9b3cbbd1-a01f-4669-ad54-4c4674bb9a79 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.360707 Oct 12 13:12:23.989276 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Oct 12 13:12:23 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:12:26.639751 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-deabceda-6d07-4908-9f22-f5c58a802653 admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:12:26.640695 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-deabceda-6d07-4908-9f22-f5c58a802653 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 12 13:12:26.641653 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 12 13:12:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:12:27.471497 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-199a2f7f-2980-4146-b72f-b0984b95b43d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "swap": 0, "disk": 5, "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "vcpus": 1}} {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:12:27.614706 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-199a2f7f-2980-4146-b72f-b0984b95b43d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.960878 Oct 12 13:12:27.621821 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Oct 12 13:12:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:12:27.629576 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-e8377e89-14e0-4404-8849-9e95305a30a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:12:27.760879 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-e8377e89-14e0-4404-8849-9e95305a30a5 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.135049 Oct 12 13:12:27.762077 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Oct 12 13:12:27 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:12:30.637493 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-199a2f7f-2980-4146-b72f-b0984b95b43d admin admin] Calling method '>' {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:12:30.638451 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-199a2f7f-2980-4146-b72f-b0984b95b43d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 12 13:12:30.641444 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 12 13:12:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:12:31.154587 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-fd2948a7-1d93-4b0e-8697-734025d3061f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0, "id": "d2", "disk": 10, "name": "ds1G"}} {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:12:31.234513 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-fd2948a7-1d93-4b0e-8697-734025d3061f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.586495 Oct 12 13:12:31.235220 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Oct 12 13:12:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:12:31.248099 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-97883945-f4ac-4a68-9708-189ec9a44675 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:12:31.356297 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-97883945-f4ac-4a68-9708-189ec9a44675 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112422 Oct 12 13:12:31.366852 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Oct 12 13:12:31 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:12:33.964242 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-fd2948a7-1d93-4b0e-8697-734025d3061f admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:12:33.965215 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-fd2948a7-1d93-4b0e-8697-734025d3061f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 12 13:12:33.965838 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 12 13:12:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:12:34.445881 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-e8f842dc-1c7e-4253-8d89-0b35045ab528 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "id": "d3", "swap": 0}} {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:12:34.525970 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-e8f842dc-1c7e-4253-8d89-0b35045ab528 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.552810 Oct 12 13:12:34.526522 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Oct 12 13:12:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:12:34.539042 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-f5fc4366-dff4-49e3-9527-463c4dbb8a96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:12:34.624485 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-f5fc4366-dff4-49e3-9527-463c4dbb8a96 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089187 Oct 12 13:12:34.625807 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Oct 12 13:12:34 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:12:37.310830 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-e8f842dc-1c7e-4253-8d89-0b35045ab528 admin admin] Calling method '>' {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:12:37.312985 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-e8f842dc-1c7e-4253-8d89-0b35045ab528 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002094 Oct 12 13:12:37.323791 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 12 13:12:37 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:12:37.815134 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-57242921-dec6-4922-a420-48528f281ad3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "disk": 20, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "name": "ds4G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:12:37.900832 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-57242921-dec6-4922-a420-48528f281ad3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.581048 Oct 12 13:12:37.902200 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Oct 12 13:12:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:12:37.914609 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-f3f714f4-0912-4fc7-9810-01fe50bdb5f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:12:37.994210 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-f3f714f4-0912-4fc7-9810-01fe50bdb5f2 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083313 Oct 12 13:12:37.996141 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Oct 12 13:12:37 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:12:40.663701 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-57242921-dec6-4922-a420-48528f281ad3 admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:12:40.664639 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-57242921-dec6-4922-a420-48528f281ad3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 12 13:12:40.665085 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 12 13:12:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:12:41.115194 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-d0654a37-7a5d-4c03-9d8f-369c2bf02302 admin admin] Calling method '>' {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:12:41.141500 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-d0654a37-7a5d-4c03-9d8f-369c2bf02302 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.469975 Oct 12 13:12:41.142066 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Oct 12 13:12:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:12:43.733883 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-57242921-dec6-4922-a420-48528f281ad3 admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:12:43.734955 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-57242921-dec6-4922-a420-48528f281ad3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Oct 12 13:12:43.735350 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 12 13:12:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:12:44.180673 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-a5ff2b68-ca85-4ee8-91cb-073e6760cfa6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "1", "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:12:44.273644 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-a5ff2b68-ca85-4ee8-91cb-073e6760cfa6 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.532011 Oct 12 13:12:44.274208 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Oct 12 13:12:43 2022] POST /compute/v2.1/flavors => generated 402 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 13:12:44.291280 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-800176df-5314-40fc-acd2-d9c87829b01c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:12:44.389403 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-800176df-5314-40fc-acd2-d9c87829b01c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106334 Oct 12 13:12:44.390011 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Oct 12 13:12:44 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:12:47.054059 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-a5ff2b68-ca85-4ee8-91cb-073e6760cfa6 admin admin] Calling method '>' {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:12:47.055067 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-a5ff2b68-ca85-4ee8-91cb-073e6760cfa6 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 12 13:12:47.055459 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 12 13:12:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:12:47.456525 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-d608967e-fe44-40eb-a8fa-5926d68a30f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "ram": 2048, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:12:47.524752 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-d608967e-fe44-40eb-a8fa-5926d68a30f2 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.463149 Oct 12 13:12:47.525357 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Oct 12 13:12:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 13:12:47.537979 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-2b3674f1-2bad-4172-8730-ef29309a2024 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:12:47.602940 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-2b3674f1-2bad-4172-8730-ef29309a2024 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068948 Oct 12 13:12:47.603452 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Oct 12 13:12:47 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:12:50.218999 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-d608967e-fe44-40eb-a8fa-5926d68a30f2 admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:12:50.220021 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-d608967e-fe44-40eb-a8fa-5926d68a30f2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Oct 12 13:12:50.220434 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 12 13:12:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:12:50.629318 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-78dbc008-7321-4826-a58f-54a864987e10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "name": "m1.medium", "swap": 0, "disk": 40, "id": "3"}} {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:12:50.736487 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-78dbc008-7321-4826-a58f-54a864987e10 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.509281 Oct 12 13:12:50.737069 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Oct 12 13:12:50 2022] POST /compute/v2.1/flavors => generated 406 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:12:50.748950 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-2407f1cb-a1cc-4d05-805a-7a62e9975ebd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:12:50.753731 n-d-861076-2 devstack@n-api.service[105059]: DEBUG dbcounter [-] [105059] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:12:50.837445 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-2407f1cb-a1cc-4d05-805a-7a62e9975ebd admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091986 Oct 12 13:12:50.838369 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Oct 12 13:12:50 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:12:53.470006 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-78dbc008-7321-4826-a58f-54a864987e10 admin admin] Calling method '>' {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:12:53.471098 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-78dbc008-7321-4826-a58f-54a864987e10 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Oct 12 13:12:53.471523 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 12 13:12:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:12:53.897669 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-b2cf72e7-611f-4b29-a514-a95a3954a948 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "m1.large", "ram": 8192, "os-flavor-access:is_public": true, "disk": 80, "id": "4", "swap": 0, "rxtx_factor": 1.0}} {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:12:53.975937 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-b2cf72e7-611f-4b29-a514-a95a3954a948 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.496135 Oct 12 13:12:53.981352 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Oct 12 13:12:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:12:53.988943 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-c9b7f0db-dd3a-4d7d-a610-dab3c6cd3b4a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:12:53.994910 n-d-861076-2 devstack@n-api.service[105060]: DEBUG dbcounter [-] [105060] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=105060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:12:54.077684 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-c9b7f0db-dd3a-4d7d-a610-dab3c6cd3b4a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092715 Oct 12 13:12:54.078468 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Oct 12 13:12:53 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:12:56.679368 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-b2cf72e7-611f-4b29-a514-a95a3954a948 admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:12:56.680562 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-b2cf72e7-611f-4b29-a514-a95a3954a948 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001640 Oct 12 13:12:56.681011 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 12 13:12:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:12:57.128858 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-1be0c579-93b4-477f-bcfb-f50ee23ca38a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "disk": 160, "rxtx_factor": 1.0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "vcpus": 8, "id": "5"}} {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:12:57.208104 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-1be0c579-93b4-477f-bcfb-f50ee23ca38a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.520586 Oct 12 13:12:57.208728 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Oct 12 13:12:56 2022] POST /compute/v2.1/flavors => generated 408 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:12:57.221304 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-bfa68d4f-6913-41b7-940f-48cf0bd737c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:12:57.332730 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-bfa68d4f-6913-41b7-940f-48cf0bd737c9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115651 Oct 12 13:12:57.333387 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Oct 12 13:12:57 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:13:17.902336 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-1be0c579-93b4-477f-bcfb-f50ee23ca38a admin admin] Calling method '>' {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:13:17.903346 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-1be0c579-93b4-477f-bcfb-f50ee23ca38a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 12 13:13:17.903743 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 12 13:13:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:13:17.914701 n-d-861076-2 devstack@n-api.service[105059]: DEBUG dbcounter [-] [105059] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:13:18.292213 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-e1fd7523-d4c8-47e7-ae5f-673ed36855fe admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:13:18.310251 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-e1fd7523-d4c8-47e7-ae5f-673ed36855fe admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399944 Oct 12 13:13:18.319570 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Oct 12 13:13:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:13:19.602792 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-1be0c579-93b4-477f-bcfb-f50ee23ca38a admin admin] Calling method '>' {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:13:19.603826 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-1be0c579-93b4-477f-bcfb-f50ee23ca38a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 12 13:13:19.604223 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Oct 12 13:13:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:13:20.144189 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-0e746134-da0d-4a49-b919-03416f5b1e0b admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:13:20.149491 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.wsgi [None req-0e746134-da0d-4a49-b919-03416f5b1e0b admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 12 13:13:20.152676 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-0e746134-da0d-4a49-b919-03416f5b1e0b admin admin] Request method failure captured: Oct 12 13:13:20.152676 n-d-861076-2 devstack@n-api.service[105059]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 12 13:13:20.152676 n-d-861076-2 devstack@n-api.service[105059]: Accept: application/json Oct 12 13:13:20.152676 n-d-861076-2 devstack@n-api.service[105059]: Accept-Encoding: gzip, deflate Oct 12 13:13:20.152676 n-d-861076-2 devstack@n-api.service[105059]: Connection: keep-alive Oct 12 13:13:20.152676 n-d-861076-2 devstack@n-api.service[105059]: Content-Length: 0 Oct 12 13:13:20.152676 n-d-861076-2 devstack@n-api.service[105059]: Host: 10.222.0.52 Oct 12 13:13:20.152676 n-d-861076-2 devstack@n-api.service[105059]: Openstack-Api-Version: compute 2.92 Oct 12 13:13:20.152676 n-d-861076-2 devstack@n-api.service[105059]: Openstack-System-Scope: None Oct 12 13:13:20.152676 n-d-861076-2 devstack@n-api.service[105059]: User-Agent: python-novaclient Oct 12 13:13:20.152676 n-d-861076-2 devstack@n-api.service[105059]: X-Auth-Token: gAAAAABjRr1vKhafNzxsh_Po4np73sOjToPFfgJ4K8R6xt0MQlh9KTnRZT2V-l74Ag20gjEqQFNrs60EUMG8FqjqeUiDsuov6lPJSHLWWsRDDomTPLfcTeGyZ4PruxHp1vXYQq888mJdRzleRJ_VQO77GbJ5wlZgH31agTcSvmJDiqP3gSY9bl8 Oct 12 13:13:20.152676 n-d-861076-2 devstack@n-api.service[105059]: X-Domain-Id: None Oct 12 13:13:20.152676 n-d-861076-2 devstack@n-api.service[105059]: X-Domain-Name: None Oct 12 13:13:20.152676 n-d-861076-2 devstack@n-api.service[105059]: X-Identity-Status: Confirmed Oct 12 13:13:20.152676 n-d-861076-2 devstack@n-api.service[105059]: X-Is-Admin-Project: True Oct 12 13:13:20.152676 n-d-861076-2 devstack@n-api.service[105059]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 13:13:20.152676 n-d-861076-2 devstack@n-api.service[105059]: X-Project-Domain-Id: default Oct 12 13:13:20.152676 n-d-861076-2 devstack@n-api.service[105059]: X-Project-Domain-Name: Default Oct 12 13:13:20.152676 n-d-861076-2 devstack@n-api.service[105059]: X-Project-Id: 2760c6bd836b4e008bddfb8cbee11980 Oct 12 13:13:20.152676 n-d-861076-2 devstack@n-api.service[105059]: X-Project-Name: admin Oct 12 13:13:20.152676 n-d-861076-2 devstack@n-api.service[105059]: X-Role: member,admin,reader Oct 12 13:13:20.152676 n-d-861076-2 devstack@n-api.service[105059]: X-Roles: member,admin,reader Oct 12 13:13:20.154635 n-d-861076-2 devstack@n-api.service[105059]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2760c6bd836b4e008bddfb8cbee11980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2760c6bd836b4e008bddfb8cbee11980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2760c6bd836b4e008bddfb8cbee11980"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2760c6bd836b4e008bddfb8cbee11980"}]}] Oct 12 13:13:20.154635 n-d-861076-2 devstack@n-api.service[105059]: X-Tenant: admin Oct 12 13:13:20.154635 n-d-861076-2 devstack@n-api.service[105059]: X-Tenant-Id: 2760c6bd836b4e008bddfb8cbee11980 Oct 12 13:13:20.154635 n-d-861076-2 devstack@n-api.service[105059]: X-Tenant-Name: admin Oct 12 13:13:20.154635 n-d-861076-2 devstack@n-api.service[105059]: X-User: admin Oct 12 13:13:20.154635 n-d-861076-2 devstack@n-api.service[105059]: X-User-Domain-Id: default Oct 12 13:13:20.154635 n-d-861076-2 devstack@n-api.service[105059]: X-User-Domain-Name: Default Oct 12 13:13:20.154635 n-d-861076-2 devstack@n-api.service[105059]: X-User-Id: f630b812c30f4e5bbed5601d95d03984 Oct 12 13:13:20.154635 n-d-861076-2 devstack@n-api.service[105059]: X-User-Name: admin Oct 12 13:13:20.154635 n-d-861076-2 devstack@n-api.service[105059]: method: > Oct 12 13:13:20.154635 n-d-861076-2 devstack@n-api.service[105059]: exception: Flavor 42 could not be found. Oct 12 13:13:20.154635 n-d-861076-2 devstack@n-api.service[105059]: action_args: {'id': '42'} Oct 12 13:13:20.154635 n-d-861076-2 devstack@n-api.service[105059]: {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:13:20.154635 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:13:20.155979 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 13:13:20.155979 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 13:13:20.155979 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 13:13:20.155979 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 13:13:20.155979 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:13:20.155979 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:13:20.155979 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 13:13:20.155979 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 13:13:20.155979 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 13:13:20.155979 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:13:20.155979 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 13:13:20.155979 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 13:13:20.155979 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 12 13:13:20.155979 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Oct 12 13:13:20.155979 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:13:20.155979 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Oct 12 13:13:20.155979 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:13:20.155979 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:13:20.155979 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:13:20.157396 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:13:20.157396 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:13:20.157396 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:13:20.157396 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:13:20.157396 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 13:13:20.157396 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:13:20.157396 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 12 13:13:20.157396 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Oct 12 13:13:20.157396 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:13:20.157396 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Oct 12 13:13:20.157396 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:13:20.157396 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:13:20.157396 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:13:20.157396 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:13:20.157396 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:13:20.157396 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 12 13:13:20.157396 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Oct 12 13:13:20.157396 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-0e746134-da0d-4a49-b919-03416f5b1e0b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:13:20.158678 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-0e746134-da0d-4a49-b919-03416f5b1e0b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.393372 Oct 12 13:13:20.158678 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Oct 12 13:13:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 13:13:20.164008 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-03dbd2f8-3038-4a70-950c-6d2fc7a44954 admin admin] Calling method '>' {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:13:20.168118 n-d-861076-2 devstack@n-api.service[105060]: DEBUG dbcounter [-] [105060] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=105060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:13:20.187614 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-03dbd2f8-3038-4a70-950c-6d2fc7a44954 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027040 Oct 12 13:13:20.188176 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Oct 12 13:13:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:13:20.199050 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-63e8d4c4-a7c8-4aca-a94c-a72c56e1c331 admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:13:20.220432 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-63e8d4c4-a7c8-4aca-a94c-a72c56e1c331 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025759 Oct 12 13:13:20.220886 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Oct 12 13:13:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:13:20.230262 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-2d3ecf4b-1a16-49ce-926d-a44ca89af2e3 admin admin] Calling method '>' {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:13:20.236614 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.wsgi [None req-2d3ecf4b-1a16-49ce-926d-a44ca89af2e3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 12 13:13:20.240108 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-2d3ecf4b-1a16-49ce-926d-a44ca89af2e3 admin admin] Request method failure captured: Oct 12 13:13:20.240108 n-d-861076-2 devstack@n-api.service[105060]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 12 13:13:20.240108 n-d-861076-2 devstack@n-api.service[105060]: Accept: application/json Oct 12 13:13:20.240108 n-d-861076-2 devstack@n-api.service[105060]: Accept-Encoding: gzip, deflate Oct 12 13:13:20.240108 n-d-861076-2 devstack@n-api.service[105060]: Connection: keep-alive Oct 12 13:13:20.240108 n-d-861076-2 devstack@n-api.service[105060]: Content-Length: 0 Oct 12 13:13:20.240108 n-d-861076-2 devstack@n-api.service[105060]: Host: 10.222.0.52 Oct 12 13:13:20.240108 n-d-861076-2 devstack@n-api.service[105060]: Openstack-Api-Version: compute 2.92 Oct 12 13:13:20.240108 n-d-861076-2 devstack@n-api.service[105060]: Openstack-System-Scope: None Oct 12 13:13:20.240108 n-d-861076-2 devstack@n-api.service[105060]: User-Agent: python-novaclient Oct 12 13:13:20.240108 n-d-861076-2 devstack@n-api.service[105060]: X-Auth-Token: gAAAAABjRr1vKhafNzxsh_Po4np73sOjToPFfgJ4K8R6xt0MQlh9KTnRZT2V-l74Ag20gjEqQFNrs60EUMG8FqjqeUiDsuov6lPJSHLWWsRDDomTPLfcTeGyZ4PruxHp1vXYQq888mJdRzleRJ_VQO77GbJ5wlZgH31agTcSvmJDiqP3gSY9bl8 Oct 12 13:13:20.240108 n-d-861076-2 devstack@n-api.service[105060]: X-Domain-Id: None Oct 12 13:13:20.240108 n-d-861076-2 devstack@n-api.service[105060]: X-Domain-Name: None Oct 12 13:13:20.240108 n-d-861076-2 devstack@n-api.service[105060]: X-Identity-Status: Confirmed Oct 12 13:13:20.240108 n-d-861076-2 devstack@n-api.service[105060]: X-Is-Admin-Project: True Oct 12 13:13:20.240108 n-d-861076-2 devstack@n-api.service[105060]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 13:13:20.240108 n-d-861076-2 devstack@n-api.service[105060]: X-Project-Domain-Id: default Oct 12 13:13:20.240108 n-d-861076-2 devstack@n-api.service[105060]: X-Project-Domain-Name: Default Oct 12 13:13:20.240108 n-d-861076-2 devstack@n-api.service[105060]: X-Project-Id: 2760c6bd836b4e008bddfb8cbee11980 Oct 12 13:13:20.240108 n-d-861076-2 devstack@n-api.service[105060]: X-Project-Name: admin Oct 12 13:13:20.240108 n-d-861076-2 devstack@n-api.service[105060]: X-Role: member,admin,reader Oct 12 13:13:20.240108 n-d-861076-2 devstack@n-api.service[105060]: X-Roles: member,admin,reader Oct 12 13:13:20.241685 n-d-861076-2 devstack@n-api.service[105060]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2760c6bd836b4e008bddfb8cbee11980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2760c6bd836b4e008bddfb8cbee11980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2760c6bd836b4e008bddfb8cbee11980"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2760c6bd836b4e008bddfb8cbee11980"}]}] Oct 12 13:13:20.241685 n-d-861076-2 devstack@n-api.service[105060]: X-Tenant: admin Oct 12 13:13:20.241685 n-d-861076-2 devstack@n-api.service[105060]: X-Tenant-Id: 2760c6bd836b4e008bddfb8cbee11980 Oct 12 13:13:20.241685 n-d-861076-2 devstack@n-api.service[105060]: X-Tenant-Name: admin Oct 12 13:13:20.241685 n-d-861076-2 devstack@n-api.service[105060]: X-User: admin Oct 12 13:13:20.241685 n-d-861076-2 devstack@n-api.service[105060]: X-User-Domain-Id: default Oct 12 13:13:20.241685 n-d-861076-2 devstack@n-api.service[105060]: X-User-Domain-Name: Default Oct 12 13:13:20.241685 n-d-861076-2 devstack@n-api.service[105060]: X-User-Id: f630b812c30f4e5bbed5601d95d03984 Oct 12 13:13:20.241685 n-d-861076-2 devstack@n-api.service[105060]: X-User-Name: admin Oct 12 13:13:20.241685 n-d-861076-2 devstack@n-api.service[105060]: method: > Oct 12 13:13:20.241685 n-d-861076-2 devstack@n-api.service[105060]: exception: Flavor 42 could not be found. Oct 12 13:13:20.241685 n-d-861076-2 devstack@n-api.service[105060]: action_args: {'id': '42'} Oct 12 13:13:20.241685 n-d-861076-2 devstack@n-api.service[105060]: {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:13:20.241685 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:13:20.242726 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 13:13:20.242726 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 13:13:20.242726 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 13:13:20.242726 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 13:13:20.242726 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:13:20.242726 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:13:20.242726 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 13:13:20.242726 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 13:13:20.242726 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 13:13:20.242726 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:13:20.242726 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 13:13:20.242726 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 13:13:20.242726 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 12 13:13:20.242726 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Oct 12 13:13:20.242726 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:13:20.242726 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Oct 12 13:13:20.242726 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:13:20.242726 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:13:20.242726 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:13:20.244182 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:13:20.244182 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:13:20.244182 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:13:20.244182 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:13:20.244182 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 13:13:20.244182 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:13:20.244182 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 12 13:13:20.244182 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Oct 12 13:13:20.244182 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:13:20.244182 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Oct 12 13:13:20.244182 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:13:20.244182 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:13:20.244182 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:13:20.244182 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:13:20.244182 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:13:20.244182 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 12 13:13:20.244182 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Oct 12 13:13:20.244182 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-2d3ecf4b-1a16-49ce-926d-a44ca89af2e3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:13:20.245427 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-2d3ecf4b-1a16-49ce-926d-a44ca89af2e3 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014883 Oct 12 13:13:20.245427 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Oct 12 13:13:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 13:13:21.465122 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-63e8d4c4-a7c8-4aca-a94c-a72c56e1c331 admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:13:21.466142 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-63e8d4c4-a7c8-4aca-a94c-a72c56e1c331 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 12 13:13:21.467157 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Oct 12 13:13:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:13:21.985025 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-d38b9b2f-2ddf-443c-8b36-6f3957e04f1f admin admin] Calling method '>' {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:13:21.989900 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.wsgi [None req-d38b9b2f-2ddf-443c-8b36-6f3957e04f1f admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 12 13:13:21.991391 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-d38b9b2f-2ddf-443c-8b36-6f3957e04f1f admin admin] Request method failure captured: Oct 12 13:13:21.991391 n-d-861076-2 devstack@n-api.service[105060]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 12 13:13:21.991391 n-d-861076-2 devstack@n-api.service[105060]: Accept: application/json Oct 12 13:13:21.991391 n-d-861076-2 devstack@n-api.service[105060]: Accept-Encoding: gzip, deflate Oct 12 13:13:21.991391 n-d-861076-2 devstack@n-api.service[105060]: Connection: keep-alive Oct 12 13:13:21.991391 n-d-861076-2 devstack@n-api.service[105060]: Content-Length: 0 Oct 12 13:13:21.991391 n-d-861076-2 devstack@n-api.service[105060]: Host: 10.222.0.52 Oct 12 13:13:21.991391 n-d-861076-2 devstack@n-api.service[105060]: Openstack-Api-Version: compute 2.92 Oct 12 13:13:21.991391 n-d-861076-2 devstack@n-api.service[105060]: Openstack-System-Scope: None Oct 12 13:13:21.991391 n-d-861076-2 devstack@n-api.service[105060]: User-Agent: python-novaclient Oct 12 13:13:21.991391 n-d-861076-2 devstack@n-api.service[105060]: X-Auth-Token: gAAAAABjRr1xMLYIUh8NfLe4-9huydjO_6FKnQUHd5dRDWOM5nrXdqUR38KyUO7zo7WQabW9kEuJU_lt6dO4JOOSS77JgtgvhNATKLHhL9wgGLxuNlqL7mk8BrnxnrBpFdtr5QMs348JQfFHFDR1A991ykGcAPxJvWRjSpQLSHRA94kRK1pYA5w Oct 12 13:13:21.991391 n-d-861076-2 devstack@n-api.service[105060]: X-Domain-Id: None Oct 12 13:13:21.991391 n-d-861076-2 devstack@n-api.service[105060]: X-Domain-Name: None Oct 12 13:13:21.991391 n-d-861076-2 devstack@n-api.service[105060]: X-Identity-Status: Confirmed Oct 12 13:13:21.991391 n-d-861076-2 devstack@n-api.service[105060]: X-Is-Admin-Project: True Oct 12 13:13:21.991391 n-d-861076-2 devstack@n-api.service[105060]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 13:13:21.991391 n-d-861076-2 devstack@n-api.service[105060]: X-Project-Domain-Id: default Oct 12 13:13:21.991391 n-d-861076-2 devstack@n-api.service[105060]: X-Project-Domain-Name: Default Oct 12 13:13:21.991391 n-d-861076-2 devstack@n-api.service[105060]: X-Project-Id: 2760c6bd836b4e008bddfb8cbee11980 Oct 12 13:13:21.991391 n-d-861076-2 devstack@n-api.service[105060]: X-Project-Name: admin Oct 12 13:13:21.991391 n-d-861076-2 devstack@n-api.service[105060]: X-Role: member,admin,reader Oct 12 13:13:21.991391 n-d-861076-2 devstack@n-api.service[105060]: X-Roles: member,admin,reader Oct 12 13:13:21.992951 n-d-861076-2 devstack@n-api.service[105060]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2760c6bd836b4e008bddfb8cbee11980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2760c6bd836b4e008bddfb8cbee11980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2760c6bd836b4e008bddfb8cbee11980"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2760c6bd836b4e008bddfb8cbee11980"}]}] Oct 12 13:13:21.992951 n-d-861076-2 devstack@n-api.service[105060]: X-Tenant: admin Oct 12 13:13:21.992951 n-d-861076-2 devstack@n-api.service[105060]: X-Tenant-Id: 2760c6bd836b4e008bddfb8cbee11980 Oct 12 13:13:21.992951 n-d-861076-2 devstack@n-api.service[105060]: X-Tenant-Name: admin Oct 12 13:13:21.992951 n-d-861076-2 devstack@n-api.service[105060]: X-User: admin Oct 12 13:13:21.992951 n-d-861076-2 devstack@n-api.service[105060]: X-User-Domain-Id: default Oct 12 13:13:21.992951 n-d-861076-2 devstack@n-api.service[105060]: X-User-Domain-Name: Default Oct 12 13:13:21.992951 n-d-861076-2 devstack@n-api.service[105060]: X-User-Id: f630b812c30f4e5bbed5601d95d03984 Oct 12 13:13:21.992951 n-d-861076-2 devstack@n-api.service[105060]: X-User-Name: admin Oct 12 13:13:21.992951 n-d-861076-2 devstack@n-api.service[105060]: method: > Oct 12 13:13:21.992951 n-d-861076-2 devstack@n-api.service[105060]: exception: Flavor 84 could not be found. Oct 12 13:13:21.992951 n-d-861076-2 devstack@n-api.service[105060]: action_args: {'id': '84'} Oct 12 13:13:21.992951 n-d-861076-2 devstack@n-api.service[105060]: {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:13:21.992951 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:13:21.993878 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 13:13:21.993878 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 13:13:21.993878 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 13:13:21.993878 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 13:13:21.993878 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:13:21.993878 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:13:21.993878 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 13:13:21.993878 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 13:13:21.993878 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 13:13:21.993878 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:13:21.993878 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 13:13:21.993878 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 13:13:21.993878 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 12 13:13:21.993878 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Oct 12 13:13:21.993878 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:13:21.993878 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Oct 12 13:13:21.993878 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:13:21.993878 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:13:21.993878 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:13:21.995161 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:13:21.995161 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:13:21.995161 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:13:21.995161 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:13:21.995161 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 13:13:21.995161 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:13:21.995161 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 12 13:13:21.995161 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Oct 12 13:13:21.995161 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:13:21.995161 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Oct 12 13:13:21.995161 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:13:21.995161 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:13:21.995161 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:13:21.995161 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:13:21.995161 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:13:21.995161 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 12 13:13:21.995161 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Oct 12 13:13:21.995161 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-d38b9b2f-2ddf-443c-8b36-6f3957e04f1f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:13:21.996397 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-d38b9b2f-2ddf-443c-8b36-6f3957e04f1f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.389337 Oct 12 13:13:21.996397 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Oct 12 13:13:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 13:13:22.003055 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-9b8e51e4-efa0-4cdc-9695-473df053336e admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:13:22.018447 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-9b8e51e4-efa0-4cdc-9695-473df053336e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019039 Oct 12 13:13:22.018985 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Oct 12 13:13:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:13:22.028129 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-947ed2c2-fd9d-42be-b517-9b1d8f2c2996 admin admin] Calling method '>' {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:13:22.043362 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-947ed2c2-fd9d-42be-b517-9b1d8f2c2996 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018722 Oct 12 13:13:22.043868 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Oct 12 13:13:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:13:22.052635 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-2b653a13-d8ce-47a7-b038-c660a34be100 admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:13:22.057455 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.wsgi [None req-2b653a13-d8ce-47a7-b038-c660a34be100 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 12 13:13:22.058942 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-2b653a13-d8ce-47a7-b038-c660a34be100 admin admin] Request method failure captured: Oct 12 13:13:22.058942 n-d-861076-2 devstack@n-api.service[105059]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 12 13:13:22.058942 n-d-861076-2 devstack@n-api.service[105059]: Accept: application/json Oct 12 13:13:22.058942 n-d-861076-2 devstack@n-api.service[105059]: Accept-Encoding: gzip, deflate Oct 12 13:13:22.058942 n-d-861076-2 devstack@n-api.service[105059]: Connection: keep-alive Oct 12 13:13:22.058942 n-d-861076-2 devstack@n-api.service[105059]: Content-Length: 0 Oct 12 13:13:22.058942 n-d-861076-2 devstack@n-api.service[105059]: Host: 10.222.0.52 Oct 12 13:13:22.058942 n-d-861076-2 devstack@n-api.service[105059]: Openstack-Api-Version: compute 2.92 Oct 12 13:13:22.058942 n-d-861076-2 devstack@n-api.service[105059]: Openstack-System-Scope: None Oct 12 13:13:22.058942 n-d-861076-2 devstack@n-api.service[105059]: User-Agent: python-novaclient Oct 12 13:13:22.058942 n-d-861076-2 devstack@n-api.service[105059]: X-Auth-Token: gAAAAABjRr1xMLYIUh8NfLe4-9huydjO_6FKnQUHd5dRDWOM5nrXdqUR38KyUO7zo7WQabW9kEuJU_lt6dO4JOOSS77JgtgvhNATKLHhL9wgGLxuNlqL7mk8BrnxnrBpFdtr5QMs348JQfFHFDR1A991ykGcAPxJvWRjSpQLSHRA94kRK1pYA5w Oct 12 13:13:22.058942 n-d-861076-2 devstack@n-api.service[105059]: X-Domain-Id: None Oct 12 13:13:22.058942 n-d-861076-2 devstack@n-api.service[105059]: X-Domain-Name: None Oct 12 13:13:22.058942 n-d-861076-2 devstack@n-api.service[105059]: X-Identity-Status: Confirmed Oct 12 13:13:22.058942 n-d-861076-2 devstack@n-api.service[105059]: X-Is-Admin-Project: True Oct 12 13:13:22.058942 n-d-861076-2 devstack@n-api.service[105059]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 13:13:22.058942 n-d-861076-2 devstack@n-api.service[105059]: X-Project-Domain-Id: default Oct 12 13:13:22.058942 n-d-861076-2 devstack@n-api.service[105059]: X-Project-Domain-Name: Default Oct 12 13:13:22.058942 n-d-861076-2 devstack@n-api.service[105059]: X-Project-Id: 2760c6bd836b4e008bddfb8cbee11980 Oct 12 13:13:22.058942 n-d-861076-2 devstack@n-api.service[105059]: X-Project-Name: admin Oct 12 13:13:22.058942 n-d-861076-2 devstack@n-api.service[105059]: X-Role: member,admin,reader Oct 12 13:13:22.058942 n-d-861076-2 devstack@n-api.service[105059]: X-Roles: member,admin,reader Oct 12 13:13:22.060964 n-d-861076-2 devstack@n-api.service[105059]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2760c6bd836b4e008bddfb8cbee11980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2760c6bd836b4e008bddfb8cbee11980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2760c6bd836b4e008bddfb8cbee11980"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2760c6bd836b4e008bddfb8cbee11980"}]}] Oct 12 13:13:22.060964 n-d-861076-2 devstack@n-api.service[105059]: X-Tenant: admin Oct 12 13:13:22.060964 n-d-861076-2 devstack@n-api.service[105059]: X-Tenant-Id: 2760c6bd836b4e008bddfb8cbee11980 Oct 12 13:13:22.060964 n-d-861076-2 devstack@n-api.service[105059]: X-Tenant-Name: admin Oct 12 13:13:22.060964 n-d-861076-2 devstack@n-api.service[105059]: X-User: admin Oct 12 13:13:22.060964 n-d-861076-2 devstack@n-api.service[105059]: X-User-Domain-Id: default Oct 12 13:13:22.060964 n-d-861076-2 devstack@n-api.service[105059]: X-User-Domain-Name: Default Oct 12 13:13:22.060964 n-d-861076-2 devstack@n-api.service[105059]: X-User-Id: f630b812c30f4e5bbed5601d95d03984 Oct 12 13:13:22.060964 n-d-861076-2 devstack@n-api.service[105059]: X-User-Name: admin Oct 12 13:13:22.060964 n-d-861076-2 devstack@n-api.service[105059]: method: > Oct 12 13:13:22.060964 n-d-861076-2 devstack@n-api.service[105059]: exception: Flavor 84 could not be found. Oct 12 13:13:22.060964 n-d-861076-2 devstack@n-api.service[105059]: action_args: {'id': '84'} Oct 12 13:13:22.060964 n-d-861076-2 devstack@n-api.service[105059]: {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:13:22.060964 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:13:22.061934 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 13:13:22.061934 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 13:13:22.061934 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 13:13:22.061934 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 13:13:22.061934 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:13:22.061934 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:13:22.061934 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 13:13:22.061934 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 13:13:22.061934 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 13:13:22.061934 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:13:22.061934 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 13:13:22.061934 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 13:13:22.061934 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 12 13:13:22.061934 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Oct 12 13:13:22.061934 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:13:22.061934 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Oct 12 13:13:22.061934 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:13:22.061934 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:13:22.061934 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:13:22.063300 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:13:22.063300 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:13:22.063300 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:13:22.063300 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:13:22.063300 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 13:13:22.063300 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:13:22.063300 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 12 13:13:22.063300 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Oct 12 13:13:22.063300 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:13:22.063300 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Oct 12 13:13:22.063300 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:13:22.063300 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:13:22.063300 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:13:22.063300 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:13:22.063300 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:13:22.063300 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 12 13:13:22.063300 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Oct 12 13:13:22.063300 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-2b653a13-d8ce-47a7-b038-c660a34be100 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:13:22.064522 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-2b653a13-d8ce-47a7-b038-c660a34be100 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011045 Oct 12 13:13:22.064522 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Oct 12 13:13:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 13:13:23.265864 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-947ed2c2-fd9d-42be-b517-9b1d8f2c2996 admin admin] Calling method '>' {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:13:23.266886 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-947ed2c2-fd9d-42be-b517-9b1d8f2c2996 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 12 13:13:23.267289 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Oct 12 13:13:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:13:23.778369 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-05916d0a-ca3b-4222-8be6-80e8b562a7f8 admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:13:23.784449 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.wsgi [None req-05916d0a-ca3b-4222-8be6-80e8b562a7f8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 12 13:13:23.785970 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-05916d0a-ca3b-4222-8be6-80e8b562a7f8 admin admin] Request method failure captured: Oct 12 13:13:23.785970 n-d-861076-2 devstack@n-api.service[105059]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 12 13:13:23.785970 n-d-861076-2 devstack@n-api.service[105059]: Accept: application/json Oct 12 13:13:23.785970 n-d-861076-2 devstack@n-api.service[105059]: Accept-Encoding: gzip, deflate Oct 12 13:13:23.785970 n-d-861076-2 devstack@n-api.service[105059]: Connection: keep-alive Oct 12 13:13:23.785970 n-d-861076-2 devstack@n-api.service[105059]: Content-Length: 0 Oct 12 13:13:23.785970 n-d-861076-2 devstack@n-api.service[105059]: Host: 10.222.0.52 Oct 12 13:13:23.785970 n-d-861076-2 devstack@n-api.service[105059]: Openstack-Api-Version: compute 2.92 Oct 12 13:13:23.785970 n-d-861076-2 devstack@n-api.service[105059]: Openstack-System-Scope: None Oct 12 13:13:23.785970 n-d-861076-2 devstack@n-api.service[105059]: User-Agent: python-novaclient Oct 12 13:13:23.785970 n-d-861076-2 devstack@n-api.service[105059]: X-Auth-Token: gAAAAABjRr1ziQQrTuz_0E6-nlkfP1UXM4VIJkq6Pa2rgjQTfQLyo-J1Gf8CkNZjzqGgxoDihMS3j0H4KYAsD2Cp-QzsR1oQ2r8Si2v9wee-lpat6UVYz2buI9AMXsJE7_99eQ7P_ttwrNxApFoQLQkc9Ft8PUTMbc3gCo1zGocvI8wr2IRmEHc Oct 12 13:13:23.785970 n-d-861076-2 devstack@n-api.service[105059]: X-Domain-Id: None Oct 12 13:13:23.785970 n-d-861076-2 devstack@n-api.service[105059]: X-Domain-Name: None Oct 12 13:13:23.785970 n-d-861076-2 devstack@n-api.service[105059]: X-Identity-Status: Confirmed Oct 12 13:13:23.785970 n-d-861076-2 devstack@n-api.service[105059]: X-Is-Admin-Project: True Oct 12 13:13:23.785970 n-d-861076-2 devstack@n-api.service[105059]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 13:13:23.785970 n-d-861076-2 devstack@n-api.service[105059]: X-Project-Domain-Id: default Oct 12 13:13:23.785970 n-d-861076-2 devstack@n-api.service[105059]: X-Project-Domain-Name: Default Oct 12 13:13:23.785970 n-d-861076-2 devstack@n-api.service[105059]: X-Project-Id: 2760c6bd836b4e008bddfb8cbee11980 Oct 12 13:13:23.785970 n-d-861076-2 devstack@n-api.service[105059]: X-Project-Name: admin Oct 12 13:13:23.785970 n-d-861076-2 devstack@n-api.service[105059]: X-Role: member,admin,reader Oct 12 13:13:23.785970 n-d-861076-2 devstack@n-api.service[105059]: X-Roles: member,admin,reader Oct 12 13:13:23.787442 n-d-861076-2 devstack@n-api.service[105059]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2760c6bd836b4e008bddfb8cbee11980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2760c6bd836b4e008bddfb8cbee11980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2760c6bd836b4e008bddfb8cbee11980"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2760c6bd836b4e008bddfb8cbee11980"}]}] Oct 12 13:13:23.787442 n-d-861076-2 devstack@n-api.service[105059]: X-Tenant: admin Oct 12 13:13:23.787442 n-d-861076-2 devstack@n-api.service[105059]: X-Tenant-Id: 2760c6bd836b4e008bddfb8cbee11980 Oct 12 13:13:23.787442 n-d-861076-2 devstack@n-api.service[105059]: X-Tenant-Name: admin Oct 12 13:13:23.787442 n-d-861076-2 devstack@n-api.service[105059]: X-User: admin Oct 12 13:13:23.787442 n-d-861076-2 devstack@n-api.service[105059]: X-User-Domain-Id: default Oct 12 13:13:23.787442 n-d-861076-2 devstack@n-api.service[105059]: X-User-Domain-Name: Default Oct 12 13:13:23.787442 n-d-861076-2 devstack@n-api.service[105059]: X-User-Id: f630b812c30f4e5bbed5601d95d03984 Oct 12 13:13:23.787442 n-d-861076-2 devstack@n-api.service[105059]: X-User-Name: admin Oct 12 13:13:23.787442 n-d-861076-2 devstack@n-api.service[105059]: method: > Oct 12 13:13:23.787442 n-d-861076-2 devstack@n-api.service[105059]: exception: Flavor 451 could not be found. Oct 12 13:13:23.787442 n-d-861076-2 devstack@n-api.service[105059]: action_args: {'id': '451'} Oct 12 13:13:23.787442 n-d-861076-2 devstack@n-api.service[105059]: {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:13:23.787442 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:13:23.788362 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 13:13:23.788362 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 13:13:23.788362 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 13:13:23.788362 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 13:13:23.788362 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:13:23.788362 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:13:23.788362 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 13:13:23.788362 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 13:13:23.788362 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 13:13:23.788362 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:13:23.788362 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 13:13:23.788362 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 13:13:23.788362 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 12 13:13:23.788362 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Oct 12 13:13:23.788362 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:13:23.788362 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Oct 12 13:13:23.788362 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:13:23.788362 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:13:23.788362 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:13:23.789746 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:13:23.789746 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:13:23.789746 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:13:23.789746 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:13:23.789746 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 13:13:23.789746 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:13:23.789746 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 12 13:13:23.789746 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Oct 12 13:13:23.789746 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:13:23.789746 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Oct 12 13:13:23.789746 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:13:23.789746 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:13:23.789746 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:13:23.789746 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:13:23.789746 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:13:23.789746 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 12 13:13:23.789746 n-d-861076-2 devstack@n-api.service[105059]: ERROR nova.api.openstack.wsgi Oct 12 13:13:23.789746 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-05916d0a-ca3b-4222-8be6-80e8b562a7f8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:13:23.790952 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-05916d0a-ca3b-4222-8be6-80e8b562a7f8 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.385044 Oct 12 13:13:23.790952 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Oct 12 13:13:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 13:13:23.797506 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-fae4c5cd-0bec-4a2a-afd4-072611f68b4e admin admin] Calling method '>' {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:13:23.812741 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-fae4c5cd-0bec-4a2a-afd4-072611f68b4e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019407 Oct 12 13:13:23.813290 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Oct 12 13:13:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:13:23.822349 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-441af8dc-38ea-416c-9c0d-b783d70785bc admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:13:23.837008 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-441af8dc-38ea-416c-9c0d-b783d70785bc admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018117 Oct 12 13:13:23.837539 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Oct 12 13:13:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:13:23.846426 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-26b773d7-ab2d-40e2-bf4f-a2822dd851c3 admin admin] Calling method '>' {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:13:23.851412 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.wsgi [None req-26b773d7-ab2d-40e2-bf4f-a2822dd851c3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 12 13:13:23.852989 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-26b773d7-ab2d-40e2-bf4f-a2822dd851c3 admin admin] Request method failure captured: Oct 12 13:13:23.852989 n-d-861076-2 devstack@n-api.service[105060]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 12 13:13:23.852989 n-d-861076-2 devstack@n-api.service[105060]: Accept: application/json Oct 12 13:13:23.852989 n-d-861076-2 devstack@n-api.service[105060]: Accept-Encoding: gzip, deflate Oct 12 13:13:23.852989 n-d-861076-2 devstack@n-api.service[105060]: Connection: keep-alive Oct 12 13:13:23.852989 n-d-861076-2 devstack@n-api.service[105060]: Content-Length: 0 Oct 12 13:13:23.852989 n-d-861076-2 devstack@n-api.service[105060]: Host: 10.222.0.52 Oct 12 13:13:23.852989 n-d-861076-2 devstack@n-api.service[105060]: Openstack-Api-Version: compute 2.92 Oct 12 13:13:23.852989 n-d-861076-2 devstack@n-api.service[105060]: Openstack-System-Scope: None Oct 12 13:13:23.852989 n-d-861076-2 devstack@n-api.service[105060]: User-Agent: python-novaclient Oct 12 13:13:23.852989 n-d-861076-2 devstack@n-api.service[105060]: X-Auth-Token: gAAAAABjRr1ziQQrTuz_0E6-nlkfP1UXM4VIJkq6Pa2rgjQTfQLyo-J1Gf8CkNZjzqGgxoDihMS3j0H4KYAsD2Cp-QzsR1oQ2r8Si2v9wee-lpat6UVYz2buI9AMXsJE7_99eQ7P_ttwrNxApFoQLQkc9Ft8PUTMbc3gCo1zGocvI8wr2IRmEHc Oct 12 13:13:23.852989 n-d-861076-2 devstack@n-api.service[105060]: X-Domain-Id: None Oct 12 13:13:23.852989 n-d-861076-2 devstack@n-api.service[105060]: X-Domain-Name: None Oct 12 13:13:23.852989 n-d-861076-2 devstack@n-api.service[105060]: X-Identity-Status: Confirmed Oct 12 13:13:23.852989 n-d-861076-2 devstack@n-api.service[105060]: X-Is-Admin-Project: True Oct 12 13:13:23.852989 n-d-861076-2 devstack@n-api.service[105060]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 13:13:23.852989 n-d-861076-2 devstack@n-api.service[105060]: X-Project-Domain-Id: default Oct 12 13:13:23.852989 n-d-861076-2 devstack@n-api.service[105060]: X-Project-Domain-Name: Default Oct 12 13:13:23.852989 n-d-861076-2 devstack@n-api.service[105060]: X-Project-Id: 2760c6bd836b4e008bddfb8cbee11980 Oct 12 13:13:23.852989 n-d-861076-2 devstack@n-api.service[105060]: X-Project-Name: admin Oct 12 13:13:23.852989 n-d-861076-2 devstack@n-api.service[105060]: X-Role: member,admin,reader Oct 12 13:13:23.852989 n-d-861076-2 devstack@n-api.service[105060]: X-Roles: member,admin,reader Oct 12 13:13:23.854619 n-d-861076-2 devstack@n-api.service[105060]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2760c6bd836b4e008bddfb8cbee11980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2760c6bd836b4e008bddfb8cbee11980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2760c6bd836b4e008bddfb8cbee11980"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2760c6bd836b4e008bddfb8cbee11980"}]}] Oct 12 13:13:23.854619 n-d-861076-2 devstack@n-api.service[105060]: X-Tenant: admin Oct 12 13:13:23.854619 n-d-861076-2 devstack@n-api.service[105060]: X-Tenant-Id: 2760c6bd836b4e008bddfb8cbee11980 Oct 12 13:13:23.854619 n-d-861076-2 devstack@n-api.service[105060]: X-Tenant-Name: admin Oct 12 13:13:23.854619 n-d-861076-2 devstack@n-api.service[105060]: X-User: admin Oct 12 13:13:23.854619 n-d-861076-2 devstack@n-api.service[105060]: X-User-Domain-Id: default Oct 12 13:13:23.854619 n-d-861076-2 devstack@n-api.service[105060]: X-User-Domain-Name: Default Oct 12 13:13:23.854619 n-d-861076-2 devstack@n-api.service[105060]: X-User-Id: f630b812c30f4e5bbed5601d95d03984 Oct 12 13:13:23.854619 n-d-861076-2 devstack@n-api.service[105060]: X-User-Name: admin Oct 12 13:13:23.854619 n-d-861076-2 devstack@n-api.service[105060]: method: > Oct 12 13:13:23.854619 n-d-861076-2 devstack@n-api.service[105060]: exception: Flavor 451 could not be found. Oct 12 13:13:23.854619 n-d-861076-2 devstack@n-api.service[105060]: action_args: {'id': '451'} Oct 12 13:13:23.854619 n-d-861076-2 devstack@n-api.service[105060]: {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:13:23.854619 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:13:23.855572 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 13:13:23.855572 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 13:13:23.855572 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 13:13:23.855572 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 13:13:23.855572 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:13:23.855572 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:13:23.855572 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 13:13:23.855572 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 13:13:23.855572 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 13:13:23.855572 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:13:23.855572 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 13:13:23.855572 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 13:13:23.855572 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 12 13:13:23.855572 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Oct 12 13:13:23.855572 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:13:23.855572 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Oct 12 13:13:23.855572 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:13:23.855572 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:13:23.855572 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:13:23.856620 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:13:23.856620 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:13:23.856620 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:13:23.856620 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:13:23.856620 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 13:13:23.856620 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:13:23.856620 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 12 13:13:23.856620 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Oct 12 13:13:23.856620 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:13:23.856620 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Oct 12 13:13:23.856620 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:13:23.856620 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:13:23.856620 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:13:23.856620 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:13:23.856620 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:13:23.856620 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 12 13:13:23.856620 n-d-861076-2 devstack@n-api.service[105060]: ERROR nova.api.openstack.wsgi Oct 12 13:13:23.856620 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-26b773d7-ab2d-40e2-bf4f-a2822dd851c3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:13:23.858172 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-26b773d7-ab2d-40e2-bf4f-a2822dd851c3 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011371 Oct 12 13:13:23.858172 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Oct 12 13:13:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 13:13:25.055475 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-441af8dc-38ea-416c-9c0d-b783d70785bc admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:13:25.056486 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-441af8dc-38ea-416c-9c0d-b783d70785bc admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 12 13:13:25.056887 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Oct 12 13:13:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:13:25.578352 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-5f6f12e7-b525-478f-a0b7-3ede6ab36762 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:13:25.654870 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-5f6f12e7-b525-478f-a0b7-3ede6ab36762 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.459147 Oct 12 13:13:25.655343 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Oct 12 13:13:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 13:13:26.867887 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-441af8dc-38ea-416c-9c0d-b783d70785bc admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:13:26.868881 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-441af8dc-38ea-416c-9c0d-b783d70785bc admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Oct 12 13:13:26.869300 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Oct 12 13:13:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:13:27.391303 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-4c9ea227-a401-460b-b528-0601490e8dff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:13:27.456560 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-4c9ea227-a401-460b-b528-0601490e8dff admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.450998 Oct 12 13:13:27.457145 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Oct 12 13:13:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:13:28.656818 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-441af8dc-38ea-416c-9c0d-b783d70785bc admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:13:28.657846 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-441af8dc-38ea-416c-9c0d-b783d70785bc admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 12 13:13:28.658237 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Oct 12 13:13:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:13:29.172589 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-b3956507-3501-49e4-b3b8-2c6a2e3ecf00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:13:29.238061 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-b3956507-3501-49e4-b3b8-2c6a2e3ecf00 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.443773 Oct 12 13:13:29.238620 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Oct 12 13:13:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:13:30.446701 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-441af8dc-38ea-416c-9c0d-b783d70785bc admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:13:30.447694 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-441af8dc-38ea-416c-9c0d-b783d70785bc admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Oct 12 13:13:30.448080 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Oct 12 13:13:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:13:30.962142 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-7b75fb9f-c6f1-4910-9cac-0844be5bc2d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:13:31.039102 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-7b75fb9f-c6f1-4910-9cac-0844be5bc2d1 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.456199 Oct 12 13:13:31.046469 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Oct 12 13:13:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:13:32.251119 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-441af8dc-38ea-416c-9c0d-b783d70785bc admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:13:32.252121 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-441af8dc-38ea-416c-9c0d-b783d70785bc admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Oct 12 13:13:32.259370 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Oct 12 13:13:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:13:32.770454 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-1539d1d7-5eb6-4177-aa0f-90d37c942ac1 admin admin] Calling method '>' {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:13:32.791161 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-1539d1d7-5eb6-4177-aa0f-90d37c942ac1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.402186 Oct 12 13:13:32.791699 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Wed Oct 12 13:13:32 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:14:29.177028 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-441af8dc-38ea-416c-9c0d-b783d70785bc admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:14:29.178038 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-441af8dc-38ea-416c-9c0d-b783d70785bc admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 12 13:14:29.178442 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 931 bytes} [Wed Oct 12 13:14:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:14:29.188695 n-d-861076-2 devstack@n-api.service[105060]: DEBUG dbcounter [-] [105060] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:14:29.564933 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-5b94ddc6-013d-45ad-a56f-1ca2e00f9162 admin admin] Calling method '>' {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:14:29.585624 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-5b94ddc6-013d-45ad-a56f-1ca2e00f9162 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.401354 Oct 12 13:14:29.586160 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Oct 12 13:14:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:14:29.606635 n-d-861076-2 devstack@n-api.service[105059]: DEBUG dbcounter [-] [105059] Writing DB stats nova_api:SELECT=14 {{(pid=105059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:14:29.610249 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-d14f740c-7c38-422e-9203-a0f5f2b0ef18 admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:14:29.617327 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-d14f740c-7c38-422e-9203-a0f5f2b0ef18 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012201 Oct 12 13:14:29.619121 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1283 bytes} [Wed Oct 12 13:14:29 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:14:29.629632 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-3aa00ef3-550a-4cfa-a655-dff72d4c8b35 admin admin] Calling method '>' {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:14:29.637494 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-3aa00ef3-550a-4cfa-a655-dff72d4c8b35 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011520 Oct 12 13:14:29.638288 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1286 bytes} [Wed Oct 12 13:14:29 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:14:29.650495 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-bfc4550f-97cd-4528-bafc-a6f4d65b6e7f admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:14:29.661266 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-bfc4550f-97cd-4528-bafc-a6f4d65b6e7f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014907 Oct 12 13:14:29.661845 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1286 bytes} [Wed Oct 12 13:14:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:14:29.673809 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-06674d22-17cd-4edc-a946-a164548c3e83 admin admin] Calling method '>' {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:14:29.681063 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-06674d22-17cd-4edc-a946-a164548c3e83 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010781 Oct 12 13:14:29.681577 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1283 bytes} [Wed Oct 12 13:14:29 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:20:01.723612 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-bfc4550f-97cd-4528-bafc-a6f4d65b6e7f admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:20:01.724622 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-bfc4550f-97cd-4528-bafc-a6f4d65b6e7f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Oct 12 13:20:01.725046 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Oct 12 13:20:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:20:01.865178 n-d-861076-2 devstack@n-api.service[105060]: DEBUG dbcounter [-] [105060] Writing DB stats nova_api:SELECT=6 {{(pid=105060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:20:02.002981 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-39a0f792-ec93-480b-9155-049c93f92f32 admin admin] Calling method '>' {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:20:02.007651 n-d-861076-2 devstack@n-api.service[105060]: DEBUG oslo_concurrency.lockutils [None req-39a0f792-ec93-480b-9155-049c93f92f32 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:20:02.008126 n-d-861076-2 devstack@n-api.service[105060]: DEBUG oslo_concurrency.lockutils [None req-39a0f792-ec93-480b-9155-049c93f92f32 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:20:02.008556 n-d-861076-2 devstack@n-api.service[105060]: DEBUG oslo_concurrency.lockutils [None req-39a0f792-ec93-480b-9155-049c93f92f32 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:20:02.009304 n-d-861076-2 devstack@n-api.service[105060]: DEBUG oslo_concurrency.lockutils [None req-39a0f792-ec93-480b-9155-049c93f92f32 admin admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:20:02.009756 n-d-861076-2 devstack@n-api.service[105060]: DEBUG oslo_concurrency.lockutils [None req-39a0f792-ec93-480b-9155-049c93f92f32 admin admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:20:02.010174 n-d-861076-2 devstack@n-api.service[105060]: DEBUG oslo_concurrency.lockutils [None req-39a0f792-ec93-480b-9155-049c93f92f32 admin admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:20:02.049314 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-39a0f792-ec93-480b-9155-049c93f92f32 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.185409 Oct 12 13:20:02.049870 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Oct 12 13:20:01 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:20:03.107842 n-d-861076-2 devstack@n-api.service[105059]: DEBUG nova.api.openstack.wsgi [None req-bfc4550f-97cd-4528-bafc-a6f4d65b6e7f admin admin] Calling method '>' {{(pid=105059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:20:03.108842 n-d-861076-2 devstack@n-api.service[105059]: INFO nova.api.openstack.requestlog [None req-bfc4550f-97cd-4528-bafc-a6f4d65b6e7f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Oct 12 13:20:03.109271 n-d-861076-2 devstack@n-api.service[105059]: [pid: 105059|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Oct 12 13:20:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:20:03.303473 n-d-861076-2 devstack@n-api.service[105060]: DEBUG nova.api.openstack.wsgi [None req-17ea9464-cc15-40e9-a46d-85da44f35ccb admin admin] Calling method '>' {{(pid=105060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:20:03.306909 n-d-861076-2 devstack@n-api.service[105060]: DEBUG oslo_concurrency.lockutils [None req-17ea9464-cc15-40e9-a46d-85da44f35ccb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:20:03.307387 n-d-861076-2 devstack@n-api.service[105060]: DEBUG oslo_concurrency.lockutils [None req-17ea9464-cc15-40e9-a46d-85da44f35ccb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:20:03.307832 n-d-861076-2 devstack@n-api.service[105060]: DEBUG oslo_concurrency.lockutils [None req-17ea9464-cc15-40e9-a46d-85da44f35ccb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:20:03.308530 n-d-861076-2 devstack@n-api.service[105060]: DEBUG oslo_concurrency.lockutils [None req-17ea9464-cc15-40e9-a46d-85da44f35ccb admin admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:20:03.309025 n-d-861076-2 devstack@n-api.service[105060]: DEBUG oslo_concurrency.lockutils [None req-17ea9464-cc15-40e9-a46d-85da44f35ccb admin admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:20:03.309445 n-d-861076-2 devstack@n-api.service[105060]: DEBUG oslo_concurrency.lockutils [None req-17ea9464-cc15-40e9-a46d-85da44f35ccb admin admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:20:03.332548 n-d-861076-2 devstack@n-api.service[105060]: INFO nova.api.openstack.requestlog [None req-17ea9464-cc15-40e9-a46d-85da44f35ccb admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.085069 Oct 12 13:20:03.333061 n-d-861076-2 devstack@n-api.service[105060]: [pid: 105060|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Oct 12 13:20:03 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:20:47.743413 n-d-861076-2 devstack@n-api.service[105058]: Wed Oct 12 13:20:47 2022 - graceful shutdown triggered... Oct 12 13:20:47.743533 n-d-861076-2 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 12 13:20:47.744400 n-d-861076-2 devstack@n-api.service[105059]: Gracefully killing worker 1 (pid: 105059)... Oct 12 13:20:47.744795 n-d-861076-2 devstack@n-api.service[105060]: Gracefully killing worker 2 (pid: 105060)... Oct 12 13:20:47.870128 n-d-861076-2 devstack@n-api.service[105059]: DEBUG dbcounter [-] [105059] Writing DB stats nova_api:SELECT=4 {{(pid=105059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:20:48.745482 n-d-861076-2 devstack@n-api.service[105058]: worker 1 buried after 1 seconds Oct 12 13:20:48.745907 n-d-861076-2 devstack@n-api.service[105058]: worker 2 buried after 1 seconds Oct 12 13:20:48.745907 n-d-861076-2 devstack@n-api.service[105058]: goodbye to uWSGI. Oct 12 13:20:48.746988 n-d-861076-2 systemd[1]: devstack@n-api.service: Succeeded. Oct 12 13:20:48.747570 n-d-861076-2 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 12 13:20:48.750335 n-d-861076-2 systemd[1]: Starting Devstack devstack@n-api.service... Oct 12 13:20:48.768004 n-d-861076-2 devstack@n-api.service[120915]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 12 13:20:48.785050 n-d-861076-2 devstack@n-api.service[120915]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 12 13:20:48 2022] *** Oct 12 13:20:48.785050 n-d-861076-2 devstack@n-api.service[120915]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 13:20:48.785050 n-d-861076-2 devstack@n-api.service[120915]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 13:20:48.785050 n-d-861076-2 devstack@n-api.service[120915]: nodename: n-d-861076-2 Oct 12 13:20:48.785050 n-d-861076-2 devstack@n-api.service[120915]: machine: x86_64 Oct 12 13:20:48.785050 n-d-861076-2 devstack@n-api.service[120915]: clock source: unix Oct 12 13:20:48.785050 n-d-861076-2 devstack@n-api.service[120915]: pcre jit disabled Oct 12 13:20:48.785050 n-d-861076-2 devstack@n-api.service[120915]: detected number of CPU cores: 4 Oct 12 13:20:48.785050 n-d-861076-2 devstack@n-api.service[120915]: current working directory: / Oct 12 13:20:48.785050 n-d-861076-2 devstack@n-api.service[120915]: detected binary path: /usr/bin/uwsgi-core Oct 12 13:20:48.785050 n-d-861076-2 devstack@n-api.service[120915]: your processes number limit is 47680 Oct 12 13:20:48.785050 n-d-861076-2 devstack@n-api.service[120915]: your memory page size is 4096 bytes Oct 12 13:20:48.786007 n-d-861076-2 devstack@n-api.service[120915]: detected max file descriptor number: 2048 Oct 12 13:20:48.786007 n-d-861076-2 devstack@n-api.service[120915]: lock engine: pthread robust mutexes Oct 12 13:20:48.786007 n-d-861076-2 devstack@n-api.service[120915]: thunder lock: enabled Oct 12 13:20:48.786007 n-d-861076-2 devstack@n-api.service[120915]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 12 13:20:48.786007 n-d-861076-2 devstack@n-api.service[120915]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 12 13:20:48.827274 n-d-861076-2 devstack@n-api.service[120915]: Python main interpreter initialized at 0x555e4fdc09c0 Oct 12 13:20:48.827274 n-d-861076-2 devstack@n-api.service[120915]: python threads support enabled Oct 12 13:20:48.827274 n-d-861076-2 devstack@n-api.service[120915]: your server socket listen backlog is limited to 100 connections Oct 12 13:20:48.827274 n-d-861076-2 devstack@n-api.service[120915]: your mercy for graceful operations on workers is 90 seconds Oct 12 13:20:48.827748 n-d-861076-2 devstack@n-api.service[120915]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 13:20:48.827748 n-d-861076-2 devstack@n-api.service[120915]: *** Operational MODE: preforking *** Oct 12 13:20:48.827992 n-d-861076-2 devstack@n-api.service[120915]: *** uWSGI is running in multiple interpreter mode *** Oct 12 13:20:48.827992 n-d-861076-2 devstack@n-api.service[120915]: spawned uWSGI master process (pid: 120915) Oct 12 13:20:48.828197 n-d-861076-2 systemd[1]: Started Devstack devstack@n-api.service. Oct 12 13:20:48.829115 n-d-861076-2 devstack@n-api.service[120915]: spawned uWSGI worker 1 (pid: 120932, cores: 1) Oct 12 13:20:48.832333 n-d-861076-2 devstack@n-api.service[120915]: spawned uWSGI worker 2 (pid: 120933, cores: 1) Oct 12 13:20:48.832333 n-d-861076-2 devstack@n-api.service[120915]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 13:20:49.485479 n-d-861076-2 devstack@n-api.service[120932]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 13:20:49.496076 n-d-861076-2 devstack@n-api.service[120933]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 13:20:50.653966 n-d-861076-2 devstack@n-api.service[120932]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 13:20:50.653966 n-d-861076-2 devstack@n-api.service[120932]: from cryptography.utils import int_from_bytes Oct 12 13:20:50.654614 n-d-861076-2 devstack@n-api.service[120932]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 13:20:50.654614 n-d-861076-2 devstack@n-api.service[120932]: from cryptography.utils import int_from_bytes Oct 12 13:20:50.654744 n-d-861076-2 devstack@n-api.service[120933]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 13:20:50.654744 n-d-861076-2 devstack@n-api.service[120933]: from cryptography.utils import int_from_bytes Oct 12 13:20:50.655146 n-d-861076-2 devstack@n-api.service[120933]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 13:20:50.655146 n-d-861076-2 devstack@n-api.service[120933]: from cryptography.utils import int_from_bytes Oct 12 13:20:53.057148 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 13:20:53.057760 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 13:20:53.057970 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 13:20:53.058323 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 13:20:53.058582 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 13:20:53.058977 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.059305 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.059625 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.059944 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.060273 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.060582 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.060919 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.061244 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.061569 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.061829 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.062143 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.062624 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-861076-2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.062947 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.063255 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.063567 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.063887 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.064193 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.064515 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.064820 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.065359 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.065809 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.066118 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.066565 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.066769 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.067103 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.067394 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.067713 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.068023 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.068347 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.068660 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.069095 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-861076-2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.069422 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.069731 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.070043 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.070461 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.071342 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.071649 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.071972 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.072296 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.072603 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.072950 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.073273 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.073593 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.073912 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.074213 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.074520 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.074830 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.075150 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.075459 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.075762 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.076013 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.076320 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.076640 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.076980 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.077305 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.077557 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.077806 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.078124 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.078444 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.078757 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.078876 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 13:20:53.079294 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.079370 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 13:20:53.079474 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.079648 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 13:20:53.079763 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.079957 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.080074 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 13:20:53.080263 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 13:20:53.080376 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.080567 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.080671 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.080872 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.081001 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.081212 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.081327 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.081529 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.081632 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.081854 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.081960 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.082164 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.082275 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.082483 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.082581 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.082831 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.082934 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.083114 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.083220 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.083413 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.083516 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.083731 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.083827 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.084054 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.084183 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-861076-2 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.084361 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.084509 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.084679 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.084818 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.085033 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.085157 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.085348 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.085477 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.085653 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.085785 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.085962 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.086110 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.086282 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.086442 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.086641 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.086945 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.087050 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.087194 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.087294 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.087494 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.087595 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.087798 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.087889 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.088117 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.088215 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.088425 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.088521 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.088731 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.088836 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.089064 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.089174 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.089361 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.089475 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.089669 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.089769 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.089974 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.090110 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.090281 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.090400 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-861076-2 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.090590 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.090695 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.090899 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.091013 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.091206 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.091312 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.091511 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.091689 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.091797 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.092004 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.092116 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.092318 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.092429 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.092643 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.092740 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.092992 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.093106 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.093312 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.093418 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.093617 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.093725 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.093923 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.094028 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.094229 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.094414 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.094549 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.094666 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.094853 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.094949 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.095160 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.095273 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.095467 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.095564 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.095779 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.095880 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.096081 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.096184 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.096387 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.096484 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.096639 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.096745 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.096974 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.097084 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.097300 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.097402 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.097598 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.097691 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.097906 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.098005 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.098173 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.098262 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.098425 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.098516 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.098747 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.098839 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.099065 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.099162 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.099381 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.099498 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.099679 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.099776 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.099984 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.100076 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.100288 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.100394 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.100591 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.100715 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.100920 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.101042 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.101226 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.101334 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.101536 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.101633 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.101845 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.101955 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.102670 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.102778 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.102977 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.103074 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.103290 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.103385 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.103615 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.103712 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.103946 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.104042 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.104258 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.104354 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.104568 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.104674 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.104933 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.105032 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.105251 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.105355 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.105562 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.105659 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.105877 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.105984 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.106196 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.106364 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.106517 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.106660 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.106813 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.106956 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.107099 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.107256 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.107427 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.107576 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.107728 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.107873 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.108016 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.108183 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.108328 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.108479 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.108623 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.108765 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.108947 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.109115 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.109260 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.109403 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.109562 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.109713 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.109867 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.110052 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.110324 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.110476 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.110628 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.110800 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.110962 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.111116 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.111260 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.111410 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.111556 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.111706 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.111858 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.112009 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.112162 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.112316 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.112467 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.112611 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.112764 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.112939 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.113091 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.113234 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.113395 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.113540 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.113694 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.113845 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.113996 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.114146 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.114300 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.114467 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.114619 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.114764 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.114906 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.114906 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.115195 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.115345 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.115496 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.115647 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.115810 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.115962 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.116120 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.116263 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.116405 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.116547 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.116699 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.116852 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.117032 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.117178 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.117327 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.117470 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.117736 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.118394 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.118548 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.118703 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.118857 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.119014 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.119166 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.119324 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.119476 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.119620 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.119773 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.119926 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.120078 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.120235 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.120473 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.120632 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.120789 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.120951 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.121101 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.121326 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.121472 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.121472 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.121744 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.121895 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.122053 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.122205 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.122350 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.122493 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.122642 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.122797 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.122954 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.122954 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.123243 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.123243 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.123532 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.123684 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.123837 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.123989 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.124134 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.124277 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.124428 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.124578 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.124746 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 13:20:53.124925 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.125077 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.125222 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.125375 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.125530 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.125674 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.125825 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.125971 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.126122 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.126268 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.126421 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.126587 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.126739 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.126890 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.127041 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.127193 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.127352 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.127503 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.127655 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.127805 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.127957 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.128101 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.128253 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.128406 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.128574 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.128730 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.128880 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.129067 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.129218 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.129387 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.129538 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.129688 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.129845 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.130007 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.130157 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.130321 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.130510 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.130666 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.130823 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.130984 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.131146 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.131297 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.131455 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.131613 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.131763 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.131763 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.132069 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.132220 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.132378 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.132539 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.132702 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.132864 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.133078 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.133232 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.133388 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.133547 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.133707 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.133864 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.134014 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.134172 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.134321 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.134470 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.134639 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.134791 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.134940 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.135095 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.135245 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.135404 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.135561 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.135713 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.135870 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.136020 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.136181 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.136340 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.136521 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.136693 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.136843 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.137017 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.137169 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.137336 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.137488 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.137645 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.137804 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.137962 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.138111 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.138273 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.138434 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.138596 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.138754 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.138906 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.139054 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.139217 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.139375 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.139533 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.139695 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.139857 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.140021 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.140178 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.140336 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.140497 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.140666 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.140817 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.141036 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.141191 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.141341 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.141491 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.141640 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.141797 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.141961 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.142112 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.142261 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.142418 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.142567 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.142731 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.142893 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.143046 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.143195 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.143352 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.143501 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.143660 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.143810 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.143959 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.144116 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.144274 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.144423 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.144585 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.144754 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.144923 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.145091 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.145242 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.145392 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.145556 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.145716 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.145874 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.146024 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.146174 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.146331 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.146491 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.146641 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.146809 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.146967 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.147125 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.147276 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.147436 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.147593 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.147751 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.147908 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.148060 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.148223 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.148373 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.148523 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.148673 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.148832 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.149025 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.149187 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.149339 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.149495 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.149646 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.149803 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.149954 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.150181 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.150353 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.150513 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.150664 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.150825 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.151012 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.151169 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.151320 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.151470 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.151627 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.151627 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.152192 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.152344 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.152502 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.152652 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.152801 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.152980 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.153156 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.153315 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.153474 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.153626 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.153775 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.153932 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.154092 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.154242 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.154397 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.154549 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.154705 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.154855 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.155025 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.155186 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.155343 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.155493 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.155653 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.155818 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.155968 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.156117 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.156265 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.156414 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.156570 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.156734 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.156891 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.157076 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.157237 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.157386 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.157543 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.157704 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.157862 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.158011 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.158160 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.158308 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.158456 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.158618 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.158769 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.158918 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.159077 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.159226 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.159384 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.159533 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.159690 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.159848 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.160006 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.160157 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.160321 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.160476 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.160625 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.160773 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.160963 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.161142 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.161306 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.161466 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.161617 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.161773 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.161932 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.162082 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.162245 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.162403 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.162559 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.162717 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.162875 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.163040 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.163201 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.163351 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.163513 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.163671 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.163828 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.163989 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.164147 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.164305 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.164962 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.165124 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.165285 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.165452 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.165602 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.165762 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.165762 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.166056 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.166205 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.166362 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.166513 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.166662 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.166810 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.166966 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.166966 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.167262 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.167412 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.167581 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.167738 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.167888 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.168046 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.168198 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.168355 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.168505 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.168654 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.168812 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.169018 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.169185 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.169345 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.169504 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.169675 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.169826 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.169974 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.170123 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.170280 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.170447 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.170605 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.170762 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.170913 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.171069 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.171225 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.171385 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.171534 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.171702 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.171852 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.172001 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.172149 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.172312 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.172478 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.172636 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.172786 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.172956 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.173125 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.173289 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.173450 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.173600 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.173768 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.173927 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.174091 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.174241 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.174404 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.174562 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.174721 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.174872 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.175030 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.175187 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.175336 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.175494 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.175654 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.175803 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.175962 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.176111 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.176266 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.176423 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.176582 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.176731 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.176949 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.177118 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.177277 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.177436 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.177594 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.177766 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.177919 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.178076 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.178233 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.178404 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.178608 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.178770 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.178928 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.179087 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.179237 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.179394 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.179545 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.179715 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.179885 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.180043 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.180789 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.180978 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.181151 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.181303 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.181452 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.181602 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.181752 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.181911 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.182076 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.182233 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.182233 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.182534 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.182686 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.182844 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.183008 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.183166 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.183323 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.183480 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.183636 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.183785 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.183945 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.184095 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.184253 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.184410 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.184579 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.184739 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.184890 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.185135 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.185296 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.185447 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.185612 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.185845 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.186007 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.186165 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.186316 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.186465 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.186626 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.186786 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.186944 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.187103 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.187255 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.187412 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.187563 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.187721 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.187873 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.188030 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.188182 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.188331 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.188494 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.188654 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.188812 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.189025 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.189182 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.189339 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.189505 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.189656 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.189806 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.189806 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.190098 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.190256 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.190416 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.190566 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.190734 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.190898 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.191049 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.191200 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.191200 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.191508 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.191667 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.191903 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.192064 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.192216 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.192377 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.192535 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.192704 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.192868 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.193052 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.193205 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.193358 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.193514 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.193665 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.193828 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.193997 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.194173 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.194335 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.194486 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.194650 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.194817 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.194975 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.195133 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.195290 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.195442 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.195605 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.195785 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.195950 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.196107 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.196268 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.196426 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.196595 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.196746 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.196955 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.197114 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.197275 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.197426 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.197590 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.197748 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.197898 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.198048 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.198204 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.198368 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.198527 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.198679 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.198828 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.199006 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.199188 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.199356 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.199515 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.199675 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.199827 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.199976 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.200131 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.200291 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.200442 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.200600 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.200771 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.200944 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.201113 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.201280 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.201433 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.201589 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.201741 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.201891 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.202050 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.202212 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.202377 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.202534 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.202692 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.202851 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.203025 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.203177 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.203327 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.203485 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.203636 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.203794 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.203953 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.204105 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.204254 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.204404 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.204560 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.204711 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.204874 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.205086 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.205255 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.205412 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.205563 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.205723 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.205880 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.206032 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.206182 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.206331 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.206487 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.206652 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.206803 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.206961 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.207122 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.207273 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.207422 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.207581 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.207731 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.207888 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.208047 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.208197 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.208354 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.208519 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.208671 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.208827 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.209012 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.209177 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.209337 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.209488 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.209645 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.209898 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.210052 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.210211 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.210371 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.210587 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.210748 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.210902 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.211059 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.211233 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.211419 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.211578 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.211729 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.211886 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.212045 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.212198 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.212358 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.212509 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.212659 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.212816 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.213008 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.213174 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.213349 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.213507 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.213657 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.213814 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.213973 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.214209 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.214444 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.214599 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.214756 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.214906 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.215065 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.215215 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.215375 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.215538 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.215689 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.215848 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.216012 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.216163 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.216313 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.216509 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.216671 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.216830 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.217018 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.217180 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.217331 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.217482 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.217655 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.217807 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.217971 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.218122 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.218357 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.218517 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.218677 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.218837 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.218994 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.219146 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.219297 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.219447 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.219610 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.219769 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.219769 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.220065 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.220223 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.220373 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.220373 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.220669 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.220832 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.221028 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.221192 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.221343 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.221565 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.221730 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.221888 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.222047 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.222199 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.222357 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.222518 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.222670 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.222819 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.222969 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.223119 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.223276 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.223441 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.223592 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.223753 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.223911 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.224070 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.224227 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.224388 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.224540 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.224696 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.224849 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.225041 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.225158 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.225264 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.225369 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.225472 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.225566 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.225652 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.225745 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.225845 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.225937 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.226022 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.226111 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.226202 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.226299 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.226384 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.226467 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.226556 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.226646 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.226736 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.226828 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.226913 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.227542 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.227662 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.227758 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.227871 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.228013 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.228107 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.228199 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.228290 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.228373 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.228470 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.228563 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.228647 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.228752 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.228845 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.229074 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.229184 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.229272 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.229355 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.229438 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.229528 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.229619 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.229716 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.229807 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.229904 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.229996 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.230088 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.230179 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.230262 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.230344 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.230433 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.230516 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.230623 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.230709 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.230791 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.230874 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.230956 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.231038 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.231129 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.231129 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.231281 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.231371 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.231455 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.231546 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.231637 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.231722 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.231810 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.231901 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.231985 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.232080 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.232180 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.232271 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.232362 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.232457 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.232542 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.232634 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.232724 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.232814 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.232931 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.233014 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.233085 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.233172 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.233263 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.233354 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.233445 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.233529 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.233620 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.233768 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.233954 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.234113 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.234267 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.234425 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.234595 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.234753 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.234920 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.235079 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.235231 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.235391 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.235555 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.235714 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.235874 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.236034 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.236185 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.236337 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.236501 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.236653 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.236810 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.237020 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.237184 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.237351 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.237509 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.237718 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.237903 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.238083 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.238293 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.238467 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.238633 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.238785 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.238934 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.239097 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.239255 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.239417 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.239570 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.239728 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.239887 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.240037 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.240188 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.240351 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.240504 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.240654 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.240804 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.240986 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.241167 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.241319 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.241469 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.241628 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.241793 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.241945 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.242104 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.242255 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.242413 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.242563 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.243341 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.243341 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.243661 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.243826 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.243976 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.244126 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.244284 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.244284 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.244579 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.244756 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.244937 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.245107 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.245322 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.245656 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.245968 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.246277 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.246433 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.246584 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.246763 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.247004 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.247158 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.247317 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.247516 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.247669 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.247821 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.247981 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.248141 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.248307 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.248478 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.248637 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.248848 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.249062 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.249225 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.249377 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.249527 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.249677 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.249841 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.250003 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.250163 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.250315 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.250478 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.250636 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.250796 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.250962 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.251123 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.251282 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.251434 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.251586 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.251745 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.251904 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.252064 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.252226 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.252402 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.252563 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.252715 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.252874 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.253049 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.253213 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.253373 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.253535 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.253696 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.253854 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.254013 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.254166 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.254317 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.254491 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.254643 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.254794 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.254945 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.255102 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.255268 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.255428 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.255588 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.255740 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.255898 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.256057 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.256222 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.256384 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.256535 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.256685 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.256835 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.257037 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.257200 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.257353 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.257503 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.257652 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.257803 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.257962 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.258121 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.258376 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.258475 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.258563 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.258652 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.258767 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.258767 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.258933 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.259018 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.259107 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.259329 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.259433 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.259637 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.259738 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.259946 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.260039 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.260272 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.260379 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.260582 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.260673 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.260885 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.261008 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.261219 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.261319 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.261530 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.261627 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.261833 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.261930 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.262138 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.262228 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.262457 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.262550 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.262763 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.262862 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.263083 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.263182 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.263393 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.263485 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.263719 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.263922 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.264030 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.264291 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.264402 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.264595 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.264706 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.264939 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.265052 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.265271 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.265376 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.265586 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.265687 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.265894 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.265994 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.266217 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.266310 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.266526 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.266625 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.266832 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.266925 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.267146 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.267259 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.267465 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.267693 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.267877 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.268032 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.268145 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.268352 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.268442 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.268659 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.268758 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.269017 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.269134 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.269311 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.269421 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.269615 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.269715 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.269947 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.270057 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.270238 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.270337 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.270546 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.270645 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.270851 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.270944 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.271164 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.271265 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.271471 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.271564 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.271775 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.271867 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.272086 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.272290 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.272460 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.272615 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.272815 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.273004 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.273168 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.273411 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.273763 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.273973 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.274220 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.274560 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.274888 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.275201 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.275523 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.275979 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.276366 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.277003 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.277267 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.277428 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.277645 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.277812 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.277964 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.278113 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.278344 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.278530 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.278858 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.279023 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.279184 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.279351 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.279452 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.279525 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.279619 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.279712 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.279798 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.280093 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.280210 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.280429 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.280525 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.280883 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.281027 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.281324 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.281465 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.281681 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.281795 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.282026 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.282121 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.282348 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.282449 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.282664 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.282756 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.282976 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.283274 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.283375 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.283602 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.283693 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.283918 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.284067 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.284238 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.284594 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.284699 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.284865 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.285244 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.285521 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.285833 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.286062 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.286147 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.286448 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.286551 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.286757 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.286860 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.287068 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.287162 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.287382 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.287486 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.287694 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.287789 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.288003 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.288138 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.288317 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.290050 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.290241 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.290335 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.290411 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.290484 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.290564 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.290564 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.290801 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.290889 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.290889 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.291035 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.291108 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.291258 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.291426 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.291643 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.291747 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.292047 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.292371 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.292486 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.292688 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.292885 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.293035 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.293286 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.293469 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.293731 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.293829 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.294071 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.294174 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.294400 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.294502 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.294716 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.294838 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.295039 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.295164 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.295363 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.295481 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.295672 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.295779 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.295993 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.296173 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.296314 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.296530 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.296626 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.296866 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.296994 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.297213 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.297307 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.297532 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.297628 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.297850 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.297951 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.298161 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.298269 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.298479 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.298580 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.298788 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.298882 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.299119 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.299219 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.302450 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.302601 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.302708 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.302809 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.302906 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.303005 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.303093 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.303180 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.303266 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.303361 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.303458 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.303552 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.303647 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.303741 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.303741 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.303915 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.304016 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.304111 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.304205 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.304205 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.304362 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.304447 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.304543 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.304638 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.304725 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.304835 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.305169 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.305799 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.305901 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.305901 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.306056 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.306142 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.306235 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.306332 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.306426 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.306514 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.306599 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.306684 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.306769 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.306863 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.306863 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.307029 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.307116 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.307246 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.307351 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.307448 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.307665 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.307772 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.308004 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.308106 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.308319 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.308423 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.308643 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.308861 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.308976 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.309232 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.309341 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.309611 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.309727 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.309899 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.309995 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.310207 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.310310 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.310538 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.310631 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.310848 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.310948 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.311155 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.311330 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.311467 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.311562 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.311781 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.311875 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.312092 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.312195 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.312402 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.312520 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.312736 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.312978 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.313096 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.313253 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.313484 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.313584 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.313879 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.313980 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.314207 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.314304 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.314533 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.314623 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.314935 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.315330 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.315622 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.315717 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.315960 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.316064 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.316319 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.316424 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.316581 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.316664 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.316954 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.317056 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.317255 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.317352 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.317574 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.317682 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.317924 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.318000 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.318197 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.318291 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.318644 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.318954 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.319275 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.319592 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.319718 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.319923 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.320029 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.320249 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.320343 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.320562 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.320669 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.321158 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.321264 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.321374 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.321984 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.322095 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.322182 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.322258 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.322329 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.322400 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.322668 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.322927 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.323035 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.323131 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.323273 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.323416 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.323575 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.323747 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.323843 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 13:20:53.324065 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.324394 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.324724 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.325092 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.325499 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.325927 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.326157 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.326502 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.326834 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.327163 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.327475 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.327786 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.328097 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.328469 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.328729 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.329074 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.329384 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.329692 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.330210 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.330493 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.330803 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.331111 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.331419 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.331733 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.332147 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.332346 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.332655 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.333018 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.333286 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.333587 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.333898 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.334207 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.334517 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.334827 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.335137 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.335443 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.335776 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.336112 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.336454 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.336798 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.337157 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.337481 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.337792 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.338120 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.338441 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.338762 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.339075 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.339409 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.339722 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.340036 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.340351 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.340663 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.341010 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.341326 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.341738 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.342123 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.342434 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.342835 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.343160 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.343563 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.343846 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.344162 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.344558 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.344872 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.345212 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.345526 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.345842 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.346159 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.346478 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.346791 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.347101 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.347420 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.347748 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.348062 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.348391 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.348729 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.349084 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.349416 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.349765 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.350079 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.350426 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.350754 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.351069 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.351451 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.351765 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 13:20:53.352561 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 13:20:53.396593 n-d-861076-2 devstack@n-api.service[120932]: INFO dbcounter [None req-69f00947-1eee-44de-9ce6-b75d140cd7f3 None None] Registered counter for database nova_api Oct 12 13:20:53.419741 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_db.sqlalchemy.engines [None req-69f00947-1eee-44de-9ce6-b75d140cd7f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 13:20:53.425182 n-d-861076-2 devstack@n-api.service[120933]: INFO dbcounter [None req-466d5ae9-8fe5-42ba-9f6d-bfc441cd7755 None None] Registered counter for database nova_api Oct 12 13:20:53.428442 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writer thread running {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 13:20:53.446219 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_db.sqlalchemy.engines [None req-466d5ae9-8fe5-42ba-9f6d-bfc441cd7755 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120933) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 13:20:53.453327 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writer thread running {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 13:20:53.491093 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.context [None req-69f00947-1eee-44de-9ce6-b75d140cd7f3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c7d37a9d-54da-4741-8e88-e51a0f3ae3d5(cell1) {{(pid=120932) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 13:20:53.495885 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-69f00947-1eee-44de-9ce6-b75d140cd7f3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:20:53.496369 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-69f00947-1eee-44de-9ce6-b75d140cd7f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:20:53.498086 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-69f00947-1eee-44de-9ce6-b75d140cd7f3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:20:53.498932 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-69f00947-1eee-44de-9ce6-b75d140cd7f3 None None] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:20:53.499507 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-69f00947-1eee-44de-9ce6-b75d140cd7f3 None None] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:20:53.501713 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-69f00947-1eee-44de-9ce6-b75d140cd7f3 None None] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:20:53.503985 n-d-861076-2 devstack@n-api.service[120932]: INFO dbcounter [None req-69f00947-1eee-44de-9ce6-b75d140cd7f3 None None] Registered counter for database nova_cell0 Oct 12 13:20:53.508329 n-d-861076-2 devstack@n-api.service[120932]: INFO dbcounter [None req-69f00947-1eee-44de-9ce6-b75d140cd7f3 None None] Registered counter for database nova_cell1 Oct 12 13:20:53.512877 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.context [None req-466d5ae9-8fe5-42ba-9f6d-bfc441cd7755 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c7d37a9d-54da-4741-8e88-e51a0f3ae3d5(cell1) {{(pid=120933) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 13:20:53.517107 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-466d5ae9-8fe5-42ba-9f6d-bfc441cd7755 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:20:53.517599 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-466d5ae9-8fe5-42ba-9f6d-bfc441cd7755 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:20:53.518074 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_db.sqlalchemy.engines [None req-69f00947-1eee-44de-9ce6-b75d140cd7f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 13:20:53.518972 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_db.sqlalchemy.engines [None req-69f00947-1eee-44de-9ce6-b75d140cd7f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 13:20:53.519218 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-466d5ae9-8fe5-42ba-9f6d-bfc441cd7755 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:20:53.520013 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-466d5ae9-8fe5-42ba-9f6d-bfc441cd7755 None None] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:20:53.520457 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-466d5ae9-8fe5-42ba-9f6d-bfc441cd7755 None None] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:20:53.522642 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-466d5ae9-8fe5-42ba-9f6d-bfc441cd7755 None None] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:20:53.525169 n-d-861076-2 devstack@n-api.service[120933]: INFO dbcounter [None req-466d5ae9-8fe5-42ba-9f6d-bfc441cd7755 None None] Registered counter for database nova_cell0 Oct 12 13:20:53.529447 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writer thread running {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 13:20:53.529587 n-d-861076-2 devstack@n-api.service[120933]: INFO dbcounter [None req-466d5ae9-8fe5-42ba-9f6d-bfc441cd7755 None None] Registered counter for database nova_cell1 Oct 12 13:20:53.531702 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writer thread running {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 13:20:53.536502 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_db.sqlalchemy.engines [None req-466d5ae9-8fe5-42ba-9f6d-bfc441cd7755 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120933) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 13:20:53.541455 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_db.sqlalchemy.engines [None req-466d5ae9-8fe5-42ba-9f6d-bfc441cd7755 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120933) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 13:20:53.549411 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writer thread running {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 13:20:53.549847 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writer thread running {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 13:20:53.686774 n-d-861076-2 devstack@n-api.service[120932]: INFO dbcounter [None req-69f00947-1eee-44de-9ce6-b75d140cd7f3 None None] Registered counter for database nova_cell0 Oct 12 13:20:53.693598 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_db.sqlalchemy.engines [None req-69f00947-1eee-44de-9ce6-b75d140cd7f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 13:20:53.698126 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writer thread running {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 13:20:53.701562 n-d-861076-2 devstack@n-api.service[120933]: INFO dbcounter [None req-466d5ae9-8fe5-42ba-9f6d-bfc441cd7755 None None] Registered counter for database nova_cell0 Oct 12 13:20:53.709805 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_db.sqlalchemy.engines [None req-466d5ae9-8fe5-42ba-9f6d-bfc441cd7755 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120933) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 13:20:53.714964 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writer thread running {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 13:20:54.031810 n-d-861076-2 devstack@n-api.service[120932]: WARNING keystonemiddleware.auth_token [None req-69f00947-1eee-44de-9ce6-b75d140cd7f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 13:20:54.042059 n-d-861076-2 devstack@n-api.service[120932]: WARNING keystonemiddleware.auth_token [None req-69f00947-1eee-44de-9ce6-b75d140cd7f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 13:20:54.045426 n-d-861076-2 devstack@n-api.service[120933]: WARNING keystonemiddleware.auth_token [None req-466d5ae9-8fe5-42ba-9f6d-bfc441cd7755 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 13:20:54.052798 n-d-861076-2 devstack@n-api.service[120933]: WARNING keystonemiddleware.auth_token [None req-466d5ae9-8fe5-42ba-9f6d-bfc441cd7755 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 13:20:54.385193 n-d-861076-2 devstack@n-api.service[120932]: WARNING keystonemiddleware.auth_token [None req-69f00947-1eee-44de-9ce6-b75d140cd7f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 13:20:54.391247 n-d-861076-2 devstack@n-api.service[120932]: WARNING keystonemiddleware.auth_token [None req-69f00947-1eee-44de-9ce6-b75d140cd7f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 13:20:54.396605 n-d-861076-2 devstack@n-api.service[120932]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555e4fdc09c0 pid: 120932 (default app) Oct 12 13:20:54.401491 n-d-861076-2 devstack@n-api.service[120933]: WARNING keystonemiddleware.auth_token [None req-466d5ae9-8fe5-42ba-9f6d-bfc441cd7755 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 13:20:54.407834 n-d-861076-2 devstack@n-api.service[120933]: WARNING keystonemiddleware.auth_token [None req-466d5ae9-8fe5-42ba-9f6d-bfc441cd7755 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 13:20:54.413232 n-d-861076-2 devstack@n-api.service[120933]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555e4fdc09c0 pid: 120933 (default app) Oct 12 13:21:34.104376 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:21:34.105224 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:21:34.106114 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:21:34.107141 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:21:35.785245 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-13f3d380-9de6-41b1-bdcf-416a11a71aa0 tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Calling method '.version_select at 0x7f8aa15314c0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:35.795515 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-13f3d380-9de6-41b1-bdcf-416a11a71aa0 tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c7d37a9d-54da-4741-8e88-e51a0f3ae3d5(cell1) {{(pid=120932) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 12 13:21:35.796237 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-13f3d380-9de6-41b1-bdcf-416a11a71aa0 tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:35.796707 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-13f3d380-9de6-41b1-bdcf-416a11a71aa0 tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:35.797165 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-13f3d380-9de6-41b1-bdcf-416a11a71aa0 tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:35.822654 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-13f3d380-9de6-41b1-bdcf-416a11a71aa0 tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:35.823140 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-13f3d380-9de6-41b1-bdcf-416a11a71aa0 tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:35.824764 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-13f3d380-9de6-41b1-bdcf-416a11a71aa0 tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:35.838723 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-13f3d380-9de6-41b1-bdcf-416a11a71aa0 tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:35.839147 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-13f3d380-9de6-41b1-bdcf-416a11a71aa0 tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:35.839672 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-13f3d380-9de6-41b1-bdcf-416a11a71aa0 tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:35.848228 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-13f3d380-9de6-41b1-bdcf-416a11a71aa0 tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.747828 Oct 12 13:21:35.848228 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1208 bytes} [Wed Oct 12 13:21:34 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:21:35.868866 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=3 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:21:35.869717 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=3 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:21:35.870445 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=3 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:21:35.871175 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=3 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:21:36.079914 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d4ea1af2-e7a4-4cc9-aa5a-4b2247048b57 tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1072973890"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:36.100032 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.aggregate [None req-d4ea1af2-e7a4-4cc9-aa5a-4b2247048b57 tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Generated uuid 75f18eab-c9bd-40e3-a87f-77e1a2fc1d87 for aggregate {{(pid=120933) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 13:21:36.221555 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d4ea1af2-e7a4-4cc9-aa5a-4b2247048b57 tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.357024 Oct 12 13:21:36.222434 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1/2] 10.222.0.52 () {62 vars in 1205 bytes} [Wed Oct 12 13:21:35 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:21:36.238431 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-451bbbac-acbc-4064-9dde-71d37834d51b tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1767322770"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:36.433409 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-451bbbac-acbc-4064-9dde-71d37834d51b tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.197805 Oct 12 13:21:36.670909 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 2/3] 10.222.0.52 () {62 vars in 1210 bytes} [Wed Oct 12 13:21:36 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:21:36.670909 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-77b9b4f8-1f70-4e83-a499-87d81dc339fa tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:36.670909 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-77b9b4f8-1f70-4e83-a499-87d81dc339fa tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.011452 Oct 12 13:21:36.670909 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 3/4] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Oct 12 13:21:36 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:21:36.670909 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b4e910b7-a2fa-4252-a10a-be1d4b53a94a tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861076-2"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:36.672802 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4e910b7-a2fa-4252-a10a-be1d4b53a94a tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:36.672802 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4e910b7-a2fa-4252-a10a-be1d4b53a94a tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:36.672802 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4e910b7-a2fa-4252-a10a-be1d4b53a94a tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:36.811111 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5a04b4af-a30f-4ffa-9227-ebfb565b48ee tempest-FlavorMetadataValidation-982448833 tempest-FlavorMetadataValidation-982448833-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1630635370", "id": 453765529, "os-flavor-access:is_public": "True"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:37.005489 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5a04b4af-a30f-4ffa-9227-ebfb565b48ee tempest-FlavorMetadataValidation-982448833 tempest-FlavorMetadataValidation-982448833-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.777131 Oct 12 13:21:37.006049 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 2/5] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 12 13:21:36 2022] POST /compute/v2.1/flavors => generated 468 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 13:21:37.408285 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8f72cbf3-2ef4-4510-8e3d-e57292b9eaeb tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:37.413038 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8f72cbf3-2ef4-4510-8e3d-e57292b9eaeb tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:37.413526 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8f72cbf3-2ef4-4510-8e3d-e57292b9eaeb tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:37.414247 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8f72cbf3-2ef4-4510-8e3d-e57292b9eaeb tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:37.415140 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8f72cbf3-2ef4-4510-8e3d-e57292b9eaeb tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:37.415857 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8f72cbf3-2ef4-4510-8e3d-e57292b9eaeb tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:37.416278 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8f72cbf3-2ef4-4510-8e3d-e57292b9eaeb tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:37.462592 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8f72cbf3-2ef4-4510-8e3d-e57292b9eaeb tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.455061 Oct 12 13:21:37.463169 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 3/6] 10.222.0.52 () {58 vars in 1176 bytes} [Wed Oct 12 13:21:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:37.467814 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-316399ca-893d-4602-ba79-bb580837818c tempest-FlavorMetadataValidation-982448833 tempest-FlavorMetadataValidation-982448833-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:37.593637 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b4e910b7-a2fa-4252-a10a-be1d4b53a94a tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.41 time: 1.115763 Oct 12 13:21:37.594283 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 4/7] 10.222.0.52 () {62 vars in 1232 bytes} [Wed Oct 12 13:21:36 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 13:21:37.759827 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-316399ca-893d-4602-ba79-bb580837818c tempest-FlavorMetadataValidation-982448833 tempest-FlavorMetadataValidation-982448833-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/453765529/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.295326 Oct 12 13:21:37.760516 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 4/8] 10.222.0.52 () {62 vars in 1262 bytes} [Wed Oct 12 13:21:37 2022] POST /compute/v2.1/flavors/453765529/os-extra_specs => generated 62 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:37.818731 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9047f55e-5f67-4aba-8812-a3084bef6365 tempest-AZAdminNegativeTestJSON-1101140439 tempest-AZAdminNegativeTestJSON-1101140439-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:37.820967 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9047f55e-5f67-4aba-8812-a3084bef6365 tempest-AZAdminNegativeTestJSON-1101140439 tempest-AZAdminNegativeTestJSON-1101140439-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '644f2e7ceca243baae6644cc91df86e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103157073606490583db000a5ff0e6d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:21:37.825175 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9047f55e-5f67-4aba-8812-a3084bef6365 tempest-AZAdminNegativeTestJSON-1101140439 tempest-AZAdminNegativeTestJSON-1101140439-project] Request method failure captured: Oct 12 13:21:37.825175 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 12 13:21:37.825175 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:21:37.825175 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:21:37.825175 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:21:37.825175 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:21:37.825175 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:21:37.825175 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:21:37.825175 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:21:37.825175 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:37.825175 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9ePwBcq9syapaz6Qw_P0M1WxFFzuwhigtGAq6VfsUPWX1PMGzLJ-c5INSOhoZaCR_1F9yLCZqrAUV59nzKUPUAcNIm6WBFQb1oM0JQXMRCNPI-CmEi03sGQxnRTSnb9837zDgUD8SLQBy7zNefRk1EtpdyDlB6cw-fZlnS4_6Mt6E Oct 12 13:21:37.825175 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:21:37.825175 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:21:37.825175 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:21:37.825175 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:21:37.825175 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:21:37.825175 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:21:37.825175 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 103157073606490583db000a5ff0e6d4 Oct 12 13:21:37.825175 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1101140439 Oct 12 13:21:37.825175 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:21:37.825175 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:21:37.826386 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/103157073606490583db000a5ff0e6d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_103157073606490583db000a5ff0e6d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/103157073606490583db000a5ff0e6d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/103157073606490583db000a5ff0e6d4"}]}] Oct 12 13:21:37.826386 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AZAdminNegativeTestJSON-1101140439 Oct 12 13:21:37.826386 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 103157073606490583db000a5ff0e6d4 Oct 12 13:21:37.826386 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1101140439 Oct 12 13:21:37.826386 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AZAdminNegativeTestJSON-1101140439-project Oct 12 13:21:37.826386 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:21:37.826386 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:21:37.826386 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 644f2e7ceca243baae6644cc91df86e7 Oct 12 13:21:37.826386 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AZAdminNegativeTestJSON-1101140439-project Oct 12 13:21:37.826386 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:21:37.826386 n-d-861076-2 devstack@n-api.service[120933]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 12 13:21:37.826386 n-d-861076-2 devstack@n-api.service[120933]: action_args: {} Oct 12 13:21:37.827053 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:37.827053 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:37.827053 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:37.827053 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:37.827053 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:37.827053 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:37.827053 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:37.827053 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:37.827053 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 12 13:21:37.827053 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 12 13:21:37.827053 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:21:37.827053 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:21:37.827053 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:21:37.827053 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:21:37.827053 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:21:37.827053 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:21:37.827053 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:21:37.827053 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:21:37.827053 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:21:37.828083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:21:37.828083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:21:37.828083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:21:37.828083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:21:37.828083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:21:37.828083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 12 13:21:37.828083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:37.828083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:37.828083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:37.828083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:37.828083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:37.828083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:37.828083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:21:37.828083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:21:37.828083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 12 13:21:37.828083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:37.830941 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9047f55e-5f67-4aba-8812-a3084bef6365 tempest-AZAdminNegativeTestJSON-1101140439 tempest-AZAdminNegativeTestJSON-1101140439-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:37.832142 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9047f55e-5f67-4aba-8812-a3084bef6365 tempest-AZAdminNegativeTestJSON-1101140439 tempest-AZAdminNegativeTestJSON-1101140439-project] 10.222.0.52 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.236114 Oct 12 13:21:37.833553 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 5/9] 10.222.0.52 () {58 vars in 1185 bytes} [Wed Oct 12 13:21:37 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 239 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:21:37.927303 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e0136ee4-6b80-4fba-84c1-bbfe29e47ea5 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Calling method '.version_select at 0x7f8aa13a8e50>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:37.929742 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0136ee4-6b80-4fba-84c1-bbfe29e47ea5 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:37.930229 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0136ee4-6b80-4fba-84c1-bbfe29e47ea5 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:37.930659 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0136ee4-6b80-4fba-84c1-bbfe29e47ea5 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:37.948071 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0136ee4-6b80-4fba-84c1-bbfe29e47ea5 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:37.948551 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0136ee4-6b80-4fba-84c1-bbfe29e47ea5 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:37.949011 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0136ee4-6b80-4fba-84c1-bbfe29e47ea5 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:37.960200 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0136ee4-6b80-4fba-84c1-bbfe29e47ea5 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:37.960673 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0136ee4-6b80-4fba-84c1-bbfe29e47ea5 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:37.961310 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0136ee4-6b80-4fba-84c1-bbfe29e47ea5 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:37.967083 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e0136ee4-6b80-4fba-84c1-bbfe29e47ea5 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.204832 Oct 12 13:21:37.967641 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 5/10] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:38.029828 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d6e90d09-8545-41d8-98f7-bcf9e74d4060 tempest-AZAdminV2TestJSON-463157223 tempest-AZAdminV2TestJSON-463157223-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:38.031648 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d6e90d09-8545-41d8-98f7-bcf9e74d4060 tempest-AZAdminV2TestJSON-463157223 tempest-AZAdminV2TestJSON-463157223-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:38.032144 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d6e90d09-8545-41d8-98f7-bcf9e74d4060 tempest-AZAdminV2TestJSON-463157223 tempest-AZAdminV2TestJSON-463157223-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:38.032585 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d6e90d09-8545-41d8-98f7-bcf9e74d4060 tempest-AZAdminV2TestJSON-463157223 tempest-AZAdminV2TestJSON-463157223-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:38.033421 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d6e90d09-8545-41d8-98f7-bcf9e74d4060 tempest-AZAdminV2TestJSON-463157223 tempest-AZAdminV2TestJSON-463157223-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:38.033878 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d6e90d09-8545-41d8-98f7-bcf9e74d4060 tempest-AZAdminV2TestJSON-463157223 tempest-AZAdminV2TestJSON-463157223-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:38.034302 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d6e90d09-8545-41d8-98f7-bcf9e74d4060 tempest-AZAdminV2TestJSON-463157223 tempest-AZAdminV2TestJSON-463157223-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:38.073469 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d6e90d09-8545-41d8-98f7-bcf9e74d4060 tempest-AZAdminV2TestJSON-463157223 tempest-AZAdminV2TestJSON-463157223-project-admin] 10.222.0.52 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.233659 Oct 12 13:21:38.076952 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 6/11] 10.222.0.52 () {58 vars in 1164 bytes} [Wed Oct 12 13:21:37 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:21:38.081494 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6f3e9ec4-477b-405f-86fd-03eedfd622c5 tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861076-2"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:38.094430 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6f3e9ec4-477b-405f-86fd-03eedfd622c5 tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:38.094893 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6f3e9ec4-477b-405f-86fd-03eedfd622c5 tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:38.095343 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6f3e9ec4-477b-405f-86fd-03eedfd622c5 tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:38.179229 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-962d692c-9386-4df5-9750-9d4356d127e8 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Calling method '.version_select at 0x7f8aa1330b80>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:38.181031 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-962d692c-9386-4df5-9750-9d4356d127e8 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:38.181504 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-962d692c-9386-4df5-9750-9d4356d127e8 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:38.181931 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-962d692c-9386-4df5-9750-9d4356d127e8 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:38.197438 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-962d692c-9386-4df5-9750-9d4356d127e8 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:38.197967 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-962d692c-9386-4df5-9750-9d4356d127e8 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:38.198393 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-962d692c-9386-4df5-9750-9d4356d127e8 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:38.213529 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-962d692c-9386-4df5-9750-9d4356d127e8 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:38.214087 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-962d692c-9386-4df5-9750-9d4356d127e8 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:38.214703 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-962d692c-9386-4df5-9750-9d4356d127e8 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:38.221393 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-962d692c-9386-4df5-9750-9d4356d127e8 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.252729 Oct 12 13:21:38.221956 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 6/12] 10.222.0.52 () {58 vars in 1167 bytes} [Wed Oct 12 13:21:37 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:38.239143 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d89914b5-0d12-42ad-a8b8-956bca049722 tempest-FlavorMetadataValidation-982448833 tempest-FlavorMetadataValidation-982448833-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:38.377693 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d89914b5-0d12-42ad-a8b8-956bca049722 tempest-FlavorMetadataValidation-982448833 tempest-FlavorMetadataValidation-982448833-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/453765529" status: 202 len: 0 microversion: 2.86 time: 0.142990 Oct 12 13:21:38.378370 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 7/13] 10.222.0.52 () {60 vars in 1199 bytes} [Wed Oct 12 13:21:38 2022] DELETE /compute/v2.1/flavors/453765529 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:21:38.384084 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c6068cdc-086f-43e9-9285-7eaf9beb651b tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Calling method '.version_select at 0x7f8aa13308b0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:38.386195 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c6068cdc-086f-43e9-9285-7eaf9beb651b tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:38.386744 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c6068cdc-086f-43e9-9285-7eaf9beb651b tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:38.387249 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c6068cdc-086f-43e9-9285-7eaf9beb651b tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:38.406953 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c6068cdc-086f-43e9-9285-7eaf9beb651b tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:38.407559 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c6068cdc-086f-43e9-9285-7eaf9beb651b tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:38.408174 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c6068cdc-086f-43e9-9285-7eaf9beb651b tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:38.415515 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6f3e9ec4-477b-405f-86fd-03eedfd622c5 tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.340246 Oct 12 13:21:38.416364 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 7/14] 10.222.0.52 () {62 vars in 1232 bytes} [Wed Oct 12 13:21:38 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:21:38.422421 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-927dad1d-0133-42a2-ad8c-3e9e5db91bd0 tempest-AZAdminV2TestJSON-463157223 tempest-AZAdminV2TestJSON-463157223-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:38.424560 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-927dad1d-0133-42a2-ad8c-3e9e5db91bd0 tempest-AZAdminV2TestJSON-463157223 tempest-AZAdminV2TestJSON-463157223-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:38.425216 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-927dad1d-0133-42a2-ad8c-3e9e5db91bd0 tempest-AZAdminV2TestJSON-463157223 tempest-AZAdminV2TestJSON-463157223-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:38.425646 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-927dad1d-0133-42a2-ad8c-3e9e5db91bd0 tempest-AZAdminV2TestJSON-463157223 tempest-AZAdminV2TestJSON-463157223-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:38.427865 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-927dad1d-0133-42a2-ad8c-3e9e5db91bd0 tempest-AZAdminV2TestJSON-463157223 tempest-AZAdminV2TestJSON-463157223-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:38.428607 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-927dad1d-0133-42a2-ad8c-3e9e5db91bd0 tempest-AZAdminV2TestJSON-463157223 tempest-AZAdminV2TestJSON-463157223-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:38.429473 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-927dad1d-0133-42a2-ad8c-3e9e5db91bd0 tempest-AZAdminV2TestJSON-463157223 tempest-AZAdminV2TestJSON-463157223-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:38.453098 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c6068cdc-086f-43e9-9285-7eaf9beb651b tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:38.454069 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c6068cdc-086f-43e9-9285-7eaf9beb651b tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:38.454706 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c6068cdc-086f-43e9-9285-7eaf9beb651b tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:38.462032 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c6068cdc-086f-43e9-9285-7eaf9beb651b tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/n-h1-861076-2/servers" status: 200 len: 104 microversion: 2.1 time: 0.082346 Oct 12 13:21:38.462856 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 8/15] 10.222.0.52 () {58 vars in 1212 bytes} [Wed Oct 12 13:21:38 2022] GET /compute/v2.1/os-hypervisors/n-h1-861076-2/servers => generated 104 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:38.467394 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-34ff0381-93cb-40ad-8f68-c61961807ee7 tempest-FlavorMetadataValidation-982448833 tempest-FlavorMetadataValidation-982448833-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:38.479677 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-927dad1d-0133-42a2-ad8c-3e9e5db91bd0 tempest-AZAdminV2TestJSON-463157223 tempest-AZAdminV2TestJSON-463157223-project-admin] 10.222.0.52 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.061966 Oct 12 13:21:38.485462 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 8/16] 10.222.0.52 () {58 vars in 1185 bytes} [Wed Oct 12 13:21:38 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:38.492323 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6a7ca1b5-a1b7-4080-afb5-98c6895b1d73 tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:38.498560 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-34ff0381-93cb-40ad-8f68-c61961807ee7 tempest-FlavorMetadataValidation-982448833 tempest-FlavorMetadataValidation-982448833-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.034540 Oct 12 13:21:38.499284 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 9/17] 10.222.0.52 () {60 vars in 1187 bytes} [Wed Oct 12 13:21:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:21:38.514005 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c3d1ad99-35a6-4c05-8319-b5cf4054edc4 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Calling method '.version_select at 0x7f8aa12b7280>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:38.515958 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3d1ad99-35a6-4c05-8319-b5cf4054edc4 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:38.516578 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3d1ad99-35a6-4c05-8319-b5cf4054edc4 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:38.517209 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3d1ad99-35a6-4c05-8319-b5cf4054edc4 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:38.532819 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3d1ad99-35a6-4c05-8319-b5cf4054edc4 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:38.533402 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3d1ad99-35a6-4c05-8319-b5cf4054edc4 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:38.533841 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3d1ad99-35a6-4c05-8319-b5cf4054edc4 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:38.545124 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3d1ad99-35a6-4c05-8319-b5cf4054edc4 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:38.545495 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3d1ad99-35a6-4c05-8319-b5cf4054edc4 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:38.545933 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3d1ad99-35a6-4c05-8319-b5cf4054edc4 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:38.552672 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c3d1ad99-35a6-4c05-8319-b5cf4054edc4 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.052587 Oct 12 13:21:38.553298 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 10/18] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:38.563323 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f9b2313f-06df-47ae-b6d9-fbff5a272f80 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Calling method '.version_select at 0x7f8aa12b7c10>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:38.565057 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f9b2313f-06df-47ae-b6d9-fbff5a272f80 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:38.565534 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f9b2313f-06df-47ae-b6d9-fbff5a272f80 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:38.565967 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f9b2313f-06df-47ae-b6d9-fbff5a272f80 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:38.578864 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f9b2313f-06df-47ae-b6d9-fbff5a272f80 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:38.579345 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f9b2313f-06df-47ae-b6d9-fbff5a272f80 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:38.579778 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f9b2313f-06df-47ae-b6d9-fbff5a272f80 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:38.585786 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f9b2313f-06df-47ae-b6d9-fbff5a272f80 tempest-HypervisorAdminUnderV252Test-1895360730 tempest-HypervisorAdminUnderV252Test-1895360730-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/n-h1-861076-2/search" status: 200 len: 104 microversion: 2.1 time: 0.025949 Oct 12 13:21:38.586544 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 11/19] 10.222.0.52 () {58 vars in 1209 bytes} [Wed Oct 12 13:21:38 2022] GET /compute/v2.1/os-hypervisors/n-h1-861076-2/search => generated 104 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:21:38.608636 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6a7ca1b5-a1b7-4080-afb5-98c6895b1d73 tempest-AggregatesAdminTestV241-1163821623 tempest-AggregatesAdminTestV241-1163821623-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.121714 Oct 12 13:21:38.609458 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 9/20] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Oct 12 13:21:38 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:38.635119 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-52336688-7ba8-4f45-bbce-3d01102bd77e tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2001489644"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:38.639085 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.aggregate [None req-52336688-7ba8-4f45-bbce-3d01102bd77e tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Generated uuid 27799314-28eb-4c73-8927-9f8e5798409c for aggregate {{(pid=120932) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 13:21:38.744995 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-52336688-7ba8-4f45-bbce-3d01102bd77e tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.116517 Oct 12 13:21:38.745591 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 12/21] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 12 13:21:38 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:38.756954 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e7d039a6-404c-47bc-8f81-5b6d92bc5267 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861076-2"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:38.768124 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e7d039a6-404c-47bc-8f81-5b6d92bc5267 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:38.768592 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e7d039a6-404c-47bc-8f81-5b6d92bc5267 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:38.769072 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e7d039a6-404c-47bc-8f81-5b6d92bc5267 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:39.062165 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e7d039a6-404c-47bc-8f81-5b6d92bc5267 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.308963 Oct 12 13:21:39.062786 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 10/22] 10.222.0.52 () {60 vars in 1191 bytes} [Wed Oct 12 13:21:38 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:39.074472 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9d841464-3f06-4314-be63-5208a531e382 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861076-2"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:39.086107 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9d841464-3f06-4314-be63-5208a531e382 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:39.086589 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9d841464-3f06-4314-be63-5208a531e382 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:39.087021 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9d841464-3f06-4314-be63-5208a531e382 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:39.156062 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-9d841464-3f06-4314-be63-5208a531e382 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h1-861076-2. Oct 12 13:21:39.171537 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9d841464-3f06-4314-be63-5208a531e382 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Request method failure captured: Oct 12 13:21:39.171537 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 12 13:21:39.171537 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:21:39.171537 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:21:39.171537 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:21:39.171537 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 39 Oct 12 13:21:39.171537 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:21:39.171537 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:21:39.171537 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:21:39.171537 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:39.171537 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr9gY2zHBQTV6Bc74geZqbSLE204Cvy0Kcd7D18N4HZm9Dlkt_4MS-4rS79SJ4WfECmTtVtTl-U3awXx7Z4-AHHpeYlq_I1hh4qjaUJdemPNUoLjNt5mHcjiunV5QEJUiJd4YLBAe9gjBz0ojxSDq2_6yRbadCl1xCP7Q1Oy6dj5F2c Oct 12 13:21:39.171537 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:21:39.171537 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:21:39.171537 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:21:39.171537 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:21:39.171537 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:21:39.171537 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:21:39.171537 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 1e3b0370297f4b7aaad100cb0a0e443e Oct 12 13:21:39.171537 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:21:39.171537 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,admin,reader Oct 12 13:21:39.171537 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,admin,reader Oct 12 13:21:39.172761 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1e3b0370297f4b7aaad100cb0a0e443e"}]}] Oct 12 13:21:39.172761 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:21:39.172761 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 1e3b0370297f4b7aaad100cb0a0e443e Oct 12 13:21:39.172761 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:21:39.172761 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin Oct 12 13:21:39.172761 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:21:39.172761 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:21:39.172761 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 0bc3956115334bdda915ed371f80cd04 Oct 12 13:21:39.172761 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin Oct 12 13:21:39.172761 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:21:39.172761 n-d-861076-2 devstack@n-api.service[120932]: {"add_host": {"host": "n-h1-861076-2"}} Oct 12 13:21:39.172761 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:21:39.172761 n-d-861076-2 devstack@n-api.service[120932]: exception: Aggregate 2 already has host n-h1-861076-2. Oct 12 13:21:39.173402 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-861076-2'}}} Oct 12 13:21:39.173402 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:39.173402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:39.173402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 13:21:39.173402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 13:21:39.173402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 13:21:39.173402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 13:21:39.173402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 13:21:39.173402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 13:21:39.173402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 13:21:39.173402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 13:21:39.173402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 13:21:39.173402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 13:21:39.173402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 13:21:39.173402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result.read() Oct 12 13:21:39.173402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 13:21:39.173402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 13:21:39.173402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 13:21:39.173402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 13:21:39.174815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 13:21:39.174815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 13:21:39.174815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 13:21:39.174815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 13:21:39.174815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-861076-2-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 12 13:21:39.174815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:39.174815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 12 13:21:39.174815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:39.174815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:39.174815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 12 13:21:39.174815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 12 13:21:39.174815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 12 13:21:39.174815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi session.flush() Oct 12 13:21:39.174815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 13:21:39.174815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 12 13:21:39.174815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 13:21:39.174815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 12 13:21:39.174815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 13:21:39.174815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 12 13:21:39.175686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 13:21:39.175686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception Oct 12 13:21:39.175686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 13:21:39.175686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 12 13:21:39.175686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 13:21:39.175686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 12 13:21:39.175686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 13:21:39.175686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 12 13:21:39.175686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 13:21:39.175686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 12 13:21:39.175686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 12 13:21:39.175686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 12 13:21:39.175686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 13:21:39.175686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 13:21:39.175686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 13:21:39.175686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 12 13:21:39.175686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 13:21:39.175686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 12 13:21:39.176476 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 13:21:39.176476 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 12 13:21:39.176476 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 13:21:39.176476 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 13:21:39.176476 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 13:21:39.176476 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception Oct 12 13:21:39.176476 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 13:21:39.176476 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 13:21:39.176476 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 13:21:39.176476 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 13:21:39.176476 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 13:21:39.176476 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 13:21:39.176476 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 13:21:39.176476 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 13:21:39.176476 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 13:21:39.176476 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 13:21:39.176476 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 13:21:39.176476 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result.read() Oct 12 13:21:39.178282 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 13:21:39.178282 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 13:21:39.178282 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 13:21:39.178282 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 13:21:39.178282 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 13:21:39.178282 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 13:21:39.178282 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 13:21:39.178282 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 13:21:39.178282 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-861076-2-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 12 13:21:39.178282 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 12 13:21:39.178282 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 12, 13, 21, 39, 115393), 'updated_at': None, 'host': 'n-h1-861076-2', 'aggregate_id': 2}] Oct 12 13:21:39.178282 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 13:21:39.178282 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:39.178282 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:39.178282 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:39.178282 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:39.178282 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 12 13:21:39.187331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 12 13:21:39.187331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 13:21:39.187331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 13:21:39.187331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:21:39.187331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:21:39.187331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:21:39.187331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:21:39.187331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 13:21:39.187331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 13:21:39.187331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 12 13:21:39.187331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 12 13:21:39.187331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 13:21:39.187331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 13:21:39.187331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 12 13:21:39.187331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 12 13:21:39.187331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 12 13:21:39.187331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 12 13:21:39.187331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h1-861076-2. Oct 12 13:21:39.187331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:39.187331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:39.188496 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:39.188496 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:39.188496 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:39.188496 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:39.188496 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:39.188496 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:39.188496 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:39.188496 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:39.188496 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:21:39.188496 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:21:39.188496 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 12 13:21:39.188496 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 12 13:21:39.188496 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h1-861076-2. Oct 12 13:21:39.188496 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:39.188496 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:39.188496 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:39.188496 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:39.188496 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:39.188496 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:39.188496 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:21:39.188496 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:21:39.189599 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h1-861076-2. Oct 12 13:21:39.189599 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:39.189599 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9d841464-3f06-4314-be63-5208a531e382 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Returning 409 to user: Aggregate 2 already has host n-h1-861076-2. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:39.189599 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9d841464-3f06-4314-be63-5208a531e382 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.102543 Oct 12 13:21:39.189599 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 13/23] 10.222.0.52 () {60 vars in 1191 bytes} [Wed Oct 12 13:21:39 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 12 13:21:39.189860 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b4835fec-d16b-4d8e-b8c3-8b4dfb2ffad1 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861076-2"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:39.195476 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4835fec-d16b-4d8e-b8c3-8b4dfb2ffad1 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:39.195986 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4835fec-d16b-4d8e-b8c3-8b4dfb2ffad1 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:39.196404 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4835fec-d16b-4d8e-b8c3-8b4dfb2ffad1 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:39.491262 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b4835fec-d16b-4d8e-b8c3-8b4dfb2ffad1 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.312941 Oct 12 13:21:39.491953 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 11/24] 10.222.0.52 () {60 vars in 1191 bytes} [Wed Oct 12 13:21:39 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:21:39.516013 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3661ebd6-1eed-4252-b580-78c27ea291f0 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:39.592283 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3661ebd6-1eed-4252-b580-78c27ea291f0 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.080363 Oct 12 13:21:39.593575 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 14/25] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:21:39 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 13:21:39.603501 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-96be950f-25fe-4259-b471-26e0a2d425eb tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-86816452"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:39.607036 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.aggregate [None req-96be950f-25fe-4259-b471-26e0a2d425eb tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Generated uuid 02b04362-6496-42af-9d7a-0c81dedce8dc for aggregate {{(pid=120933) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 13:21:39.698288 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-55d0f809-19cc-492c-bb92-2406d80569e1 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-726203575", "name": "tempest-test_aggregate-1323676047"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:39.705668 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-96be950f-25fe-4259-b471-26e0a2d425eb tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.105652 Oct 12 13:21:39.707835 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 12/26] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 12 13:21:39 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:39.744318 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.aggregate [None req-55d0f809-19cc-492c-bb92-2406d80569e1 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Generated uuid eae3e035-8e7f-4f77-bdba-6b9a5af59f90 for aggregate {{(pid=120932) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 13:21:39.843582 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-55d0f809-19cc-492c-bb92-2406d80569e1 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.149312 Oct 12 13:21:39.844181 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 15/27] 10.222.0.52 () {60 vars in 1165 bytes} [Wed Oct 12 13:21:39 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:21:39.855136 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7cd3b076-e4c4-4f63-96dd-534dd670f747 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:39.871543 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7cd3b076-e4c4-4f63-96dd-534dd670f747 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 513 microversion: 2.1 time: 0.016828 Oct 12 13:21:39.871543 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 16/28] 10.222.0.52 () {58 vars in 1143 bytes} [Wed Oct 12 13:21:39 2022] GET /compute/v2.1/os-aggregates => generated 513 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:39.882481 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-788ef285-5bcb-4f24-996d-37079cdd20a3 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861076-2"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:39.893873 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-788ef285-5bcb-4f24-996d-37079cdd20a3 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:39.894868 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-788ef285-5bcb-4f24-996d-37079cdd20a3 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:39.895372 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-788ef285-5bcb-4f24-996d-37079cdd20a3 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:40.163226 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-75625751-33f3-4277-b740-c4107d937315 tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861076-2"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:40.166431 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-75625751-33f3-4277-b740-c4107d937315 tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'c463e23684544c34b872e2b6329c7180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9aebbf88bb47cab5110557308711bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:21:40.168581 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-75625751-33f3-4277-b740-c4107d937315 tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Request method failure captured: Oct 12 13:21:40.168581 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Oct 12 13:21:40.168581 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:21:40.168581 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:21:40.168581 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:21:40.168581 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 39 Oct 12 13:21:40.168581 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:21:40.168581 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:21:40.168581 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:21:40.168581 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:40.168581 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9eSx-TU6YutT1a6IF-xOmb3Q2osrlfpIVekEWjievjumBvUdovXijZwSBNsjrGwXFqjhHTWER0nDN6Pke1K23rskmyvPO5WrpQpvSgj_OcptSQhER5EPIjN8DxH6HF8pYzlrH_CQ1FGJnP_fDIXwOZntPedU07e4xcMOPYOb118qQ Oct 12 13:21:40.168581 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:21:40.168581 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:21:40.168581 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:21:40.168581 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:21:40.168581 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:21:40.168581 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:21:40.168581 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 6e9aebbf88bb47cab5110557308711bf Oct 12 13:21:40.168581 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-774722693 Oct 12 13:21:40.168581 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:21:40.168581 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:21:40.169603 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6e9aebbf88bb47cab5110557308711bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6e9aebbf88bb47cab5110557308711bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6e9aebbf88bb47cab5110557308711bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6e9aebbf88bb47cab5110557308711bf"}]}] Oct 12 13:21:40.169603 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-774722693 Oct 12 13:21:40.169603 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 6e9aebbf88bb47cab5110557308711bf Oct 12 13:21:40.169603 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-774722693 Oct 12 13:21:40.169603 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AggregatesAdminNegativeTestJSON-774722693-project Oct 12 13:21:40.169603 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:21:40.169603 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:21:40.169603 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: c463e23684544c34b872e2b6329c7180 Oct 12 13:21:40.169603 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-774722693-project Oct 12 13:21:40.169603 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:21:40.169603 n-d-861076-2 devstack@n-api.service[120933]: {"add_host": {"host": "n-h1-861076-2"}} Oct 12 13:21:40.169603 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:21:40.169603 n-d-861076-2 devstack@n-api.service[120933]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 12 13:21:40.170326 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h1-861076-2'}}} Oct 12 13:21:40.170326 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:40.170326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:40.170326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:40.170326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:40.170326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:40.170326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:40.170326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:40.170326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:40.170326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:21:40.170326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:21:40.170326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 12 13:21:40.170326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 12 13:21:40.170326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:21:40.170326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:21:40.170326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:21:40.170326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:21:40.170326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:21:40.170326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:21:40.171201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:21:40.171201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:21:40.171201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:21:40.171201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:21:40.171201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:21:40.171201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:21:40.171201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:21:40.171201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:21:40.171201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 12 13:21:40.171201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.171201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:40.171201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.171201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:40.171201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:40.171201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:40.171201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:21:40.171201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:21:40.171201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 12 13:21:40.171201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.178722 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-75625751-33f3-4277-b740-c4107d937315 tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:40.180389 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-75625751-33f3-4277-b740-c4107d937315 tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] 10.222.0.52 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.465946 Oct 12 13:21:40.182080 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 13/29] 10.222.0.52 () {60 vars in 1191 bytes} [Wed Oct 12 13:21:39 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 468 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 12 13:21:40.192890 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8407cb7d-9432-4bab-98ac-fe38a1ae6cd4 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:40.266320 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-8407cb7d-9432-4bab-98ac-fe38a1ae6cd4 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.079197 Oct 12 13:21:40.267126 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 14/30] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:21:40 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 13:21:40.278217 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-29bd6b00-9c85-4625-9f73-a0f85445ed1b tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-609932830"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:40.281889 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.aggregate [None req-29bd6b00-9c85-4625-9f73-a0f85445ed1b tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Generated uuid db46e721-5635-4a73-b676-06886046765d for aggregate {{(pid=120933) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 13:21:40.440991 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-29bd6b00-9c85-4625-9f73-a0f85445ed1b tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.164612 Oct 12 13:21:40.441958 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 15/31] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 12 13:21:40 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:21:40.459280 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-62a74bf8-6ecd-4f06-9373-a2472332f2de tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1631365903"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:40.498915 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-62a74bf8-6ecd-4f06-9373-a2472332f2de tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c7d37a9d-54da-4741-8e88-e51a0f3ae3d5(cell1) {{(pid=120933) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 12 13:21:40.500098 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-62a74bf8-6ecd-4f06-9373-a2472332f2de tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:40.500737 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-62a74bf8-6ecd-4f06-9373-a2472332f2de tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:40.501297 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-62a74bf8-6ecd-4f06-9373-a2472332f2de tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:40.509837 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-62a74bf8-6ecd-4f06-9373-a2472332f2de tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:40.510921 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-62a74bf8-6ecd-4f06-9373-a2472332f2de tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:40.511533 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-62a74bf8-6ecd-4f06-9373-a2472332f2de tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:40.526276 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-62a74bf8-6ecd-4f06-9373-a2472332f2de tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1631365903 could not be found. Oct 12 13:21:40.532481 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-62a74bf8-6ecd-4f06-9373-a2472332f2de tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Request method failure captured: Oct 12 13:21:40.532481 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Oct 12 13:21:40.532481 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:21:40.532481 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:21:40.532481 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:21:40.532481 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 58 Oct 12 13:21:40.532481 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:21:40.532481 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:21:40.532481 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:21:40.532481 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:40.532481 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9gY2zHBQTV6Bc74geZqbSLE204Cvy0Kcd7D18N4HZm9Dlkt_4MS-4rS79SJ4WfECmTtVtTl-U3awXx7Z4-AHHpeYlq_I1hh4qjaUJdemPNUoLjNt5mHcjiunV5QEJUiJd4YLBAe9gjBz0ojxSDq2_6yRbadCl1xCP7Q1Oy6dj5F2c Oct 12 13:21:40.532481 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:21:40.532481 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:21:40.532481 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:21:40.532481 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:21:40.532481 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:21:40.532481 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:21:40.532481 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 1e3b0370297f4b7aaad100cb0a0e443e Oct 12 13:21:40.532481 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:21:40.532481 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:21:40.532481 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:21:40.533671 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1e3b0370297f4b7aaad100cb0a0e443e"}]}] Oct 12 13:21:40.533671 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:21:40.533671 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 1e3b0370297f4b7aaad100cb0a0e443e Oct 12 13:21:40.533671 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:21:40.533671 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin Oct 12 13:21:40.533671 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:21:40.533671 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:21:40.533671 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 0bc3956115334bdda915ed371f80cd04 Oct 12 13:21:40.533671 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin Oct 12 13:21:40.533671 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:21:40.533671 n-d-861076-2 devstack@n-api.service[120933]: {"add_host": {"host": "tempest-nonexist_host-1631365903"}} Oct 12 13:21:40.533671 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:21:40.534286 n-d-861076-2 devstack@n-api.service[120933]: exception: Compute host tempest-nonexist_host-1631365903 could not be found. Oct 12 13:21:40.534286 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-1631365903'}}} Oct 12 13:21:40.534286 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:40.534286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:40.534286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 12 13:21:40.534286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 12 13:21:40.534286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:21:40.534286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:21:40.534286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 13:21:40.534286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 13:21:40.534286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:21:40.534286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:21:40.534286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 13:21:40.534286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 13:21:40.534286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1631365903' is not mapped to any cell Oct 12 13:21:40.534286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.534286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:40.534286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.534286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:40.534286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 12 13:21:40.535327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 12 13:21:40.535327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 12 13:21:40.535327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 12 13:21:40.535327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 12 13:21:40.535327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.535327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:40.535327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.535327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:40.535327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 12 13:21:40.535327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 12 13:21:40.535327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 13:21:40.535327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 13:21:40.535327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:21:40.535327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:21:40.535327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:21:40.535327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:21:40.535327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 13:21:40.535327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 13:21:40.535327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 12 13:21:40.535327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 12 13:21:40.536806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 12 13:21:40.536806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 12 13:21:40.536806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1631365903 could not be found. Oct 12 13:21:40.536806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.536806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:40.536806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.536806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:40.536806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:40.536806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:40.536806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:40.536806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:40.536806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:40.536806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:40.536806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:21:40.536806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:21:40.536806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 12 13:21:40.536806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:21:40.536806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1631365903 could not be found. Oct 12 13:21:40.536806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.536806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:40.536806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.538942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:40.538942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:40.538942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:40.538942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:21:40.538942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:21:40.538942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1631365903 could not be found. Oct 12 13:21:40.538942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.538942 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-62a74bf8-6ecd-4f06-9373-a2472332f2de tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1631365903 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:40.538942 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-62a74bf8-6ecd-4f06-9373-a2472332f2de tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 111 microversion: 2.1 time: 0.083569 Oct 12 13:21:40.538942 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 16/32] 10.222.0.52 () {60 vars in 1191 bytes} [Wed Oct 12 13:21:40 2022] POST /compute/v2.1/os-aggregates/5/action => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 13:21:40.545174 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f2e2b904-d500-4063-8d2b-fc60c315741e tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:40.654938 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f2e2b904-d500-4063-8d2b-fc60c315741e tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.114129 Oct 12 13:21:40.662512 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 17/33] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:21:40 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 13:21:40.668858 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7aa035a1-cd8e-44f7-bed8-eace4e058bb9 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:40.675918 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7aa035a1-cd8e-44f7-bed8-eace4e058bb9 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Request method failure captured: Oct 12 13:21:40.675918 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 12 13:21:40.675918 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:21:40.675918 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:21:40.675918 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:21:40.675918 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 283 Oct 12 13:21:40.675918 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:21:40.675918 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:21:40.675918 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:21:40.675918 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:40.675918 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9gY2zHBQTV6Bc74geZqbSLE204Cvy0Kcd7D18N4HZm9Dlkt_4MS-4rS79SJ4WfECmTtVtTl-U3awXx7Z4-AHHpeYlq_I1hh4qjaUJdemPNUoLjNt5mHcjiunV5QEJUiJd4YLBAe9gjBz0ojxSDq2_6yRbadCl1xCP7Q1Oy6dj5F2c Oct 12 13:21:40.675918 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:21:40.675918 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:21:40.675918 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:21:40.675918 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:21:40.675918 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:21:40.675918 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:21:40.675918 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 1e3b0370297f4b7aaad100cb0a0e443e Oct 12 13:21:40.675918 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:21:40.675918 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:21:40.675918 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:21:40.677190 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1e3b0370297f4b7aaad100cb0a0e443e"}]}] Oct 12 13:21:40.677190 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:21:40.677190 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 1e3b0370297f4b7aaad100cb0a0e443e Oct 12 13:21:40.677190 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:21:40.677190 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin Oct 12 13:21:40.677190 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:21:40.677190 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:21:40.677190 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 0bc3956115334bdda915ed371f80cd04 Oct 12 13:21:40.677190 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin Oct 12 13:21:40.677190 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:21:40.677699 n-d-861076-2 devstack@n-api.service[120933]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 12 13:21:40.677699 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:21:40.677699 n-d-861076-2 devstack@n-api.service[120933]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 13:21:40.677699 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 12 13:21:40.677699 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:40.677699 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:40.677699 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 13:21:40.677699 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 13:21:40.677699 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 13:21:40.677699 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise error Oct 12 13:21:40.678277 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 13:21:40.678277 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.678277 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 12 13:21:40.678277 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 13:21:40.678277 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.678277 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 12 13:21:40.678277 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 12 13:21:40.678277 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.678277 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:40.678277 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.678277 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:40.678277 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:40.678277 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:40.678277 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:40.678277 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:40.678277 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:40.678277 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:40.679075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:21:40.679075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:21:40.679075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 13:21:40.679075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 13:21:40.679075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 13:21:40.679075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 13:21:40.679075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 13:21:40.679075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 13:21:40.679075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 13:21:40.679075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.679075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:40.679075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.679075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:40.679075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:40.679075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:40.679859 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 13:21:40.679859 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 13:21:40.679859 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 13:21:40.679859 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.679859 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7aa035a1-cd8e-44f7-bed8-eace4e058bb9 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:40.680139 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-7aa035a1-cd8e-44f7-bed8-eace4e058bb9 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.013809 Oct 12 13:21:40.681744 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 18/34] 10.222.0.52 () {60 vars in 1165 bytes} [Wed Oct 12 13:21:40 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:21:40.701510 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-72de4f77-b2f6-4ecb-938b-eca16eed33e7 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:40.716187 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-72de4f77-b2f6-4ecb-938b-eca16eed33e7 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Request method failure captured: Oct 12 13:21:40.716187 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 12 13:21:40.716187 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:21:40.716187 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:21:40.716187 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:21:40.716187 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 27 Oct 12 13:21:40.716187 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:21:40.716187 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:21:40.716187 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:21:40.716187 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:40.716187 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9gY2zHBQTV6Bc74geZqbSLE204Cvy0Kcd7D18N4HZm9Dlkt_4MS-4rS79SJ4WfECmTtVtTl-U3awXx7Z4-AHHpeYlq_I1hh4qjaUJdemPNUoLjNt5mHcjiunV5QEJUiJd4YLBAe9gjBz0ojxSDq2_6yRbadCl1xCP7Q1Oy6dj5F2c Oct 12 13:21:40.716187 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:21:40.716187 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:21:40.716187 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:21:40.716187 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:21:40.716187 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:21:40.716187 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:21:40.716187 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 1e3b0370297f4b7aaad100cb0a0e443e Oct 12 13:21:40.716187 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:21:40.716187 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:21:40.716187 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:21:40.717959 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1e3b0370297f4b7aaad100cb0a0e443e"}]}] Oct 12 13:21:40.717959 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:21:40.717959 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 1e3b0370297f4b7aaad100cb0a0e443e Oct 12 13:21:40.717959 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:21:40.717959 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin Oct 12 13:21:40.717959 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:21:40.717959 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:21:40.717959 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 0bc3956115334bdda915ed371f80cd04 Oct 12 13:21:40.717959 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin Oct 12 13:21:40.717959 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:21:40.717959 n-d-861076-2 devstack@n-api.service[120933]: {"aggregate": {"name": ""}} Oct 12 13:21:40.717959 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:21:40.717959 n-d-861076-2 devstack@n-api.service[120933]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 12 13:21:40.718704 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 12 13:21:40.718704 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:40.718704 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:40.718704 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 13:21:40.718704 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 13:21:40.718704 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 13:21:40.718704 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise error Oct 12 13:21:40.718704 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 12 13:21:40.718704 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.718704 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 12 13:21:40.718704 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 13:21:40.718704 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.718704 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 12 13:21:40.718704 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi '' Oct 12 13:21:40.718704 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.718704 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:40.718704 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.718704 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:40.718704 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:40.718704 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:40.718704 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:40.718704 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:40.718704 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:40.719852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:40.719852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:21:40.719852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:21:40.719852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 13:21:40.719852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 13:21:40.719852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 13:21:40.719852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 13:21:40.719852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 13:21:40.719852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 13:21:40.719852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 12 13:21:40.719852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.719852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:40.719852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.719852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:40.719852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:40.719852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:40.719852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 13:21:40.719852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 13:21:40.719852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 12 13:21:40.719852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.723476 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-72de4f77-b2f6-4ecb-938b-eca16eed33e7 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:40.725426 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-72de4f77-b2f6-4ecb-938b-eca16eed33e7 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.027569 Oct 12 13:21:40.731784 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 19/35] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 12 13:21:40 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:21:40.744809 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-de6faa04-39d4-4db5-9c6c-fa63d171716b tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-475909742"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:40.749077 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-de6faa04-39d4-4db5-9c6c-fa63d171716b tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'c463e23684544c34b872e2b6329c7180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9aebbf88bb47cab5110557308711bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:21:40.750945 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-de6faa04-39d4-4db5-9c6c-fa63d171716b tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Request method failure captured: Oct 12 13:21:40.750945 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 12 13:21:40.750945 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:21:40.750945 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:21:40.750945 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:21:40.750945 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 59 Oct 12 13:21:40.750945 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:21:40.750945 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:21:40.750945 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:21:40.750945 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:40.750945 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9eSx-TU6YutT1a6IF-xOmb3Q2osrlfpIVekEWjievjumBvUdovXijZwSBNsjrGwXFqjhHTWER0nDN6Pke1K23rskmyvPO5WrpQpvSgj_OcptSQhER5EPIjN8DxH6HF8pYzlrH_CQ1FGJnP_fDIXwOZntPedU07e4xcMOPYOb118qQ Oct 12 13:21:40.750945 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:21:40.750945 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:21:40.750945 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:21:40.750945 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:21:40.750945 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:21:40.750945 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:21:40.750945 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 6e9aebbf88bb47cab5110557308711bf Oct 12 13:21:40.750945 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-774722693 Oct 12 13:21:40.750945 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:21:40.750945 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:21:40.752195 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6e9aebbf88bb47cab5110557308711bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6e9aebbf88bb47cab5110557308711bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6e9aebbf88bb47cab5110557308711bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6e9aebbf88bb47cab5110557308711bf"}]}] Oct 12 13:21:40.752195 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-774722693 Oct 12 13:21:40.752195 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 6e9aebbf88bb47cab5110557308711bf Oct 12 13:21:40.752195 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-774722693 Oct 12 13:21:40.752195 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AggregatesAdminNegativeTestJSON-774722693-project Oct 12 13:21:40.752195 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:21:40.752195 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:21:40.752195 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: c463e23684544c34b872e2b6329c7180 Oct 12 13:21:40.752195 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-774722693-project Oct 12 13:21:40.752195 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:21:40.752195 n-d-861076-2 devstack@n-api.service[120933]: {"aggregate": {"name": "tempest-test_aggregate-475909742"}} Oct 12 13:21:40.752195 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:21:40.752195 n-d-861076-2 devstack@n-api.service[120933]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 12 13:21:40.753007 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-475909742'}}} Oct 12 13:21:40.753007 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:40.753007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:40.753007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:40.753007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:40.753007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:40.753007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:40.753007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:40.753007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:40.753007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:21:40.753007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:21:40.753007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:21:40.753007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:21:40.753007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 12 13:21:40.753007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 12 13:21:40.753007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:21:40.753007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:21:40.753007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:21:40.753007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:21:40.754193 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:21:40.754193 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:21:40.754193 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:21:40.754193 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:21:40.754193 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:21:40.754193 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:21:40.754193 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:21:40.754193 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:21:40.754193 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:21:40.754193 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:21:40.754193 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 12 13:21:40.754193 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.754193 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:40.754193 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.754193 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:40.754193 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:40.754193 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:40.754193 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:21:40.754193 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:21:40.754193 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 12 13:21:40.755661 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.755661 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-de6faa04-39d4-4db5-9c6c-fa63d171716b tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:40.755661 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-de6faa04-39d4-4db5-9c6c-fa63d171716b tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.012044 Oct 12 13:21:40.758603 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 20/36] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 12 13:21:40 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:21:40.763467 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-25719d29-5fb8-40ac-acf3-f490cb3bb9e5 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-710739722"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:40.767618 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.aggregate [None req-25719d29-5fb8-40ac-acf3-f490cb3bb9e5 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Generated uuid af2bd29f-3ce7-48df-aefc-7997a0dba7af for aggregate {{(pid=120933) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 13:21:40.877155 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-25719d29-5fb8-40ac-acf3-f490cb3bb9e5 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.117209 Oct 12 13:21:40.878367 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 21/37] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 12 13:21:40 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:40.891138 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-716644b6-eb3d-414d-bb27-d19a3b71c9e0 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-710739722"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:40.894422 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.aggregate [None req-716644b6-eb3d-414d-bb27-d19a3b71c9e0 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Generated uuid 400a1b9a-ef2b-4bb9-8607-f1ffffc232bc for aggregate {{(pid=120933) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 13:21:40.909816 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-716644b6-eb3d-414d-bb27-d19a3b71c9e0 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-710739722 already exists. Oct 12 13:21:40.912086 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-716644b6-eb3d-414d-bb27-d19a3b71c9e0 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Request method failure captured: Oct 12 13:21:40.912086 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 12 13:21:40.912086 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:21:40.912086 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:21:40.912086 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:21:40.912086 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 59 Oct 12 13:21:40.912086 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:21:40.912086 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:21:40.912086 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:21:40.912086 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:40.912086 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9gY2zHBQTV6Bc74geZqbSLE204Cvy0Kcd7D18N4HZm9Dlkt_4MS-4rS79SJ4WfECmTtVtTl-U3awXx7Z4-AHHpeYlq_I1hh4qjaUJdemPNUoLjNt5mHcjiunV5QEJUiJd4YLBAe9gjBz0ojxSDq2_6yRbadCl1xCP7Q1Oy6dj5F2c Oct 12 13:21:40.912086 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:21:40.912086 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:21:40.912086 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:21:40.912086 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:21:40.912086 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:21:40.912086 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:21:40.912086 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 1e3b0370297f4b7aaad100cb0a0e443e Oct 12 13:21:40.912086 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:21:40.912086 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:21:40.912086 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:21:40.913157 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1e3b0370297f4b7aaad100cb0a0e443e"}]}] Oct 12 13:21:40.913157 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:21:40.913157 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 1e3b0370297f4b7aaad100cb0a0e443e Oct 12 13:21:40.913157 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:21:40.913157 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin Oct 12 13:21:40.913157 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:21:40.913157 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:21:40.913157 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 0bc3956115334bdda915ed371f80cd04 Oct 12 13:21:40.913157 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin Oct 12 13:21:40.913157 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:21:40.913157 n-d-861076-2 devstack@n-api.service[120933]: {"aggregate": {"name": "tempest-test_aggregate-710739722"}} Oct 12 13:21:40.913157 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:21:40.913157 n-d-861076-2 devstack@n-api.service[120933]: exception: Aggregate tempest-test_aggregate-710739722 already exists. Oct 12 13:21:40.913777 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-710739722'}}} Oct 12 13:21:40.913777 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:40.913777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:40.913777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 12 13:21:40.913777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 12 13:21:40.913777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 13:21:40.913777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 13:21:40.913777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:21:40.913777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:21:40.913777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:21:40.913777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:21:40.913777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 13:21:40.913777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 13:21:40.913777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 12 13:21:40.913777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 12 13:21:40.913777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 13:21:40.913777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 13:21:40.913777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 12 13:21:40.913777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 12 13:21:40.914649 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:21:40.914649 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:21:40.914649 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 12 13:21:40.914649 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 12 13:21:40.914649 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-710739722 already exists. Oct 12 13:21:40.914649 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.914649 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:40.914649 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.914649 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:40.914649 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:40.914649 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:40.914649 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:40.914649 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:40.914649 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:40.914649 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:40.914649 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:21:40.914649 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:21:40.914649 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:21:40.914649 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:21:40.914649 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 12 13:21:40.915725 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 12 13:21:40.915725 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-710739722 already exists. Oct 12 13:21:40.915725 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.915725 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:40.915725 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.915725 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:40.915725 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:40.915725 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:40.915725 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:21:40.915725 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:21:40.915725 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-710739722 already exists. Oct 12 13:21:40.915725 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:40.915725 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-716644b6-eb3d-414d-bb27-d19a3b71c9e0 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-710739722 already exists. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:40.915725 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-716644b6-eb3d-414d-bb27-d19a3b71c9e0 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.026394 Oct 12 13:21:40.916563 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 22/38] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 12 13:21:40 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 28 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:21:40.924194 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c35f77ec-32e0-44fc-b07b-e3a82632e4b0 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:41.043834 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c35f77ec-32e0-44fc-b07b-e3a82632e4b0 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.125070 Oct 12 13:21:41.044705 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 23/39] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:21:40 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 12 13:21:41.053942 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b9d0e6b3-07f7-46d4-bfa7-cdc1df394828 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1448890020"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:41.057366 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.aggregate [None req-b9d0e6b3-07f7-46d4-bfa7-cdc1df394828 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Generated uuid c1c3b00a-bad4-4237-9091-5cb48324b1dc for aggregate {{(pid=120933) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 13:21:41.168994 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b9d0e6b3-07f7-46d4-bfa7-cdc1df394828 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.118472 Oct 12 13:21:41.169680 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 24/40] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 12 13:21:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:21:41.182323 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3e826039-4c0b-4a94-8146-d05ab4b045b2 tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:41.184713 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-3e826039-4c0b-4a94-8146-d05ab4b045b2 tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'c463e23684544c34b872e2b6329c7180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9aebbf88bb47cab5110557308711bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:21:41.186482 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3e826039-4c0b-4a94-8146-d05ab4b045b2 tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Request method failure captured: Oct 12 13:21:41.186482 n-d-861076-2 devstack@n-api.service[120933]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 12 13:21:41.186482 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:21:41.186482 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:21:41.186482 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:21:41.186482 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:21:41.186482 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:21:41.186482 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:21:41.186482 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:21:41.186482 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:41.186482 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9eSx-TU6YutT1a6IF-xOmb3Q2osrlfpIVekEWjievjumBvUdovXijZwSBNsjrGwXFqjhHTWER0nDN6Pke1K23rskmyvPO5WrpQpvSgj_OcptSQhER5EPIjN8DxH6HF8pYzlrH_CQ1FGJnP_fDIXwOZntPedU07e4xcMOPYOb118qQ Oct 12 13:21:41.186482 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:21:41.186482 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:21:41.186482 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:21:41.186482 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:21:41.186482 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:21:41.186482 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:21:41.186482 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 6e9aebbf88bb47cab5110557308711bf Oct 12 13:21:41.186482 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-774722693 Oct 12 13:21:41.186482 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:21:41.186482 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:21:41.200019 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6e9aebbf88bb47cab5110557308711bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6e9aebbf88bb47cab5110557308711bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6e9aebbf88bb47cab5110557308711bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6e9aebbf88bb47cab5110557308711bf"}]}] Oct 12 13:21:41.200019 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-774722693 Oct 12 13:21:41.200019 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 6e9aebbf88bb47cab5110557308711bf Oct 12 13:21:41.200019 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-774722693 Oct 12 13:21:41.200019 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AggregatesAdminNegativeTestJSON-774722693-project Oct 12 13:21:41.200019 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:21:41.200019 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:21:41.200019 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: c463e23684544c34b872e2b6329c7180 Oct 12 13:21:41.200019 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-774722693-project Oct 12 13:21:41.200019 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:21:41.200019 n-d-861076-2 devstack@n-api.service[120933]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 12 13:21:41.200019 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '7'} Oct 12 13:21:41.200952 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:41.200952 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:41.200952 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:41.200952 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:41.200952 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:41.200952 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:41.200952 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:41.200952 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:41.200952 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 12 13:21:41.200952 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 12 13:21:41.200952 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:21:41.200952 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:21:41.200952 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:21:41.200952 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:21:41.200952 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:21:41.200952 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:21:41.200952 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:21:41.200952 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:21:41.200952 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:21:41.202094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:21:41.202094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:21:41.202094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:21:41.202094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:21:41.202094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:21:41.202094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 12 13:21:41.202094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:41.202094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:41.202094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:41.202094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:41.202094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:41.202094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:41.202094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:21:41.202094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:21:41.202094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 12 13:21:41.202094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:41.202094 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3e826039-4c0b-4a94-8146-d05ab4b045b2 tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:41.203107 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3e826039-4c0b-4a94-8146-d05ab4b045b2 tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.011134 Oct 12 13:21:41.203107 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 25/41] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:21:41 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 12 13:21:41.205495 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5dfd550c-7381-435d-8af1-c0175652b853 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:41.218505 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=12 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:21:41.277628 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5dfd550c-7381-435d-8af1-c0175652b853 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.077389 Oct 12 13:21:41.278574 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 26/42] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:21:41 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 13:21:41.287301 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0dff28f7-4e6c-452a-84a5-d510df93cd15 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:41.297287 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-0dff28f7-4e6c-452a-84a5-d510df93cd15 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 12 13:21:41.298899 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0dff28f7-4e6c-452a-84a5-d510df93cd15 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Request method failure captured: Oct 12 13:21:41.298899 n-d-861076-2 devstack@n-api.service[120933]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 12 13:21:41.298899 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:21:41.298899 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:21:41.298899 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:21:41.298899 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:21:41.298899 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:21:41.298899 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:21:41.298899 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:21:41.298899 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:41.298899 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9gY2zHBQTV6Bc74geZqbSLE204Cvy0Kcd7D18N4HZm9Dlkt_4MS-4rS79SJ4WfECmTtVtTl-U3awXx7Z4-AHHpeYlq_I1hh4qjaUJdemPNUoLjNt5mHcjiunV5QEJUiJd4YLBAe9gjBz0ojxSDq2_6yRbadCl1xCP7Q1Oy6dj5F2c Oct 12 13:21:41.298899 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:21:41.298899 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:21:41.298899 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:21:41.298899 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:21:41.298899 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:21:41.298899 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:21:41.298899 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 1e3b0370297f4b7aaad100cb0a0e443e Oct 12 13:21:41.298899 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:21:41.298899 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:21:41.298899 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:21:41.300261 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1e3b0370297f4b7aaad100cb0a0e443e"}]}] Oct 12 13:21:41.300261 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:21:41.300261 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 1e3b0370297f4b7aaad100cb0a0e443e Oct 12 13:21:41.300261 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:21:41.300261 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin Oct 12 13:21:41.300261 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:21:41.300261 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:21:41.300261 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 0bc3956115334bdda915ed371f80cd04 Oct 12 13:21:41.300261 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin Oct 12 13:21:41.300261 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:21:41.300261 n-d-861076-2 devstack@n-api.service[120933]: exception: Aggregate -1 could not be found. Oct 12 13:21:41.300261 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '-1'} Oct 12 13:21:41.305772 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:41.305772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:41.305772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 12 13:21:41.305772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 12 13:21:41.305772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 13:21:41.305772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 13:21:41.305772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:21:41.305772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:21:41.305772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:21:41.305772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:21:41.305772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 13:21:41.305772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 13:21:41.305772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 12 13:21:41.305772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 13:21:41.305772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:21:41.305772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:21:41.305772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 13:21:41.305772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 13:21:41.305772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:21:41.306739 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:21:41.306739 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 13:21:41.306739 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 13:21:41.306739 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 12 13:21:41.306739 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:41.306739 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:41.306739 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:41.306739 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:41.306739 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:41.306739 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:41.306739 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:41.306739 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:41.306739 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:41.306739 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:41.306739 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 12 13:21:41.306739 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:21:41.306739 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 12 13:21:41.306739 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:41.306739 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:41.306739 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:41.306739 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:41.307797 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:41.307797 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:41.307797 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:21:41.307797 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:21:41.307797 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 12 13:21:41.307797 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:41.307797 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0dff28f7-4e6c-452a-84a5-d510df93cd15 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:41.307797 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0dff28f7-4e6c-452a-84a5-d510df93cd15 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.016683 Oct 12 13:21:41.307797 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 27/43] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 12 13:21:41 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 12 13:21:41.309905 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4654dd55-5cab-4fc6-a513-2c3261328565 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-457422782"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:41.313734 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.aggregate [None req-4654dd55-5cab-4fc6-a513-2c3261328565 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Generated uuid a2db3b7f-c9c5-4ef1-865d-09608bc69288 for aggregate {{(pid=120933) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 13:21:41.429772 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4654dd55-5cab-4fc6-a513-2c3261328565 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.122911 Oct 12 13:21:41.440465 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 28/44] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 12 13:21:41 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:41.448610 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-152ad1c7-47a1-49bb-a96d-33fe1dff30d7 tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:41.451262 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-152ad1c7-47a1-49bb-a96d-33fe1dff30d7 tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'c463e23684544c34b872e2b6329c7180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9aebbf88bb47cab5110557308711bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:21:41.453021 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-152ad1c7-47a1-49bb-a96d-33fe1dff30d7 tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Request method failure captured: Oct 12 13:21:41.453021 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 12 13:21:41.453021 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:21:41.453021 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:21:41.453021 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:21:41.453021 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:21:41.453021 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:21:41.453021 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:21:41.453021 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:21:41.453021 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:41.453021 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9eSx-TU6YutT1a6IF-xOmb3Q2osrlfpIVekEWjievjumBvUdovXijZwSBNsjrGwXFqjhHTWER0nDN6Pke1K23rskmyvPO5WrpQpvSgj_OcptSQhER5EPIjN8DxH6HF8pYzlrH_CQ1FGJnP_fDIXwOZntPedU07e4xcMOPYOb118qQ Oct 12 13:21:41.453021 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:21:41.453021 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:21:41.453021 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:21:41.453021 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:21:41.453021 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:21:41.453021 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:21:41.453021 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 6e9aebbf88bb47cab5110557308711bf Oct 12 13:21:41.453021 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-774722693 Oct 12 13:21:41.453021 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:21:41.453021 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:21:41.454086 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6e9aebbf88bb47cab5110557308711bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6e9aebbf88bb47cab5110557308711bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6e9aebbf88bb47cab5110557308711bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6e9aebbf88bb47cab5110557308711bf"}]}] Oct 12 13:21:41.454086 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-774722693 Oct 12 13:21:41.454086 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 6e9aebbf88bb47cab5110557308711bf Oct 12 13:21:41.454086 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-774722693 Oct 12 13:21:41.454086 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AggregatesAdminNegativeTestJSON-774722693-project Oct 12 13:21:41.454086 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:21:41.454086 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:21:41.454086 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: c463e23684544c34b872e2b6329c7180 Oct 12 13:21:41.454086 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-774722693-project Oct 12 13:21:41.454086 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:21:41.454086 n-d-861076-2 devstack@n-api.service[120933]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 12 13:21:41.454086 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '8'} Oct 12 13:21:41.454909 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:41.454909 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:41.454909 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:41.454909 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:41.454909 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:41.454909 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:41.454909 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:41.454909 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:41.454909 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 12 13:21:41.454909 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 12 13:21:41.454909 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:21:41.454909 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:21:41.454909 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:21:41.454909 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:21:41.454909 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:21:41.454909 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:21:41.454909 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:21:41.454909 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:21:41.454909 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:21:41.455910 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:21:41.455910 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:21:41.455910 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:21:41.455910 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:21:41.455910 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:21:41.455910 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 12 13:21:41.455910 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:41.455910 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:41.455910 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:41.455910 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:41.455910 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:41.455910 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:41.455910 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:21:41.455910 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:21:41.455910 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 12 13:21:41.455910 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:41.458095 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-152ad1c7-47a1-49bb-a96d-33fe1dff30d7 tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:41.458989 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-152ad1c7-47a1-49bb-a96d-33fe1dff30d7 tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] 10.222.0.52 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.017319 Oct 12 13:21:41.460217 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 29/45] 10.222.0.52 () {58 vars in 1149 bytes} [Wed Oct 12 13:21:41 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:21:41.480486 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-554fb2e0-eb1a-490b-a5af-70ef2dbb7936 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:41.606887 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-554fb2e0-eb1a-490b-a5af-70ef2dbb7936 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.130534 Oct 12 13:21:41.607471 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 30/46] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:21:41 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 13:21:41.616526 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-bb29a988-5615-47a3-9da0-cc6d201155e9 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:41.623129 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-bb29a988-5615-47a3-9da0-cc6d201155e9 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 12 13:21:41.624667 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-bb29a988-5615-47a3-9da0-cc6d201155e9 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Request method failure captured: Oct 12 13:21:41.624667 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 12 13:21:41.624667 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:21:41.624667 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:21:41.624667 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:21:41.624667 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:21:41.624667 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:21:41.624667 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:21:41.624667 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:21:41.624667 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:41.624667 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9gY2zHBQTV6Bc74geZqbSLE204Cvy0Kcd7D18N4HZm9Dlkt_4MS-4rS79SJ4WfECmTtVtTl-U3awXx7Z4-AHHpeYlq_I1hh4qjaUJdemPNUoLjNt5mHcjiunV5QEJUiJd4YLBAe9gjBz0ojxSDq2_6yRbadCl1xCP7Q1Oy6dj5F2c Oct 12 13:21:41.624667 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:21:41.624667 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:21:41.624667 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:21:41.624667 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:21:41.624667 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:21:41.624667 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:21:41.624667 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 1e3b0370297f4b7aaad100cb0a0e443e Oct 12 13:21:41.624667 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:21:41.624667 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:21:41.624667 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:21:41.625780 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1e3b0370297f4b7aaad100cb0a0e443e"}]}] Oct 12 13:21:41.625780 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:21:41.625780 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 1e3b0370297f4b7aaad100cb0a0e443e Oct 12 13:21:41.625780 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:21:41.625780 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin Oct 12 13:21:41.625780 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:21:41.625780 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:21:41.625780 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 0bc3956115334bdda915ed371f80cd04 Oct 12 13:21:41.625780 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin Oct 12 13:21:41.625780 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:21:41.625780 n-d-861076-2 devstack@n-api.service[120933]: exception: Aggregate -1 could not be found. Oct 12 13:21:41.625780 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '-1'} Oct 12 13:21:41.626383 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:41.626383 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:41.626383 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 12 13:21:41.626383 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 12 13:21:41.626383 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 12 13:21:41.626383 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 13:21:41.626383 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:21:41.626383 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:21:41.626383 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 13:21:41.626383 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 13:21:41.626383 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:21:41.626383 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:21:41.626383 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 13:21:41.626383 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 13:21:41.626383 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 12 13:21:41.626383 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:41.626383 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:41.626383 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:41.626383 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:41.626383 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:41.627333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:41.627333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:41.627333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:41.627333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:41.627333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:41.627333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 12 13:21:41.627333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:21:41.627333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 12 13:21:41.627333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:41.627333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:41.627333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:41.627333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:41.627333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:41.627333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:41.627333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:21:41.627333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:21:41.627333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 12 13:21:41.627333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:41.628263 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-bb29a988-5615-47a3-9da0-cc6d201155e9 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:41.628263 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-bb29a988-5615-47a3-9da0-cc6d201155e9 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.013510 Oct 12 13:21:41.628263 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 31/47] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:21:41 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:21:41.637077 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e6ccf30a-4a6b-43b8-8928-b2bcb3dc59fc tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:41.638641 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e6ccf30a-4a6b-43b8-8928-b2bcb3dc59fc tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'c463e23684544c34b872e2b6329c7180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9aebbf88bb47cab5110557308711bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:21:41.645918 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e6ccf30a-4a6b-43b8-8928-b2bcb3dc59fc tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Request method failure captured: Oct 12 13:21:41.645918 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 12 13:21:41.645918 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:21:41.645918 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:21:41.645918 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:21:41.645918 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:21:41.645918 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:21:41.645918 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:21:41.645918 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:21:41.645918 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:41.645918 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9eSx-TU6YutT1a6IF-xOmb3Q2osrlfpIVekEWjievjumBvUdovXijZwSBNsjrGwXFqjhHTWER0nDN6Pke1K23rskmyvPO5WrpQpvSgj_OcptSQhER5EPIjN8DxH6HF8pYzlrH_CQ1FGJnP_fDIXwOZntPedU07e4xcMOPYOb118qQ Oct 12 13:21:41.645918 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:21:41.645918 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:21:41.645918 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:21:41.645918 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:21:41.645918 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:21:41.645918 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:21:41.645918 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 6e9aebbf88bb47cab5110557308711bf Oct 12 13:21:41.645918 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-774722693 Oct 12 13:21:41.645918 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:21:41.645918 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:21:41.646951 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6e9aebbf88bb47cab5110557308711bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6e9aebbf88bb47cab5110557308711bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6e9aebbf88bb47cab5110557308711bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6e9aebbf88bb47cab5110557308711bf"}]}] Oct 12 13:21:41.646951 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-774722693 Oct 12 13:21:41.646951 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 6e9aebbf88bb47cab5110557308711bf Oct 12 13:21:41.646951 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-774722693 Oct 12 13:21:41.646951 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AggregatesAdminNegativeTestJSON-774722693-project Oct 12 13:21:41.646951 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:21:41.646951 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:21:41.646951 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: c463e23684544c34b872e2b6329c7180 Oct 12 13:21:41.646951 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-774722693-project Oct 12 13:21:41.646951 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:21:41.646951 n-d-861076-2 devstack@n-api.service[120933]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 12 13:21:41.646951 n-d-861076-2 devstack@n-api.service[120933]: action_args: {} Oct 12 13:21:41.647540 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:41.647540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:41.647540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:41.647540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:41.647540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:41.647540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:41.647540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:41.647540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:41.647540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 12 13:21:41.647540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 12 13:21:41.647540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:21:41.647540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:21:41.647540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:21:41.647540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:21:41.647540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:21:41.647540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:21:41.647540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:21:41.647540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:21:41.647540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:21:41.648412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:21:41.648412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:21:41.648412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:21:41.648412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:21:41.648412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:21:41.648412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 12 13:21:41.648412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:41.648412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:41.648412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:41.648412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:41.648412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:41.648412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:41.648412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:21:41.648412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:21:41.648412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 12 13:21:41.648412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:41.648412 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e6ccf30a-4a6b-43b8-8928-b2bcb3dc59fc tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:41.649529 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e6ccf30a-4a6b-43b8-8928-b2bcb3dc59fc tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.010052 Oct 12 13:21:41.649529 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 32/48] 10.222.0.52 () {58 vars in 1143 bytes} [Wed Oct 12 13:21:41 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 12 13:21:41.655085 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-788ef285-5bcb-4f24-996d-37079cdd20a3 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 313 microversion: 2.1 time: 1.776865 Oct 12 13:21:41.655664 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 17/49] 10.222.0.52 () {60 vars in 1191 bytes} [Wed Oct 12 13:21:39 2022] POST /compute/v2.1/os-aggregates/4/action => generated 313 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:43.273340 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1252802578", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "availability_zone": "tempest-test_az-726203575"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:43.301417 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:43.302682 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:43.303306 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:43.304194 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:43.304637 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:43.305131 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:44.319578 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] validate_networks() for None {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:21:44.631097 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:21:44.631599 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:21:44.632335 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:21:44.632829 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:21:44.633350 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:21:44.649760 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:44.650376 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:44.650886 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:44.651708 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:44.652300 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:44.652939 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:44.686663 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Getting quotas for project 79a760f270b741faa8363f5142561aa0. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:21:44.696010 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Getting quotas for user cbfb915900c442c0999a39440a8228fe and project 79a760f270b741faa8363f5142561aa0. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:21:44.711838 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Going to run 1 instances... {{(pid=120933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:21:44.716079 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:21:44.858552 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ebaebfa6-b3f1-4ba8-9976-2ed4f9a0d6b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.300776 Oct 12 13:21:44.859326 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 33/50] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:21:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 13:21:44.877685 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c1be5548-31da-4e46-bd7e-d28f1c17d054 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:44.880610 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c1be5548-31da-4e46-bd7e-d28f1c17d054 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:21:46.244014 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c1be5548-31da-4e46-bd7e-d28f1c17d054 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbfb915900c442c0999a39440a8228fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a760f270b741faa8363f5142561aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:21:46.259183 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c1be5548-31da-4e46-bd7e-d28f1c17d054 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1242 microversion: 2.1 time: 1.390503 Oct 12 13:21:46.260070 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 18/51] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:21:44 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1242 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:46.358779 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-eb5b3ed2-f176-4ee2-971a-07e0878e363c tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-551931695", "id": 2137521841, "os-flavor-access:is_public": "False"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:46.462419 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-eb5b3ed2-f176-4ee2-971a-07e0878e363c tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.602296 Oct 12 13:21:46.463007 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 34/52] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:21:45 2022] POST /compute/v2.1/flavors => generated 438 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:21:46.477918 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0c24ede9-ad32-4f21-929f-3e8c25901587 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "28c452a91b02417fada142df25ae7cc7"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:47.291674 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1529f6ff-71ae-4f7e-866e-f7c5333b8b2b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:47.292559 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-1529f6ff-71ae-4f7e-866e-f7c5333b8b2b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:21:47.306564 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1529f6ff-71ae-4f7e-866e-f7c5333b8b2b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:47.308327 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1529f6ff-71ae-4f7e-866e-f7c5333b8b2b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:47.308327 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1529f6ff-71ae-4f7e-866e-f7c5333b8b2b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:47.308327 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1529f6ff-71ae-4f7e-866e-f7c5333b8b2b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:47.308620 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1529f6ff-71ae-4f7e-866e-f7c5333b8b2b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:47.309229 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1529f6ff-71ae-4f7e-866e-f7c5333b8b2b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:47.325315 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=5 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:21:47.332789 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0c24ede9-ad32-4f21-929f-3e8c25901587 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/2137521841/action" status: 200 len: 97 microversion: 2.1 time: 0.859423 Oct 12 13:21:47.336563 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 19/53] 10.222.0.52 () {60 vars in 1200 bytes} [Wed Oct 12 13:21:46 2022] POST /compute/v2.1/flavors/2137521841/action => generated 97 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:21:47.344855 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e9f90126-45c5-4782-8f82-03d36c88b497 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "28c452a91b02417fada142df25ae7cc7"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:47.431155 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:21:47.496966 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-1529f6ff-71ae-4f7e-866e-f7c5333b8b2b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbfb915900c442c0999a39440a8228fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a760f270b741faa8363f5142561aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:21:47.514938 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1529f6ff-71ae-4f7e-866e-f7c5333b8b2b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1242 microversion: 2.1 time: 0.226863 Oct 12 13:21:47.515744 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 35/54] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:21:47 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1242 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:21:48.278733 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-e9f90126-45c5-4782-8f82-03d36c88b497 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project 28c452a91b02417fada142df25ae7cc7 combination. Oct 12 13:21:48.284930 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e9f90126-45c5-4782-8f82-03d36c88b497 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Request method failure captured: Oct 12 13:21:48.284930 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/flavors/2137521841/action HTTP/1.1 Oct 12 13:21:48.284930 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:21:48.284930 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:21:48.284930 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:21:48.284930 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 67 Oct 12 13:21:48.284930 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:21:48.284930 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:21:48.284930 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:21:48.284930 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:48.284930 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr9nXRsV1tExwt4w8v4HKkDSyjSpSaFOfiZL2mps4XkoHIyEUE_LFzp3QqYu7CaGIX4NwCQsGTmLEehVHcz0xpc0Y22PvU5T3fejz7um7_4gzy9K4Ot_SbG3x3GM3d5LiMxvJMaTkeqU9NXEpVLZJhFb0PNxl3YF9vf4rTkW0W0KNmc Oct 12 13:21:48.284930 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:21:48.284930 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:21:48.284930 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:21:48.284930 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:21:48.284930 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:21:48.284930 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:21:48.284930 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 191330f2e54b43cc8804c9bc6e97888f Oct 12 13:21:48.284930 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1438474687 Oct 12 13:21:48.284930 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,admin,reader Oct 12 13:21:48.284930 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,admin,reader Oct 12 13:21:48.286329 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/191330f2e54b43cc8804c9bc6e97888f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_191330f2e54b43cc8804c9bc6e97888f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/191330f2e54b43cc8804c9bc6e97888f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/191330f2e54b43cc8804c9bc6e97888f"}]}] Oct 12 13:21:48.286329 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1438474687 Oct 12 13:21:48.286329 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 191330f2e54b43cc8804c9bc6e97888f Oct 12 13:21:48.286329 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1438474687 Oct 12 13:21:48.286329 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin Oct 12 13:21:48.286329 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:21:48.286329 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:21:48.286329 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 0afde2761eb14780b45766754b8ea753 Oct 12 13:21:48.286329 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin Oct 12 13:21:48.286329 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:21:48.286329 n-d-861076-2 devstack@n-api.service[120932]: {"addTenantAccess": {"tenant": "28c452a91b02417fada142df25ae7cc7"}} Oct 12 13:21:48.286329 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:21:48.287100 n-d-861076-2 devstack@n-api.service[120932]: exception: Flavor access already exists for flavor 16 and project 28c452a91b02417fada142df25ae7cc7 combination. Oct 12 13:21:48.287100 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '2137521841', 'body': {'addTenantAccess': {'tenant': '28c452a91b02417fada142df25ae7cc7'}}} Oct 12 13:21:48.287100 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:48.287100 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:48.287100 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 13:21:48.287100 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 13:21:48.287100 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 13:21:48.287100 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 13:21:48.287100 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 13:21:48.287100 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 13:21:48.287100 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 13:21:48.287100 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 13:21:48.287100 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 13:21:48.287100 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 13:21:48.287100 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 13:21:48.287100 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result.read() Oct 12 13:21:48.287100 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 13:21:48.287100 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 13:21:48.287969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 13:21:48.287969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 13:21:48.287969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 13:21:48.287969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 13:21:48.287969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 13:21:48.287969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 13:21:48.287969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '16-28c452a91b02417fada142df25ae7cc7' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 12 13:21:48.287969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:48.287969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 12 13:21:48.287969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:48.287969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:48.287969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 12 13:21:48.287969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 12 13:21:48.287969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 12 13:21:48.287969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi session.flush() Oct 12 13:21:48.287969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 13:21:48.287969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 12 13:21:48.287969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 13:21:48.287969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 12 13:21:48.289055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 13:21:48.289055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 12 13:21:48.289055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 13:21:48.289055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception Oct 12 13:21:48.289055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 13:21:48.289055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 12 13:21:48.289055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 13:21:48.289055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 12 13:21:48.289055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 13:21:48.289055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 12 13:21:48.289055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 13:21:48.289055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 12 13:21:48.289055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 12 13:21:48.289055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 12 13:21:48.289055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 13:21:48.289055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 13:21:48.289055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 13:21:48.289055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 12 13:21:48.290110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 13:21:48.290110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 12 13:21:48.290110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 13:21:48.290110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 12 13:21:48.290110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 13:21:48.290110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 13:21:48.290110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 13:21:48.290110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception Oct 12 13:21:48.290110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 13:21:48.290110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 13:21:48.290110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 13:21:48.290110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 13:21:48.290110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 13:21:48.290110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 13:21:48.290110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 13:21:48.290110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 13:21:48.290110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 13:21:48.290110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 13:21:48.291376 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 13:21:48.291376 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result.read() Oct 12 13:21:48.291376 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 13:21:48.291376 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 13:21:48.291376 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 13:21:48.291376 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 13:21:48.291376 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 13:21:48.291376 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 13:21:48.291376 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 13:21:48.291376 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 13:21:48.291376 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '16-28c452a91b02417fada142df25ae7cc7' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 12 13:21:48.291376 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 12 13:21:48.291376 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 12, 13, 21, 48, 224605), 'updated_at': None, 'flavor_id': 16, 'project_id': '28c452a91b02417fada142df25ae7cc7'}] Oct 12 13:21:48.291376 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 13:21:48.291376 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:48.291376 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:48.291376 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:48.292489 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:48.292489 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 12 13:21:48.292489 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 12 13:21:48.292489 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 13:21:48.292489 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 13:21:48.292489 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 12 13:21:48.292489 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 12 13:21:48.292489 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 12 13:21:48.292489 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 12 13:21:48.292489 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 12 13:21:48.292489 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 12 13:21:48.292489 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:21:48.292489 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:21:48.292489 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 12 13:21:48.292489 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 12 13:21:48.292489 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 16 and project 28c452a91b02417fada142df25ae7cc7 combination. Oct 12 13:21:48.292489 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:48.292489 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:48.292489 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:48.293613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:48.293613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:48.293613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:48.293613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:48.293613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:48.293613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:48.293613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:48.293613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:21:48.293613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:21:48.293613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 12 13:21:48.293613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 12 13:21:48.293613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 16 and project 28c452a91b02417fada142df25ae7cc7 combination. Oct 12 13:21:48.293613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:48.293613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:48.293613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:48.293613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:48.293613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:48.293613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:48.293613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:21:48.293613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:21:48.295261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 16 and project 28c452a91b02417fada142df25ae7cc7 combination. Oct 12 13:21:48.295261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:48.295261 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e9f90126-45c5-4782-8f82-03d36c88b497 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project 28c452a91b02417fada142df25ae7cc7 combination. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:48.295261 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e9f90126-45c5-4782-8f82-03d36c88b497 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/2137521841/action" status: 409 len: 152 microversion: 2.1 time: 0.946282 Oct 12 13:21:48.296702 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 20/55] 10.222.0.52 () {60 vars in 1200 bytes} [Wed Oct 12 13:21:47 2022] POST /compute/v2.1/flavors/2137521841/action => generated 152 bytes in 957 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:21:48.300581 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ab3bc1ef-231d-436c-82a0-54c1325800b2 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "28c452a91b02417fada142df25ae7cc7"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:48.662758 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-045624fe-85a0-4ac4-9a1e-1cd138d9c603 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Calling method '.version_select at 0x7f8aa07085e0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:48.667050 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-045624fe-85a0-4ac4-9a1e-1cd138d9c603 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:48.667539 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-045624fe-85a0-4ac4-9a1e-1cd138d9c603 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:48.667979 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-045624fe-85a0-4ac4-9a1e-1cd138d9c603 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:48.668711 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-045624fe-85a0-4ac4-9a1e-1cd138d9c603 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:48.669831 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-045624fe-85a0-4ac4-9a1e-1cd138d9c603 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:48.672078 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-045624fe-85a0-4ac4-9a1e-1cd138d9c603 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:48.729177 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-045624fe-85a0-4ac4-9a1e-1cd138d9c603 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.431138 Oct 12 13:21:48.747510 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 21/56] 10.222.0.52 () {58 vars in 1128 bytes} [Wed Oct 12 13:21:48 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:49.062867 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-82e8370c-accb-4608-b586-82cd3edf6e76 tempest-FlavorsV255TestJSON-1055509335 tempest-FlavorsV255TestJSON-1055509335-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-707875904", "id": 785196444, "os-flavor-access:is_public": "True"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:49.100166 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ab3bc1ef-231d-436c-82a0-54c1325800b2 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/2137521841/action" status: 200 len: 21 microversion: 2.1 time: 0.803371 Oct 12 13:21:49.105829 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 36/57] 10.222.0.52 () {60 vars in 1200 bytes} [Wed Oct 12 13:21:48 2022] POST /compute/v2.1/flavors/2137521841/action => generated 21 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:21:49.106965 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-327b01a0-b3f9-4a64-ae11-1f5e10a5df4d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:49.107693 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-327b01a0-b3f9-4a64-ae11-1f5e10a5df4d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:21:49.114148 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-327b01a0-b3f9-4a64-ae11-1f5e10a5df4d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:49.115769 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-327b01a0-b3f9-4a64-ae11-1f5e10a5df4d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:49.116213 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-327b01a0-b3f9-4a64-ae11-1f5e10a5df4d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:49.117501 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-327b01a0-b3f9-4a64-ae11-1f5e10a5df4d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:49.118095 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-327b01a0-b3f9-4a64-ae11-1f5e10a5df4d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:49.118664 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-327b01a0-b3f9-4a64-ae11-1f5e10a5df4d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:49.201582 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-82e8370c-accb-4608-b586-82cd3edf6e76 tempest-FlavorsV255TestJSON-1055509335 tempest-FlavorsV255TestJSON-1055509335-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.452877 Oct 12 13:21:49.202221 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 22/58] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 12 13:21:48 2022] POST /compute/v2.1/flavors => generated 445 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:21:49.240142 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-327b01a0-b3f9-4a64-ae11-1f5e10a5df4d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbfb915900c442c0999a39440a8228fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a760f270b741faa8363f5142561aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:21:49.257071 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-327b01a0-b3f9-4a64-ae11-1f5e10a5df4d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1296 microversion: 2.1 time: 0.155110 Oct 12 13:21:49.259027 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 37/59] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:21:49 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1296 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:49.486411 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5c0c3a33-d7af-467e-a135-e0f7a5fb78b7 tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Calling method '.version_select at 0x7f8aa06ce670>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:49.490779 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-5c0c3a33-d7af-467e-a135-e0f7a5fb78b7 tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'a074e71e742d4950883027949723fa20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fead338e14f460d85318abd07464f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:21:49.493871 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5c0c3a33-d7af-467e-a135-e0f7a5fb78b7 tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Request method failure captured: Oct 12 13:21:49.493871 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 12 13:21:49.493871 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:21:49.493871 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:21:49.493871 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:21:49.493871 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:21:49.493871 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:21:49.493871 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:21:49.493871 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:21:49.493871 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:49.493871 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr9pezbQhzVoxMxdhT00Qlsfi8_dBjPf8jvO4N1f1HWWJDHJMSCnCXPWRaBSHq2HUHuTPQ7tvnrijaZQNMSFVIQma8gPU96PRMCp9dnLO0iICYpg9wA5Cm8GAwE_FMvhByBmUuiVeAI5mfT7NUJhUvHVz-Z6GMbElIgV23TTK8OVq9U Oct 12 13:21:49.493871 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:21:49.493871 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:21:49.493871 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:21:49.493871 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:21:49.493871 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:21:49.493871 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:21:49.493871 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 4fead338e14f460d85318abd07464f28 Oct 12 13:21:49.493871 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1978285757 Oct 12 13:21:49.493871 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:21:49.493871 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:21:49.495169 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4fead338e14f460d85318abd07464f28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4fead338e14f460d85318abd07464f28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4fead338e14f460d85318abd07464f28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4fead338e14f460d85318abd07464f28"}]}] Oct 12 13:21:49.495169 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1978285757 Oct 12 13:21:49.495169 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 4fead338e14f460d85318abd07464f28 Oct 12 13:21:49.495169 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1978285757 Oct 12 13:21:49.495169 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-HostsAdminNegativeTestJSON-1978285757-project Oct 12 13:21:49.495169 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:21:49.495169 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:21:49.495169 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: a074e71e742d4950883027949723fa20 Oct 12 13:21:49.495169 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1978285757-project Oct 12 13:21:49.495169 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:21:49.495169 n-d-861076-2 devstack@n-api.service[120932]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 12 13:21:49.495169 n-d-861076-2 devstack@n-api.service[120932]: action_args: {} Oct 12 13:21:49.495169 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:49.500609 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:49.500609 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:49.500609 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:49.500609 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:49.500609 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:49.500609 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:21:49.500609 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:21:49.500609 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 13:21:49.500609 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:21:49.500609 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:49.500609 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:49.500609 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 12 13:21:49.500609 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 12 13:21:49.500609 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:21:49.500609 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:21:49.500609 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:21:49.500609 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:21:49.500609 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:21:49.500609 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:21:49.501761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:21:49.501761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:21:49.501761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:21:49.501761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:21:49.501761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:21:49.501761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:21:49.501761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:21:49.501761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:21:49.501761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 12 13:21:49.501761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:49.501761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:49.501761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:49.501761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:49.501761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:49.501761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:49.501761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:21:49.501761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:21:49.501761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 12 13:21:49.501761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:49.502675 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5c0c3a33-d7af-467e-a135-e0f7a5fb78b7 tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:49.502675 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5c0c3a33-d7af-467e-a135-e0f7a5fb78b7 tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.289315 Oct 12 13:21:49.502675 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 23/60] 10.222.0.52 () {58 vars in 1128 bytes} [Wed Oct 12 13:21:49 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 290 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:21:49.502675 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0b171ce4-fd2f-4c46-a852-b48491a46470 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:49.564676 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9bb9f2ef-8f40-4318-9e87-0ff0a7d52868 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1142268594", "id": 147990786, "os-flavor-access:is_public": "True"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:49.598927 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0b171ce4-fd2f-4c46-a852-b48491a46470 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/2137521841" status: 202 len: 0 microversion: 2.1 time: 0.101523 Oct 12 13:21:49.599519 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 24/61] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 12 13:21:49 2022] DELETE /compute/v2.1/flavors/2137521841 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:21:49.643452 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9bb9f2ef-8f40-4318-9e87-0ff0a7d52868 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.382558 Oct 12 13:21:49.644048 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 38/62] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:21:49 2022] POST /compute/v2.1/flavors => generated 427 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:49.731719 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-aa90b076-8898-441e-9796-f2b58ca9eb11 tempest-FlavorsAccessTestJSON-474636403 tempest-FlavorsAccessTestJSON-474636403-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-455701663", "id": 918418949, "os-flavor-access:is_public": "False"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:49.811132 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-aa90b076-8898-441e-9796-f2b58ca9eb11 tempest-FlavorsAccessTestJSON-474636403 tempest-FlavorsAccessTestJSON-474636403-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.165770 Oct 12 13:21:49.814175 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 39/63] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:21:49 2022] POST /compute/v2.1/flavors => generated 427 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:49.822958 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f08f22e4-6245-417a-bd4b-7527ec0750bf tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Calling method '.version_select at 0x7f8aa07b6550>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:49.824756 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f08f22e4-6245-417a-bd4b-7527ec0750bf tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'a074e71e742d4950883027949723fa20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fead338e14f460d85318abd07464f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:21:49.835191 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1620c694-d4e4-4e24-9638-2013dbe968ff tempest-FlavorsV255TestJSON-1479125918 tempest-FlavorsV255TestJSON-1479125918-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:49.842843 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f08f22e4-6245-417a-bd4b-7527ec0750bf tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Request method failure captured: Oct 12 13:21:49.842843 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-hosts/n-d-861076-2/reboot HTTP/1.1 Oct 12 13:21:49.842843 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:21:49.842843 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:21:49.842843 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:21:49.842843 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:21:49.842843 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:21:49.842843 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:21:49.842843 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:21:49.842843 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:49.842843 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9pezbQhzVoxMxdhT00Qlsfi8_dBjPf8jvO4N1f1HWWJDHJMSCnCXPWRaBSHq2HUHuTPQ7tvnrijaZQNMSFVIQma8gPU96PRMCp9dnLO0iICYpg9wA5Cm8GAwE_FMvhByBmUuiVeAI5mfT7NUJhUvHVz-Z6GMbElIgV23TTK8OVq9U Oct 12 13:21:49.842843 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:21:49.842843 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:21:49.842843 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:21:49.842843 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:21:49.842843 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:21:49.842843 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:21:49.842843 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 4fead338e14f460d85318abd07464f28 Oct 12 13:21:49.842843 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1978285757 Oct 12 13:21:49.842843 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:21:49.842843 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:21:49.843915 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4fead338e14f460d85318abd07464f28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4fead338e14f460d85318abd07464f28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4fead338e14f460d85318abd07464f28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4fead338e14f460d85318abd07464f28"}]}] Oct 12 13:21:49.843915 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1978285757 Oct 12 13:21:49.843915 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 4fead338e14f460d85318abd07464f28 Oct 12 13:21:49.843915 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1978285757 Oct 12 13:21:49.843915 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-HostsAdminNegativeTestJSON-1978285757-project Oct 12 13:21:49.843915 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:21:49.843915 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:21:49.843915 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: a074e71e742d4950883027949723fa20 Oct 12 13:21:49.843915 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1978285757-project Oct 12 13:21:49.843915 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:21:49.843915 n-d-861076-2 devstack@n-api.service[120933]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 12 13:21:49.843915 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'n-d-861076-2'} Oct 12 13:21:49.843915 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:49.844560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:49.844560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:49.844560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:49.844560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:49.844560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:49.844560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:21:49.844560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:21:49.844560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:49.844560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:49.844560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 12 13:21:49.844560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 12 13:21:49.844560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:21:49.844560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:21:49.844560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:21:49.844560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:21:49.844560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:21:49.844560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:21:49.844560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:21:49.844560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:21:49.845524 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:21:49.845524 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:21:49.845524 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:21:49.845524 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:21:49.845524 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:21:49.845524 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:21:49.845524 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 12 13:21:49.845524 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:49.845524 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:49.845524 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:49.845524 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:49.845524 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:49.845524 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:49.845524 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:21:49.845524 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:21:49.845524 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 12 13:21:49.845524 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:49.847251 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f08f22e4-6245-417a-bd4b-7527ec0750bf tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:49.847251 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f08f22e4-6245-417a-bd4b-7527ec0750bf tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-d-861076-2/reboot" status: 403 len: 111 microversion: 2.1 time: 0.025896 Oct 12 13:21:49.847831 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 40/64] 10.222.0.52 () {58 vars in 1188 bytes} [Wed Oct 12 13:21:49 2022] GET /compute/v2.1/os-hosts/n-d-861076-2/reboot => generated 111 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:21:49.852390 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f02669ce-c1d6-47ea-9740-d3f557553d50 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:49.855292 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1620c694-d4e4-4e24-9638-2013dbe968ff tempest-FlavorsV255TestJSON-1479125918 tempest-FlavorsV255TestJSON-1479125918-project] 10.222.0.52 "GET /compute/v2.1/flavors/785196444" status: 200 len: 445 microversion: 2.55 time: 0.254341 Oct 12 13:21:49.856520 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 25/65] 10.222.0.52 () {60 vars in 1196 bytes} [Wed Oct 12 13:21:49 2022] GET /compute/v2.1/flavors/785196444 => generated 445 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:21:49.863230 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-29f02c3b-dfe1-4bc0-b66a-b3d61b62b31b tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:49.904389 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f02669ce-c1d6-47ea-9740-d3f557553d50 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5822 microversion: 2.1 time: 0.055336 Oct 12 13:21:49.905730 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 41/66] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:49 2022] GET /compute/v2.1/flavors/detail => generated 5822 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:49.910637 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2c6e18c6-0753-4b49-885b-38ecb40e210c tempest-FlavorsAccessTestJSON-474636403 tempest-FlavorsAccessTestJSON-474636403-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6bf13ccf28ae41c987c3477f991b7df2"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:49.953349 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-29f02c3b-dfe1-4bc0-b66a-b3d61b62b31b tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/147990786" status: 202 len: 0 microversion: 2.1 time: 0.095182 Oct 12 13:21:49.954090 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 26/67] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 12 13:21:49 2022] DELETE /compute/v2.1/flavors/147990786 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:21:49.964632 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1fe60da5-ab92-400c-bda0-8fcd5cde5b0e tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Calling method '.version_select at 0x7f8aa068a8b0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:50.002395 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-1fe60da5-ab92-400c-bda0-8fcd5cde5b0e tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:50.005819 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1fe60da5-ab92-400c-bda0-8fcd5cde5b0e tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Request method failure captured: Oct 12 13:21:50.005819 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 12 13:21:50.005819 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:21:50.005819 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:21:50.005819 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:21:50.005819 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:21:50.005819 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:21:50.005819 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:21:50.005819 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:21:50.005819 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:50.005819 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr9s7T7d-F40YAn1umWVdTSp_aq4dJryZOHMqK9J6Zlo0vFqP8Ul0hFvW1626FNALghi0atvzi9p3PuYODHgW-1tAFri8B0WqzW4KV_lCshnIaUUSJkq_wU7OpNFOr1-bRp_OQ19pQE6BlG12Gwc5PFDjQSqlEM9m7vjQ91EzTKShOA Oct 12 13:21:50.005819 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:21:50.005819 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:21:50.005819 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:21:50.005819 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:21:50.005819 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:21:50.005819 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:21:50.005819 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: f0f9edee0d924a34a1d470a046c82d9f Oct 12 13:21:50.005819 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:50.005819 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,admin,reader Oct 12 13:21:50.005819 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,admin,reader Oct 12 13:21:50.007002 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f0f9edee0d924a34a1d470a046c82d9f"}]}] Oct 12 13:21:50.007002 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:50.007002 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: f0f9edee0d924a34a1d470a046c82d9f Oct 12 13:21:50.007002 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:50.007002 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-HostsAdminNegativeTestJSON-1090889828-project-admin Oct 12 13:21:50.007002 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:21:50.007002 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:21:50.007002 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 226d831c08134a1a9c23ce467c2369ae Oct 12 13:21:50.007002 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1090889828-project-admin Oct 12 13:21:50.007002 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:21:50.007002 n-d-861076-2 devstack@n-api.service[120932]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:50.007002 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'nonexistent_hostname'} Oct 12 13:21:50.007002 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:50.008261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:50.008261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 12 13:21:50.008261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 12 13:21:50.008261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 13:21:50.008261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 13:21:50.008261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:21:50.008261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:21:50.008261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:21:50.008261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:21:50.008261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 13:21:50.008261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 13:21:50.008261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 12 13:21:50.008261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 12 13:21:50.008261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:21:50.008261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:21:50.008261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 13:21:50.008261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 13:21:50.008261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:21:50.008261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:21:50.009359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 13:21:50.009359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 13:21:50.009359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:50.009359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:50.009359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:50.009359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:50.009359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:50.009359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:50.009359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:50.009359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:50.009359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:50.009359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:21:50.009359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:21:50.009359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:50.009359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:50.009359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 12 13:21:50.009359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 12 13:21:50.009359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 12 13:21:50.009359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:21:50.010319 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:50.010319 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:50.010319 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:50.010319 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:50.010319 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:50.010319 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:50.010319 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:50.010319 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:21:50.010319 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:21:50.010319 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:50.010319 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:50.010319 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1fe60da5-ab92-400c-bda0-8fcd5cde5b0e tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:50.016784 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1fe60da5-ab92-400c-bda0-8fcd5cde5b0e tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.057932 Oct 12 13:21:50.023957 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 27/68] 10.222.0.52 () {58 vars in 1212 bytes} [Wed Oct 12 13:21:49 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:21:50.033068 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cd850124-270e-4d61-9aba-7986de671b1a tempest-FlavorsV255TestJSON-1055509335 tempest-FlavorsV255TestJSON-1055509335-project-admin] Action: 'update', calling method: .version_select at 0x7f8aa18e8b80>, body: {"flavor": {"description": "new"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:50.133724 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2c6e18c6-0753-4b49-885b-38ecb40e210c tempest-FlavorsAccessTestJSON-474636403 tempest-FlavorsAccessTestJSON-474636403-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/918418949/action" status: 200 len: 96 microversion: 2.1 time: 0.226658 Oct 12 13:21:50.135384 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 42/69] 10.222.0.52 () {60 vars in 1197 bytes} [Wed Oct 12 13:21:49 2022] POST /compute/v2.1/flavors/918418949/action => generated 96 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:21:50.141007 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d97593b3-cbc9-4ec9-8701-40e9878948e1 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-623079947", "id": 1419927605, "os-flavor-access:is_public": "True"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:50.255648 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cd850124-270e-4d61-9aba-7986de671b1a tempest-FlavorsV255TestJSON-1055509335 tempest-FlavorsV255TestJSON-1055509335-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/785196444" status: 200 len: 446 microversion: 2.55 time: 0.235835 Oct 12 13:21:50.269150 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 28/70] 10.222.0.52 () {62 vars in 1216 bytes} [Wed Oct 12 13:21:50 2022] PUT /compute/v2.1/flavors/785196444 => generated 446 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:21:50.288763 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cf08e18b-f974-4ec6-997e-f43f76c587d0 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:50.343029 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d97593b3-cbc9-4ec9-8701-40e9878948e1 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.195292 Oct 12 13:21:50.343936 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 43/71] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:21:50 2022] POST /compute/v2.1/flavors => generated 437 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:50.358255 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cf08e18b-f974-4ec6-997e-f43f76c587d0 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5832 microversion: 2.1 time: 0.087569 Oct 12 13:21:50.359209 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 29/72] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:50 2022] GET /compute/v2.1/flavors/detail => generated 5832 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:50.380362 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-50761d98-fe57-4d74-b582-02c41ef6d1fc tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Calling method '.version_select at 0x7f8aa07b6ca0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:50.391627 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-50761d98-fe57-4d74-b582-02c41ef6d1fc tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'a074e71e742d4950883027949723fa20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fead338e14f460d85318abd07464f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:21:50.394064 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-50761d98-fe57-4d74-b582-02c41ef6d1fc tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Request method failure captured: Oct 12 13:21:50.394064 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-hosts/n-d-861076-2 HTTP/1.1 Oct 12 13:21:50.394064 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:21:50.394064 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:21:50.394064 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:21:50.394064 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:21:50.394064 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:21:50.394064 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:21:50.394064 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:21:50.394064 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:50.394064 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9pezbQhzVoxMxdhT00Qlsfi8_dBjPf8jvO4N1f1HWWJDHJMSCnCXPWRaBSHq2HUHuTPQ7tvnrijaZQNMSFVIQma8gPU96PRMCp9dnLO0iICYpg9wA5Cm8GAwE_FMvhByBmUuiVeAI5mfT7NUJhUvHVz-Z6GMbElIgV23TTK8OVq9U Oct 12 13:21:50.394064 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:21:50.394064 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:21:50.394064 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:21:50.394064 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:21:50.394064 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:21:50.394064 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:21:50.394064 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 4fead338e14f460d85318abd07464f28 Oct 12 13:21:50.394064 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1978285757 Oct 12 13:21:50.394064 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:21:50.394064 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:21:50.395713 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4fead338e14f460d85318abd07464f28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4fead338e14f460d85318abd07464f28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4fead338e14f460d85318abd07464f28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4fead338e14f460d85318abd07464f28"}]}] Oct 12 13:21:50.395713 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1978285757 Oct 12 13:21:50.395713 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 4fead338e14f460d85318abd07464f28 Oct 12 13:21:50.395713 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1978285757 Oct 12 13:21:50.395713 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-HostsAdminNegativeTestJSON-1978285757-project Oct 12 13:21:50.395713 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:21:50.395713 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:21:50.395713 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: a074e71e742d4950883027949723fa20 Oct 12 13:21:50.395713 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1978285757-project Oct 12 13:21:50.395713 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:21:50.395713 n-d-861076-2 devstack@n-api.service[120933]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 12 13:21:50.395713 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'n-d-861076-2'} Oct 12 13:21:50.395713 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:50.396802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:50.396802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:50.396802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:50.396802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:50.396802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:50.396802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:21:50.396802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:21:50.396802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:50.396802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:50.396802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 12 13:21:50.396802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 12 13:21:50.396802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:21:50.396802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:21:50.396802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:21:50.396802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:21:50.396802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:21:50.396802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:21:50.396802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:21:50.396802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:21:50.398727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:21:50.398727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:21:50.398727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:21:50.398727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:21:50.398727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:21:50.398727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:21:50.398727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 12 13:21:50.398727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:50.398727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:50.398727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:50.398727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:50.398727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:50.398727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:50.398727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:21:50.398727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:21:50.398727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 12 13:21:50.398727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:50.400793 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-50761d98-fe57-4d74-b582-02c41ef6d1fc tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:50.402333 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-50761d98-fe57-4d74-b582-02c41ef6d1fc tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-d-861076-2" status: 403 len: 109 microversion: 2.1 time: 0.054485 Oct 12 13:21:50.403681 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 44/73] 10.222.0.52 () {58 vars in 1167 bytes} [Wed Oct 12 13:21:50 2022] GET /compute/v2.1/os-hosts/n-d-861076-2 => generated 109 bytes in 59 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:21:50.409471 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-909c8511-e856-462c-bf07-9d5390cc6902 tempest-FlavorsV255TestJSON-1479125918 tempest-FlavorsV255TestJSON-1479125918-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:50.457266 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-909c8511-e856-462c-bf07-9d5390cc6902 tempest-FlavorsV255TestJSON-1479125918 tempest-FlavorsV255TestJSON-1479125918-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 6169 microversion: 2.55 time: 0.052183 Oct 12 13:21:50.458007 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 45/74] 10.222.0.52 () {60 vars in 1187 bytes} [Wed Oct 12 13:21:50 2022] GET /compute/v2.1/flavors/detail => generated 6169 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:21:50.463405 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9e0222c1-7e3b-4b7b-bf54-584644c0ea7a tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:50.464138 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-9e0222c1-7e3b-4b7b-bf54-584644c0ea7a tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:21:50.475180 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9e0222c1-7e3b-4b7b-bf54-584644c0ea7a tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:50.475824 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9e0222c1-7e3b-4b7b-bf54-584644c0ea7a tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:50.476475 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9e0222c1-7e3b-4b7b-bf54-584644c0ea7a tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:50.477226 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9e0222c1-7e3b-4b7b-bf54-584644c0ea7a tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:50.477702 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9e0222c1-7e3b-4b7b-bf54-584644c0ea7a tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:50.480280 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9e0222c1-7e3b-4b7b-bf54-584644c0ea7a tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:50.594749 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4b7007d5-84ad-4bdd-8fc8-095152fac91d tempest-FlavorsAccessTestJSON-1423070288 tempest-FlavorsAccessTestJSON-1423070288-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:50.653687 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4b7007d5-84ad-4bdd-8fc8-095152fac91d tempest-FlavorsAccessTestJSON-1423070288 tempest-FlavorsAccessTestJSON-1423070288-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 6249 microversion: 2.1 time: 0.292767 Oct 12 13:21:50.654876 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 30/75] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:50 2022] GET /compute/v2.1/flavors/detail => generated 6249 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:50.664120 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7e1f7311-a4b9-4355-85c2-1c3b8ef4d633 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:50.672084 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-7e1f7311-a4b9-4355-85c2-1c3b8ef4d633 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 12 13:21:50.673638 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7e1f7311-a4b9-4355-85c2-1c3b8ef4d633 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Request method failure captured: Oct 12 13:21:50.673638 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/flavors/1419927605/os-flavor-access HTTP/1.1 Oct 12 13:21:50.673638 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:21:50.673638 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:21:50.673638 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:21:50.673638 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:21:50.673638 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:21:50.673638 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:21:50.673638 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:21:50.673638 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:50.673638 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr9nXRsV1tExwt4w8v4HKkDSyjSpSaFOfiZL2mps4XkoHIyEUE_LFzp3QqYu7CaGIX4NwCQsGTmLEehVHcz0xpc0Y22PvU5T3fejz7um7_4gzy9K4Ot_SbG3x3GM3d5LiMxvJMaTkeqU9NXEpVLZJhFb0PNxl3YF9vf4rTkW0W0KNmc Oct 12 13:21:50.673638 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:21:50.673638 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:21:50.673638 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:21:50.673638 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:21:50.673638 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:21:50.673638 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:21:50.673638 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 191330f2e54b43cc8804c9bc6e97888f Oct 12 13:21:50.673638 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1438474687 Oct 12 13:21:50.673638 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,admin,reader Oct 12 13:21:50.673638 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,admin,reader Oct 12 13:21:50.675007 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/191330f2e54b43cc8804c9bc6e97888f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_191330f2e54b43cc8804c9bc6e97888f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/191330f2e54b43cc8804c9bc6e97888f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/191330f2e54b43cc8804c9bc6e97888f"}]}] Oct 12 13:21:50.675007 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1438474687 Oct 12 13:21:50.675007 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 191330f2e54b43cc8804c9bc6e97888f Oct 12 13:21:50.675007 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1438474687 Oct 12 13:21:50.675007 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin Oct 12 13:21:50.675007 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:21:50.675007 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:21:50.675007 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 0afde2761eb14780b45766754b8ea753 Oct 12 13:21:50.675007 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin Oct 12 13:21:50.675007 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:21:50.675007 n-d-861076-2 devstack@n-api.service[120932]: exception: Access list not available for public flavors. Oct 12 13:21:50.675007 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'flavor_id': '1419927605'} Oct 12 13:21:50.679933 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:50.679933 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:50.679933 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:50.679933 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:50.679933 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:50.679933 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:50.679933 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:50.679933 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:50.679933 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 12 13:21:50.679933 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 13:21:50.679933 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 12 13:21:50.679933 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:50.679933 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:50.679933 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:50.679933 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:50.679933 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:50.679933 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:50.679933 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:21:50.679933 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:21:50.679933 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 12 13:21:50.679933 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:50.680999 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7e1f7311-a4b9-4355-85c2-1c3b8ef4d633 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:50.680999 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7e1f7311-a4b9-4355-85c2-1c3b8ef4d633 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/1419927605/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.019021 Oct 12 13:21:50.680999 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 31/76] 10.222.0.52 () {58 vars in 1209 bytes} [Wed Oct 12 13:21:50 2022] GET /compute/v2.1/flavors/1419927605/os-flavor-access => generated 91 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:21:50.681438 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9368781f-8325-4ea8-8c23-2c9365f4914c tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1704133427", "id": 793661742, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:50.799849 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9368781f-8325-4ea8-8c23-2c9365f4914c tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.122207 Oct 12 13:21:50.808564 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 32/77] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:21:50 2022] POST /compute/v2.1/flavors => generated 414 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:50.808745 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-62d1728e-cd4a-418d-9f94-cf1a828ccd6c tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Calling method '.version_select at 0x7f8aa068aee0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:50.833175 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-62d1728e-cd4a-418d-9f94-cf1a828ccd6c tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:50.838091 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-62d1728e-cd4a-418d-9f94-cf1a828ccd6c tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Request method failure captured: Oct 12 13:21:50.838091 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 12 13:21:50.838091 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:21:50.838091 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:21:50.838091 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:21:50.838091 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:21:50.838091 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:21:50.838091 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:21:50.838091 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:21:50.838091 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:50.838091 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr9s7T7d-F40YAn1umWVdTSp_aq4dJryZOHMqK9J6Zlo0vFqP8Ul0hFvW1626FNALghi0atvzi9p3PuYODHgW-1tAFri8B0WqzW4KV_lCshnIaUUSJkq_wU7OpNFOr1-bRp_OQ19pQE6BlG12Gwc5PFDjQSqlEM9m7vjQ91EzTKShOA Oct 12 13:21:50.838091 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:21:50.838091 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:21:50.838091 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:21:50.838091 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:21:50.838091 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:21:50.838091 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:21:50.838091 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: f0f9edee0d924a34a1d470a046c82d9f Oct 12 13:21:50.838091 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:50.838091 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,admin,reader Oct 12 13:21:50.838091 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,admin,reader Oct 12 13:21:50.839949 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f0f9edee0d924a34a1d470a046c82d9f"}]}] Oct 12 13:21:50.839949 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:50.839949 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: f0f9edee0d924a34a1d470a046c82d9f Oct 12 13:21:50.839949 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:50.839949 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-HostsAdminNegativeTestJSON-1090889828-project-admin Oct 12 13:21:50.839949 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:21:50.839949 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:21:50.839949 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 226d831c08134a1a9c23ce467c2369ae Oct 12 13:21:50.839949 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1090889828-project-admin Oct 12 13:21:50.839949 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:21:50.839949 n-d-861076-2 devstack@n-api.service[120932]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:50.839949 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'nonexistent_hostname'} Oct 12 13:21:50.839949 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:50.840778 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:50.840778 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 12 13:21:50.840778 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 12 13:21:50.840778 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:21:50.840778 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:21:50.840778 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 13:21:50.840778 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 13:21:50.840778 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:21:50.840778 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:21:50.840778 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 13:21:50.840778 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 13:21:50.840778 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:50.840778 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:50.840778 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:50.840778 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:50.840778 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:50.840778 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:50.840778 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:50.840778 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:50.841851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:50.841851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:21:50.841851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:21:50.841851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:50.841851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:50.841851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 12 13:21:50.841851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:21:50.841851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:50.841851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:50.841851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:50.841851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:50.841851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:50.841851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:50.841851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:50.841851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:21:50.841851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:21:50.841851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:50.841851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:50.843010 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-62d1728e-cd4a-418d-9f94-cf1a828ccd6c tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:50.843010 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-62d1728e-cd4a-418d-9f94-cf1a828ccd6c tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.037607 Oct 12 13:21:50.843010 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 33/78] 10.222.0.52 () {58 vars in 1191 bytes} [Wed Oct 12 13:21:50 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:21:50.854969 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-dae664d6-c809-487f-bc31-dae2666a7845 tempest-FlavorsV255TestJSON-1479125918 tempest-FlavorsV255TestJSON-1479125918-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:51.017773 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-dae664d6-c809-487f-bc31-dae2666a7845 tempest-FlavorsV255TestJSON-1479125918 tempest-FlavorsV255TestJSON-1479125918-project] 10.222.0.52 "GET /compute/v2.1/flavors" status: 200 len: 3681 microversion: 2.55 time: 0.055123 Oct 12 13:21:51.017773 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 34/79] 10.222.0.52 () {60 vars in 1166 bytes} [Wed Oct 12 13:21:50 2022] GET /compute/v2.1/flavors => generated 3681 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:21:51.017773 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7ab8a807-5fb3-4bae-9abb-23d0ed214018 tempest-FlavorsAccessTestJSON-474636403 tempest-FlavorsAccessTestJSON-474636403-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6bf13ccf28ae41c987c3477f991b7df2"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:51.018973 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9e0222c1-7e3b-4b7b-bf54-584644c0ea7a tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbfb915900c442c0999a39440a8228fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a760f270b741faa8363f5142561aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:21:51.018973 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9e0222c1-7e3b-4b7b-bf54-584644c0ea7a tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1338 microversion: 2.1 time: 0.495276 Oct 12 13:21:51.018973 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 46/80] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:21:50 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1338 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:51.018973 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d386e6ab-47e2-4eef-b35e-b40aaea963e4 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:51.618695 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d386e6ab-47e2-4eef-b35e-b40aaea963e4 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1419927605" status: 202 len: 0 microversion: 2.1 time: 0.662623 Oct 12 13:21:51.620476 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 47/81] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 12 13:21:50 2022] DELETE /compute/v2.1/flavors/1419927605 => generated 0 bytes in 665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:21:51.626376 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ef4724b8-3e24-4055-b599-05cdf3df3f88 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:51.634026 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7ab8a807-5fb3-4bae-9abb-23d0ed214018 tempest-FlavorsAccessTestJSON-474636403 tempest-FlavorsAccessTestJSON-474636403-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/918418949/action" status: 200 len: 21 microversion: 2.1 time: 0.733920 Oct 12 13:21:51.639426 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 35/82] 10.222.0.52 () {60 vars in 1197 bytes} [Wed Oct 12 13:21:50 2022] POST /compute/v2.1/flavors/918418949/action => generated 21 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:21:51.651016 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2eb19b9b-c74c-40c6-a2ba-55670e546fac tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Calling method '.version_select at 0x7f8aa068a1f0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:51.655138 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-2eb19b9b-c74c-40c6-a2ba-55670e546fac tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'a074e71e742d4950883027949723fa20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fead338e14f460d85318abd07464f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:21:51.659499 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2eb19b9b-c74c-40c6-a2ba-55670e546fac tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Request method failure captured: Oct 12 13:21:51.659499 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/os-hosts/n-d-861076-2/shutdown HTTP/1.1 Oct 12 13:21:51.659499 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:21:51.659499 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:21:51.659499 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:21:51.659499 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:21:51.659499 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:21:51.659499 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:21:51.659499 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:21:51.659499 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:51.659499 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr9pezbQhzVoxMxdhT00Qlsfi8_dBjPf8jvO4N1f1HWWJDHJMSCnCXPWRaBSHq2HUHuTPQ7tvnrijaZQNMSFVIQma8gPU96PRMCp9dnLO0iICYpg9wA5Cm8GAwE_FMvhByBmUuiVeAI5mfT7NUJhUvHVz-Z6GMbElIgV23TTK8OVq9U Oct 12 13:21:51.659499 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:21:51.659499 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:21:51.659499 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:21:51.659499 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:21:51.659499 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:21:51.659499 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:21:51.659499 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 4fead338e14f460d85318abd07464f28 Oct 12 13:21:51.659499 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1978285757 Oct 12 13:21:51.659499 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:21:51.659499 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:21:51.662605 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4fead338e14f460d85318abd07464f28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4fead338e14f460d85318abd07464f28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4fead338e14f460d85318abd07464f28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4fead338e14f460d85318abd07464f28"}]}] Oct 12 13:21:51.662605 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1978285757 Oct 12 13:21:51.662605 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 4fead338e14f460d85318abd07464f28 Oct 12 13:21:51.662605 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1978285757 Oct 12 13:21:51.662605 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-HostsAdminNegativeTestJSON-1978285757-project Oct 12 13:21:51.662605 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:21:51.662605 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:21:51.662605 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: a074e71e742d4950883027949723fa20 Oct 12 13:21:51.662605 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1978285757-project Oct 12 13:21:51.662605 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:21:51.662605 n-d-861076-2 devstack@n-api.service[120932]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 12 13:21:51.662605 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'n-d-861076-2'} Oct 12 13:21:51.662605 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:51.663449 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:51.663449 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:51.663449 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:51.663449 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:51.663449 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:51.663449 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:21:51.663449 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:21:51.663449 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:51.663449 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:51.663449 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 12 13:21:51.663449 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 12 13:21:51.663449 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:21:51.663449 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:21:51.663449 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:21:51.663449 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:21:51.663449 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:21:51.663449 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:21:51.663449 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:21:51.663449 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:21:51.664618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:21:51.664618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:21:51.664618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:21:51.664618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:21:51.664618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:21:51.664618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:21:51.664618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 12 13:21:51.664618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:51.664618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:51.664618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:51.664618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:51.664618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:51.664618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:51.664618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:21:51.664618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:21:51.664618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 12 13:21:51.664618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:51.668725 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2eb19b9b-c74c-40c6-a2ba-55670e546fac tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:51.672223 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2eb19b9b-c74c-40c6-a2ba-55670e546fac tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-d-861076-2/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.030066 Oct 12 13:21:51.673520 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 36/83] 10.222.0.52 () {58 vars in 1194 bytes} [Wed Oct 12 13:21:51 2022] GET /compute/v2.1/os-hosts/n-d-861076-2/shutdown => generated 113 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:21:51.678101 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ef4724b8-3e24-4055-b599-05cdf3df3f88 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5809 microversion: 2.1 time: 0.056238 Oct 12 13:21:51.685934 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-dc7f144c-88c6-4352-9dc6-cbb26d8b8231 tempest-FlavorsV255TestJSON-1055509335 tempest-FlavorsV255TestJSON-1055509335-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:51.689060 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 48/84] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:51 2022] GET /compute/v2.1/flavors/detail => generated 5809 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:51.701703 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-419ee8c3-2a02-47b6-b472-ac8e7d7fb7ff tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:51.725227 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-419ee8c3-2a02-47b6-b472-ac8e7d7fb7ff tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5809 microversion: 2.1 time: 0.034890 Oct 12 13:21:51.725821 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 49/85] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:51 2022] GET /compute/v2.1/flavors/detail => generated 5809 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:51.741228 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-176fa27f-1358-47c0-b6ac-e1a7deb45b45 tempest-FlavorsAccessTestJSON-1423070288 tempest-FlavorsAccessTestJSON-1423070288-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:51.756959 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-176fa27f-1358-47c0-b6ac-e1a7deb45b45 tempest-FlavorsAccessTestJSON-1423070288 tempest-FlavorsAccessTestJSON-1423070288-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5809 microversion: 2.1 time: 0.029888 Oct 12 13:21:51.758957 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 50/86] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:51 2022] GET /compute/v2.1/flavors/detail => generated 5809 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:51.764924 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b75f33ba-9b0c-48a3-97df-9559e98f4276 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Calling method '.version_select at 0x7f8aa07e6dc0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:51.786982 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-dc7f144c-88c6-4352-9dc6-cbb26d8b8231 tempest-FlavorsV255TestJSON-1055509335 tempest-FlavorsV255TestJSON-1055509335-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/785196444" status: 202 len: 0 microversion: 2.55 time: 0.109863 Oct 12 13:21:51.795223 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-b75f33ba-9b0c-48a3-97df-9559e98f4276 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:51.795460 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 37/87] 10.222.0.52 () {60 vars in 1199 bytes} [Wed Oct 12 13:21:51 2022] DELETE /compute/v2.1/flavors/785196444 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:21:51.795539 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b75f33ba-9b0c-48a3-97df-9559e98f4276 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Request method failure captured: Oct 12 13:21:51.795539 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 12 13:21:51.795539 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:21:51.795539 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:21:51.795539 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:21:51.795539 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:21:51.795539 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:21:51.795539 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:21:51.795539 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:21:51.795539 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:51.795539 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9s7T7d-F40YAn1umWVdTSp_aq4dJryZOHMqK9J6Zlo0vFqP8Ul0hFvW1626FNALghi0atvzi9p3PuYODHgW-1tAFri8B0WqzW4KV_lCshnIaUUSJkq_wU7OpNFOr1-bRp_OQ19pQE6BlG12Gwc5PFDjQSqlEM9m7vjQ91EzTKShOA Oct 12 13:21:51.795539 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:21:51.795539 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:21:51.795539 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:21:51.795539 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:21:51.795539 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:21:51.795539 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:21:51.795539 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: f0f9edee0d924a34a1d470a046c82d9f Oct 12 13:21:51.795539 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:51.795539 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:21:51.795539 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:21:51.796888 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f0f9edee0d924a34a1d470a046c82d9f"}]}] Oct 12 13:21:51.796888 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:51.796888 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: f0f9edee0d924a34a1d470a046c82d9f Oct 12 13:21:51.796888 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:51.796888 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-HostsAdminNegativeTestJSON-1090889828-project-admin Oct 12 13:21:51.796888 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:21:51.796888 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:21:51.796888 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 226d831c08134a1a9c23ce467c2369ae Oct 12 13:21:51.796888 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1090889828-project-admin Oct 12 13:21:51.796888 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:21:51.796888 n-d-861076-2 devstack@n-api.service[120933]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:51.796888 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'nonexistent_hostname'} Oct 12 13:21:51.796888 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:51.797695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:51.797695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 12 13:21:51.797695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 12 13:21:51.797695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 13:21:51.797695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 13:21:51.797695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:21:51.797695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:21:51.797695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:21:51.797695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:21:51.797695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 13:21:51.797695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 13:21:51.797695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 12 13:21:51.797695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 12 13:21:51.797695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:21:51.797695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:21:51.797695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 13:21:51.797695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 13:21:51.797695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:21:51.797695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:21:51.798671 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 13:21:51.798671 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 13:21:51.798671 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:51.798671 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:51.798671 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:51.798671 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:51.798671 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:51.798671 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:51.798671 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:51.798671 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:51.798671 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:51.798671 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:21:51.798671 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:21:51.798671 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:51.798671 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:51.798671 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 12 13:21:51.798671 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 12 13:21:51.798671 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 12 13:21:51.798671 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:21:51.800120 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:51.800120 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:51.800120 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:51.800120 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:51.800120 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:51.800120 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:51.800120 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:51.800120 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:21:51.800120 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:21:51.800120 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:51.800120 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:51.800120 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b75f33ba-9b0c-48a3-97df-9559e98f4276 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:51.800120 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b75f33ba-9b0c-48a3-97df-9559e98f4276 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.031147 Oct 12 13:21:51.800120 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 51/88] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Oct 12 13:21:51 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:21:51.802137 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b2bec38c-8fb4-41ab-9f34-1b4739ec13f9 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:51.805336 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-98003c2e-ad17-485d-9807-ce824c66cd4a tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-883792087", "id": 835272385, "os-flavor-access:is_public": "False"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:51.893534 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-98003c2e-ad17-485d-9807-ce824c66cd4a tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.093656 Oct 12 13:21:51.894670 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 52/89] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:21:51 2022] POST /compute/v2.1/flavors => generated 435 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:51.906171 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b2bec38c-8fb4-41ab-9f34-1b4739ec13f9 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/793661742" status: 202 len: 0 microversion: 2.1 time: 0.115966 Oct 12 13:21:51.907619 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 38/90] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 12 13:21:51 2022] DELETE /compute/v2.1/flavors/793661742 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:21:51.914092 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-690cb979-42f5-4859-9286-8de087b877e1 tempest-FlavorsAccessTestJSON-474636403 tempest-FlavorsAccessTestJSON-474636403-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:51.925823 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b1f86143-e1e2-463d-b909-1861d838d1d4 tempest-FlavorsV255TestJSON-1055509335 tempest-FlavorsV255TestJSON-1055509335-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:51.964191 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b1f86143-e1e2-463d-b909-1861d838d1d4 tempest-FlavorsV255TestJSON-1055509335 tempest-FlavorsV255TestJSON-1055509335-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.055040 Oct 12 13:21:51.980213 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 39/91] 10.222.0.52 () {60 vars in 1187 bytes} [Wed Oct 12 13:21:51 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:21:51.995005 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5c52d7b3-5edd-423e-a640-f6cd5573e7fe tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Calling method '.version_select at 0x7f8aa06bda60>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:51.997277 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-5c52d7b3-5edd-423e-a640-f6cd5573e7fe tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'a074e71e742d4950883027949723fa20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fead338e14f460d85318abd07464f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:21:51.999950 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5c52d7b3-5edd-423e-a640-f6cd5573e7fe tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Request method failure captured: Oct 12 13:21:51.999950 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/os-hosts/n-d-861076-2/startup HTTP/1.1 Oct 12 13:21:51.999950 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:21:51.999950 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:21:51.999950 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:21:51.999950 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:21:51.999950 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:21:51.999950 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:21:51.999950 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:21:51.999950 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:51.999950 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr9pezbQhzVoxMxdhT00Qlsfi8_dBjPf8jvO4N1f1HWWJDHJMSCnCXPWRaBSHq2HUHuTPQ7tvnrijaZQNMSFVIQma8gPU96PRMCp9dnLO0iICYpg9wA5Cm8GAwE_FMvhByBmUuiVeAI5mfT7NUJhUvHVz-Z6GMbElIgV23TTK8OVq9U Oct 12 13:21:51.999950 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:21:51.999950 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:21:51.999950 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:21:51.999950 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:21:51.999950 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:21:51.999950 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:21:51.999950 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 4fead338e14f460d85318abd07464f28 Oct 12 13:21:51.999950 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1978285757 Oct 12 13:21:51.999950 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:21:51.999950 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:21:52.001285 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4fead338e14f460d85318abd07464f28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4fead338e14f460d85318abd07464f28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4fead338e14f460d85318abd07464f28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4fead338e14f460d85318abd07464f28"}]}] Oct 12 13:21:52.001285 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1978285757 Oct 12 13:21:52.001285 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 4fead338e14f460d85318abd07464f28 Oct 12 13:21:52.001285 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1978285757 Oct 12 13:21:52.001285 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-HostsAdminNegativeTestJSON-1978285757-project Oct 12 13:21:52.001285 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:21:52.001285 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:21:52.001285 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: a074e71e742d4950883027949723fa20 Oct 12 13:21:52.001285 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1978285757-project Oct 12 13:21:52.001285 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:21:52.001285 n-d-861076-2 devstack@n-api.service[120932]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 12 13:21:52.001285 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'n-d-861076-2'} Oct 12 13:21:52.001285 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:52.002761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:52.002761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:52.002761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:52.002761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:52.002761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:52.002761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:21:52.002761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:21:52.002761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:52.002761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:52.002761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 12 13:21:52.002761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 12 13:21:52.002761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:21:52.002761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:21:52.002761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:21:52.002761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:21:52.002761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:21:52.002761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:21:52.002761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:21:52.002761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:21:52.004075 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:21:52.004075 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:21:52.004075 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:21:52.004075 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:21:52.004075 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:21:52.004075 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:21:52.004075 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 12 13:21:52.004075 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.004075 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:52.004075 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.004075 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:52.004075 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:52.004075 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:52.004075 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:21:52.004075 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:21:52.004075 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 12 13:21:52.004075 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.007007 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5c52d7b3-5edd-423e-a640-f6cd5573e7fe tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:52.008186 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5c52d7b3-5edd-423e-a640-f6cd5573e7fe tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-d-861076-2/startup" status: 403 len: 110 microversion: 2.1 time: 0.026914 Oct 12 13:21:52.009742 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 40/92] 10.222.0.52 () {58 vars in 1191 bytes} [Wed Oct 12 13:21:51 2022] GET /compute/v2.1/os-hosts/n-d-861076-2/startup => generated 110 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:21:52.050000 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-690cb979-42f5-4859-9286-8de087b877e1 tempest-FlavorsAccessTestJSON-474636403 tempest-FlavorsAccessTestJSON-474636403-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/918418949" status: 202 len: 0 microversion: 2.1 time: 0.143600 Oct 12 13:21:52.051164 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 53/93] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 12 13:21:51 2022] DELETE /compute/v2.1/flavors/918418949 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:21:52.057532 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b14d4c7d-c63c-4f79-8f34-8e42fa667cd7 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:52.105596 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=10,nova_api:DELETE=9 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:21:52.130061 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b14d4c7d-c63c-4f79-8f34-8e42fa667cd7 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.077805 Oct 12 13:21:52.133963 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 54/94] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:52.142287 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-bf4f39e2-a49b-43a2-b1ea-379bfbc7e4da tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:52.149337 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-bf4f39e2-a49b-43a2-b1ea-379bfbc7e4da tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:21:52.164630 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bf4f39e2-a49b-43a2-b1ea-379bfbc7e4da tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:52.170054 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bf4f39e2-a49b-43a2-b1ea-379bfbc7e4da tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:52.171962 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bf4f39e2-a49b-43a2-b1ea-379bfbc7e4da tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:52.178038 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bf4f39e2-a49b-43a2-b1ea-379bfbc7e4da tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:52.178579 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bf4f39e2-a49b-43a2-b1ea-379bfbc7e4da tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:52.179020 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bf4f39e2-a49b-43a2-b1ea-379bfbc7e4da tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:52.228761 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8c5a3335-5f3d-4fe9-a8d7-6c25a15a59b2 tempest-FlavorsAccessNegativeTestJSON-1604402001 tempest-FlavorsAccessNegativeTestJSON-1604402001-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "28c452a91b02417fada142df25ae7cc7"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:52.234027 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8c5a3335-5f3d-4fe9-a8d7-6c25a15a59b2 tempest-FlavorsAccessNegativeTestJSON-1604402001 tempest-FlavorsAccessNegativeTestJSON-1604402001-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '222a437b1cb344fd8a295a601b0b9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c452a91b02417fada142df25ae7cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:21:52.235852 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8c5a3335-5f3d-4fe9-a8d7-6c25a15a59b2 tempest-FlavorsAccessNegativeTestJSON-1604402001 tempest-FlavorsAccessNegativeTestJSON-1604402001-project] Request method failure captured: Oct 12 13:21:52.235852 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/flavors/835272385/action HTTP/1.1 Oct 12 13:21:52.235852 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:21:52.235852 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:21:52.235852 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:21:52.235852 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 67 Oct 12 13:21:52.235852 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:21:52.235852 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:21:52.235852 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:21:52.235852 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:52.235852 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr9kkmALDtyJZVCm7q2mBwlCSH6obE0_3ALxSyWGDprmsJvsEzCSv4TkS0dnJ5omffr3kKlyEd7e3OrzhGbl1--myeUr2YDA_nbbXgg465zsEpJk5ochHx1YrnUGNpmqNhGLmfUuVBetQZP49qB25w2MBRMMur1qPIW72Y6mlTfJ9GQ Oct 12 13:21:52.235852 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:21:52.235852 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:21:52.235852 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:21:52.235852 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:21:52.235852 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:21:52.235852 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:21:52.235852 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 28c452a91b02417fada142df25ae7cc7 Oct 12 13:21:52.235852 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1604402001 Oct 12 13:21:52.235852 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:21:52.235852 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:21:52.237021 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/28c452a91b02417fada142df25ae7cc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_28c452a91b02417fada142df25ae7cc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28c452a91b02417fada142df25ae7cc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28c452a91b02417fada142df25ae7cc7"}]}] Oct 12 13:21:52.237021 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1604402001 Oct 12 13:21:52.237021 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 28c452a91b02417fada142df25ae7cc7 Oct 12 13:21:52.237021 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1604402001 Oct 12 13:21:52.237021 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-FlavorsAccessNegativeTestJSON-1604402001-project Oct 12 13:21:52.237021 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:21:52.237021 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:21:52.237021 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 222a437b1cb344fd8a295a601b0b9952 Oct 12 13:21:52.237021 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1604402001-project Oct 12 13:21:52.237021 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:21:52.237021 n-d-861076-2 devstack@n-api.service[120932]: {"addTenantAccess": {"tenant": "28c452a91b02417fada142df25ae7cc7"}} Oct 12 13:21:52.237021 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:21:52.237770 n-d-861076-2 devstack@n-api.service[120932]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 12 13:21:52.237770 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '835272385', 'body': {'addTenantAccess': {'tenant': '28c452a91b02417fada142df25ae7cc7'}}} Oct 12 13:21:52.237770 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:52.237770 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:52.237770 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:52.237770 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:52.237770 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:52.237770 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:52.237770 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:52.237770 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:52.237770 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:21:52.237770 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:21:52.237770 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 12 13:21:52.237770 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 12 13:21:52.237770 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:21:52.237770 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:21:52.237770 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:21:52.237770 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:21:52.237770 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:21:52.239226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:21:52.239226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:21:52.239226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:21:52.239226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:21:52.239226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:21:52.239226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:21:52.239226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:21:52.239226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:21:52.239226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:21:52.239226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 12 13:21:52.239226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.239226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:52.239226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.239226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:52.239226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:52.239226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:52.239226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:21:52.239226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:21:52.239226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 12 13:21:52.239226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.240236 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8c5a3335-5f3d-4fe9-a8d7-6c25a15a59b2 tempest-FlavorsAccessNegativeTestJSON-1604402001 tempest-FlavorsAccessNegativeTestJSON-1604402001-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:52.240236 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8c5a3335-5f3d-4fe9-a8d7-6c25a15a59b2 tempest-FlavorsAccessNegativeTestJSON-1604402001 tempest-FlavorsAccessNegativeTestJSON-1604402001-project] 10.222.0.52 "POST /compute/v2.1/flavors/835272385/action" status: 403 len: 130 microversion: 2.1 time: 0.226268 Oct 12 13:21:52.248730 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 41/95] 10.222.0.52 () {60 vars in 1197 bytes} [Wed Oct 12 13:21:52 2022] POST /compute/v2.1/flavors/835272385/action => generated 130 bytes in 238 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:21:52.264383 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-91348d91-ff65-48cf-a2e9-f2f0677cc0a1 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Calling method '.version_select at 0x7f8aa076fc10>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:52.285719 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-91348d91-ff65-48cf-a2e9-f2f0677cc0a1 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:52.287875 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-91348d91-ff65-48cf-a2e9-f2f0677cc0a1 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Request method failure captured: Oct 12 13:21:52.287875 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 12 13:21:52.287875 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:21:52.287875 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:21:52.287875 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:21:52.287875 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:21:52.287875 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:21:52.287875 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:21:52.287875 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:21:52.287875 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:52.287875 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr9s7T7d-F40YAn1umWVdTSp_aq4dJryZOHMqK9J6Zlo0vFqP8Ul0hFvW1626FNALghi0atvzi9p3PuYODHgW-1tAFri8B0WqzW4KV_lCshnIaUUSJkq_wU7OpNFOr1-bRp_OQ19pQE6BlG12Gwc5PFDjQSqlEM9m7vjQ91EzTKShOA Oct 12 13:21:52.287875 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:21:52.287875 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:21:52.287875 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:21:52.287875 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:21:52.287875 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:21:52.287875 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:21:52.287875 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: f0f9edee0d924a34a1d470a046c82d9f Oct 12 13:21:52.287875 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:52.287875 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,admin,reader Oct 12 13:21:52.287875 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,admin,reader Oct 12 13:21:52.291767 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f0f9edee0d924a34a1d470a046c82d9f"}]}] Oct 12 13:21:52.291767 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:52.291767 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: f0f9edee0d924a34a1d470a046c82d9f Oct 12 13:21:52.291767 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:52.291767 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-HostsAdminNegativeTestJSON-1090889828-project-admin Oct 12 13:21:52.291767 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:21:52.291767 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:21:52.291767 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 226d831c08134a1a9c23ce467c2369ae Oct 12 13:21:52.291767 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1090889828-project-admin Oct 12 13:21:52.291767 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:21:52.291767 n-d-861076-2 devstack@n-api.service[120932]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:52.291767 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'nonexistent_hostname'} Oct 12 13:21:52.291767 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:52.292618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:52.292618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 12 13:21:52.292618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 12 13:21:52.292618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 13:21:52.292618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 13:21:52.292618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:21:52.292618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:21:52.292618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:21:52.292618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:21:52.292618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 13:21:52.292618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 13:21:52.292618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 12 13:21:52.292618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 12 13:21:52.292618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:21:52.292618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:21:52.292618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 13:21:52.292618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 13:21:52.292618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:21:52.292618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:21:52.293745 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 13:21:52.293745 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 13:21:52.293745 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:52.293745 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.293745 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:52.293745 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.293745 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:52.293745 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:52.293745 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:52.293745 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:52.293745 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:52.293745 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:21:52.293745 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:21:52.293745 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:52.293745 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:52.293745 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 12 13:21:52.293745 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 12 13:21:52.293745 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 12 13:21:52.293745 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:21:52.295749 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:52.295749 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.295749 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:52.295749 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.295749 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:52.295749 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:52.295749 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:52.295749 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:21:52.295749 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:21:52.295749 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:52.295749 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.295749 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-91348d91-ff65-48cf-a2e9-f2f0677cc0a1 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:52.295749 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-91348d91-ff65-48cf-a2e9-f2f0677cc0a1 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.039784 Oct 12 13:21:52.295749 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 42/96] 10.222.0.52 () {58 vars in 1215 bytes} [Wed Oct 12 13:21:52 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:21:52.297081 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-72cc6061-c0bb-4d58-a9e5-badcfb25cb5e tempest-FlavorsAccessTestJSON-474636403 tempest-FlavorsAccessTestJSON-474636403-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:52.320061 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-72cc6061-c0bb-4d58-a9e5-badcfb25cb5e tempest-FlavorsAccessTestJSON-474636403 tempest-FlavorsAccessTestJSON-474636403-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027886 Oct 12 13:21:52.323922 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 43/97] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:52.326262 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1a799a18-f41e-4341-918a-be1f4e9da66f tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-800914357", "id": 965405134, "os-flavor-access:is_public": "True"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:52.408068 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1a799a18-f41e-4341-918a-be1f4e9da66f tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.085369 Oct 12 13:21:52.411138 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 44/98] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:21:52 2022] POST /compute/v2.1/flavors => generated 425 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:52.433548 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7aa57679-7a7b-4cce-934f-a0f146918a8e tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:52.545805 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-bf4f39e2-a49b-43a2-b1ea-379bfbc7e4da tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbfb915900c442c0999a39440a8228fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a760f270b741faa8363f5142561aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:21:52.555339 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-bf4f39e2-a49b-43a2-b1ea-379bfbc7e4da tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1338 microversion: 2.1 time: 0.418861 Oct 12 13:21:52.563428 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7aa57679-7a7b-4cce-934f-a0f146918a8e tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/835272385" status: 202 len: 0 microversion: 2.1 time: 0.150995 Oct 12 13:21:52.564279 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 45/99] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 12 13:21:52 2022] DELETE /compute/v2.1/flavors/835272385 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:21:52.572541 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 55/100] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:21:52 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1338 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:52.579293 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3c933b93-1c9f-4ff8-8278-f075894378d7 tempest-FlavorsAccessTestJSON-474636403 tempest-FlavorsAccessTestJSON-474636403-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-459079429", "id": 881326577, "os-flavor-access:is_public": "False"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:52.586572 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b60e5370-1fc6-4e77-886f-8a4a20034124 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Action: 'update', calling method: .version_select at 0x7f8aa068aca0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:52.600347 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b60e5370-1fc6-4e77-886f-8a4a20034124 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Request method failure captured: Oct 12 13:21:52.600347 n-d-861076-2 devstack@n-api.service[120932]: request: PUT /compute/v2.1/os-hosts/n-d-861076-2 HTTP/1.1 Oct 12 13:21:52.600347 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:21:52.600347 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:21:52.600347 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:21:52.600347 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 51 Oct 12 13:21:52.600347 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:21:52.600347 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:21:52.600347 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:21:52.600347 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:52.600347 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr9s7T7d-F40YAn1umWVdTSp_aq4dJryZOHMqK9J6Zlo0vFqP8Ul0hFvW1626FNALghi0atvzi9p3PuYODHgW-1tAFri8B0WqzW4KV_lCshnIaUUSJkq_wU7OpNFOr1-bRp_OQ19pQE6BlG12Gwc5PFDjQSqlEM9m7vjQ91EzTKShOA Oct 12 13:21:52.600347 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:21:52.600347 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:21:52.600347 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:21:52.600347 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:21:52.600347 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:21:52.600347 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:21:52.600347 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: f0f9edee0d924a34a1d470a046c82d9f Oct 12 13:21:52.600347 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:52.600347 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,admin,reader Oct 12 13:21:52.600347 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,admin,reader Oct 12 13:21:52.601663 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f0f9edee0d924a34a1d470a046c82d9f"}]}] Oct 12 13:21:52.601663 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:52.601663 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: f0f9edee0d924a34a1d470a046c82d9f Oct 12 13:21:52.601663 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:52.601663 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-HostsAdminNegativeTestJSON-1090889828-project-admin Oct 12 13:21:52.601663 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:21:52.601663 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:21:52.601663 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 226d831c08134a1a9c23ce467c2369ae Oct 12 13:21:52.601663 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1090889828-project-admin Oct 12 13:21:52.601663 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:21:52.601663 n-d-861076-2 devstack@n-api.service[120932]: {"status": "enable", "maintenance_mode": "invalid"} Oct 12 13:21:52.601663 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:21:52.601663 n-d-861076-2 devstack@n-api.service[120932]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'n-d-861076-2', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise error Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi 'disable', Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi 'Enable', Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi 'Disable', Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi On instance: Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi 'invalid' Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:52.603325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:52.606034 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:52.606034 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:52.606034 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:52.606034 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:21:52.606034 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:21:52.606034 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:52.606034 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:52.606034 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 13:21:52.606034 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 13:21:52.606034 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 13:21:52.606034 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 13:21:52.606034 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 13:21:52.606034 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 13:21:52.606034 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 13:21:52.606034 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.606034 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:52.606034 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.606034 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:52.606034 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:52.607378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:52.607378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 13:21:52.607378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 13:21:52.607378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 13:21:52.607378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.607378 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b60e5370-1fc6-4e77-886f-8a4a20034124 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:52.607378 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b60e5370-1fc6-4e77-886f-8a4a20034124 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/n-d-861076-2" status: 400 len: 199 microversion: 2.1 time: 0.040269 Oct 12 13:21:52.619489 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 46/101] 10.222.0.52 () {60 vars in 1187 bytes} [Wed Oct 12 13:21:52 2022] PUT /compute/v2.1/os-hosts/n-d-861076-2 => generated 199 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:21:52.630544 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-359bac43-bf23-4065-bd7d-341762902a56 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:52.657968 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3c933b93-1c9f-4ff8-8278-f075894378d7 tempest-FlavorsAccessTestJSON-474636403 tempest-FlavorsAccessTestJSON-474636403-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.083167 Oct 12 13:21:52.661822 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 56/102] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:21:52 2022] POST /compute/v2.1/flavors => generated 427 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:52.675568 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5c896007-bef1-4131-8727-664772f0999b tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:52.718331 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5c896007-bef1-4131-8727-664772f0999b tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.053876 Oct 12 13:21:52.722619 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 57/103] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:52 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:52.729708 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-359bac43-bf23-4065-bd7d-341762902a56 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/965405134" status: 202 len: 0 microversion: 2.1 time: 0.108917 Oct 12 13:21:52.730285 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 47/104] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 12 13:21:52 2022] DELETE /compute/v2.1/flavors/965405134 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:21:52.735270 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6404632b-6c2b-45a7-907d-cecd1d9a2456 tempest-FlavorsAccessTestJSON-474636403 tempest-FlavorsAccessTestJSON-474636403-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:52.747619 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e7fe66ed-e24f-4f0a-bc22-d3264264dbfc tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Action: 'update', calling method: .version_select at 0x7f8aa07e6310>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:52.762482 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e7fe66ed-e24f-4f0a-bc22-d3264264dbfc tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Request method failure captured: Oct 12 13:21:52.762482 n-d-861076-2 devstack@n-api.service[120933]: request: PUT /compute/v2.1/os-hosts/n-d-861076-2 HTTP/1.1 Oct 12 13:21:52.762482 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:21:52.762482 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:21:52.762482 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:21:52.762482 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 51 Oct 12 13:21:52.762482 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:21:52.762482 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:21:52.762482 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:21:52.762482 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:52.762482 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9s7T7d-F40YAn1umWVdTSp_aq4dJryZOHMqK9J6Zlo0vFqP8Ul0hFvW1626FNALghi0atvzi9p3PuYODHgW-1tAFri8B0WqzW4KV_lCshnIaUUSJkq_wU7OpNFOr1-bRp_OQ19pQE6BlG12Gwc5PFDjQSqlEM9m7vjQ91EzTKShOA Oct 12 13:21:52.762482 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:21:52.762482 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:21:52.762482 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:21:52.762482 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:21:52.762482 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:21:52.762482 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:21:52.762482 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: f0f9edee0d924a34a1d470a046c82d9f Oct 12 13:21:52.762482 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:52.762482 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:21:52.762482 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:21:52.763833 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f0f9edee0d924a34a1d470a046c82d9f"}]}] Oct 12 13:21:52.763833 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:52.763833 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: f0f9edee0d924a34a1d470a046c82d9f Oct 12 13:21:52.763833 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:52.763833 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-HostsAdminNegativeTestJSON-1090889828-project-admin Oct 12 13:21:52.763833 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:21:52.763833 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:21:52.763833 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 226d831c08134a1a9c23ce467c2369ae Oct 12 13:21:52.763833 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1090889828-project-admin Oct 12 13:21:52.763833 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:21:52.763833 n-d-861076-2 devstack@n-api.service[120933]: {"status": "invalid", "maintenance_mode": "enable"} Oct 12 13:21:52.763833 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:21:52.763833 n-d-861076-2 devstack@n-api.service[120933]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'n-d-861076-2', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise error Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'disable', Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'Enable', Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'Disable', Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi On instance: Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'invalid' Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:52.764670 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:52.766167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:52.766167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:52.766167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:52.766167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:21:52.766167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:21:52.766167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:52.766167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:52.766167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 13:21:52.766167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 13:21:52.766167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 13:21:52.766167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 13:21:52.766167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 13:21:52.766167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 13:21:52.766167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 13:21:52.766167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.766167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:52.766167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.766167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:52.766167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:52.767313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:52.767313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 13:21:52.767313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 13:21:52.767313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 13:21:52.767313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.784502 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:DELETE=19,nova_api:UPDATE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:21:52.789124 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e7fe66ed-e24f-4f0a-bc22-d3264264dbfc tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:52.796213 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e7fe66ed-e24f-4f0a-bc22-d3264264dbfc tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/n-d-861076-2" status: 400 len: 189 microversion: 2.1 time: 0.071110 Oct 12 13:21:52.800212 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 58/105] 10.222.0.52 () {60 vars in 1187 bytes} [Wed Oct 12 13:21:52 2022] PUT /compute/v2.1/os-hosts/n-d-861076-2 => generated 189 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:21:52.813272 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6404632b-6c2b-45a7-907d-cecd1d9a2456 tempest-FlavorsAccessTestJSON-474636403 tempest-FlavorsAccessTestJSON-474636403-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/881326577/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.077237 Oct 12 13:21:52.820226 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 48/106] 10.222.0.52 () {58 vars in 1206 bytes} [Wed Oct 12 13:21:52 2022] GET /compute/v2.1/flavors/881326577/os-flavor-access => generated 21 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:21:52.831426 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0e6800a9-7cfe-449b-a98d-6ee178dcb8e8 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:52.848553 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6023b989-14e4-4f40-ae66-9d536a134882 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-370022599", "id": 1681260725, "os-flavor-access:is_public": "False"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:52.895914 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0e6800a9-7cfe-449b-a98d-6ee178dcb8e8 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.093918 Oct 12 13:21:52.920752 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 59/107] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:52.929366 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d58b71a6-bc73-41b7-adf4-aee213878680 tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Action: 'update', calling method: .version_select at 0x7f8aa07b6f70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:52.933204 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d58b71a6-bc73-41b7-adf4-aee213878680 tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'a074e71e742d4950883027949723fa20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fead338e14f460d85318abd07464f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:21:52.934829 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d58b71a6-bc73-41b7-adf4-aee213878680 tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Request method failure captured: Oct 12 13:21:52.934829 n-d-861076-2 devstack@n-api.service[120933]: request: PUT /compute/v2.1/os-hosts/n-d-861076-2 HTTP/1.1 Oct 12 13:21:52.934829 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:21:52.934829 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:21:52.934829 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:21:52.934829 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 50 Oct 12 13:21:52.934829 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:21:52.934829 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:21:52.934829 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:21:52.934829 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:52.934829 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9pezbQhzVoxMxdhT00Qlsfi8_dBjPf8jvO4N1f1HWWJDHJMSCnCXPWRaBSHq2HUHuTPQ7tvnrijaZQNMSFVIQma8gPU96PRMCp9dnLO0iICYpg9wA5Cm8GAwE_FMvhByBmUuiVeAI5mfT7NUJhUvHVz-Z6GMbElIgV23TTK8OVq9U Oct 12 13:21:52.934829 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:21:52.934829 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:21:52.934829 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:21:52.934829 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:21:52.934829 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:21:52.934829 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:21:52.934829 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 4fead338e14f460d85318abd07464f28 Oct 12 13:21:52.934829 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1978285757 Oct 12 13:21:52.934829 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:21:52.934829 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:21:52.936559 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4fead338e14f460d85318abd07464f28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4fead338e14f460d85318abd07464f28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4fead338e14f460d85318abd07464f28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4fead338e14f460d85318abd07464f28"}]}] Oct 12 13:21:52.936559 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1978285757 Oct 12 13:21:52.936559 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 4fead338e14f460d85318abd07464f28 Oct 12 13:21:52.936559 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1978285757 Oct 12 13:21:52.936559 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-HostsAdminNegativeTestJSON-1978285757-project Oct 12 13:21:52.936559 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:21:52.936559 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:21:52.936559 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: a074e71e742d4950883027949723fa20 Oct 12 13:21:52.936559 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1978285757-project Oct 12 13:21:52.936559 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:21:52.936559 n-d-861076-2 devstack@n-api.service[120933]: {"status": "enable", "maintenance_mode": "enable"} Oct 12 13:21:52.936559 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:21:52.936559 n-d-861076-2 devstack@n-api.service[120933]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 12 13:21:52.936559 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'n-d-861076-2', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 12 13:21:52.938723 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:52.938723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:52.938723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:52.938723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:52.938723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:52.938723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:52.938723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:21:52.938723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:21:52.938723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:52.938723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:52.938723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:21:52.938723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:21:52.938723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 12 13:21:52.938723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 12 13:21:52.938723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:21:52.938723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:21:52.938723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:21:52.938723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:21:52.938723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:21:52.938723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:21:52.940376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:21:52.940376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:21:52.940376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:21:52.940376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:21:52.940376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:21:52.940376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:21:52.940376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:21:52.940376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:21:52.940376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 12 13:21:52.940376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.940376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:52.940376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.940376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:52.940376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:52.940376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:52.940376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:21:52.940376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:21:52.940376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 12 13:21:52.940376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:52.945130 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d58b71a6-bc73-41b7-adf4-aee213878680 tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:52.945130 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d58b71a6-bc73-41b7-adf4-aee213878680 tempest-HostsAdminNegativeTestJSON-1978285757 tempest-HostsAdminNegativeTestJSON-1978285757-project] 10.222.0.52 "PUT /compute/v2.1/os-hosts/n-d-861076-2" status: 403 len: 111 microversion: 2.1 time: 0.015687 Oct 12 13:21:52.952317 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 60/108] 10.222.0.52 () {60 vars in 1187 bytes} [Wed Oct 12 13:21:52 2022] PUT /compute/v2.1/os-hosts/n-d-861076-2 => generated 111 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:21:52.963404 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fd5a929b-f346-43ba-a11c-8ca1c7c70375 tempest-FlavorsAccessTestJSON-474636403 tempest-FlavorsAccessTestJSON-474636403-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:52.970937 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6023b989-14e4-4f40-ae66-9d536a134882 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.143893 Oct 12 13:21:52.979497 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 49/109] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:21:52 2022] POST /compute/v2.1/flavors => generated 438 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:52.989402 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1fa1e854-5d93-4dc5-95cf-562e4e2e62a3 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-270832893", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:53.078618 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fd5a929b-f346-43ba-a11c-8ca1c7c70375 tempest-FlavorsAccessTestJSON-474636403 tempest-FlavorsAccessTestJSON-474636403-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/881326577" status: 202 len: 0 microversion: 2.1 time: 0.124929 Oct 12 13:21:53.079811 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 61/110] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 12 13:21:52 2022] DELETE /compute/v2.1/flavors/881326577 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:21:53.085376 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1fa1e854-5d93-4dc5-95cf-562e4e2e62a3 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.104453 Oct 12 13:21:53.085546 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a3cb52b8-d403-442c-b873-fac08a2e7a29 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Action: 'update', calling method: .version_select at 0x7f8aa07e64c0>, body: {"status": null, "maintenance_mode": null} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:53.086652 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 50/111] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:21:52 2022] POST /compute/v2.1/flavors => generated 506 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:53.096651 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7406b13a-42d3-4f54-b480-7eb79dc9c4e6 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "28c452a91b02417fada142df25ae7cc7"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:53.097513 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a3cb52b8-d403-442c-b873-fac08a2e7a29 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Request method failure captured: Oct 12 13:21:53.097513 n-d-861076-2 devstack@n-api.service[120933]: request: PUT /compute/v2.1/os-hosts/n-d-861076-2 HTTP/1.1 Oct 12 13:21:53.097513 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:21:53.097513 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:21:53.097513 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:21:53.097513 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 42 Oct 12 13:21:53.097513 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:21:53.097513 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:21:53.097513 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:21:53.097513 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:53.097513 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9s7T7d-F40YAn1umWVdTSp_aq4dJryZOHMqK9J6Zlo0vFqP8Ul0hFvW1626FNALghi0atvzi9p3PuYODHgW-1tAFri8B0WqzW4KV_lCshnIaUUSJkq_wU7OpNFOr1-bRp_OQ19pQE6BlG12Gwc5PFDjQSqlEM9m7vjQ91EzTKShOA Oct 12 13:21:53.097513 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:21:53.097513 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:21:53.097513 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:21:53.097513 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:21:53.097513 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:21:53.097513 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:21:53.097513 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: f0f9edee0d924a34a1d470a046c82d9f Oct 12 13:21:53.097513 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:53.097513 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:21:53.097513 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:21:53.098601 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f0f9edee0d924a34a1d470a046c82d9f"}]}] Oct 12 13:21:53.098601 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:53.098601 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: f0f9edee0d924a34a1d470a046c82d9f Oct 12 13:21:53.098601 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:53.098601 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-HostsAdminNegativeTestJSON-1090889828-project-admin Oct 12 13:21:53.098601 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:21:53.098601 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:21:53.098601 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 226d831c08134a1a9c23ce467c2369ae Oct 12 13:21:53.098601 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1090889828-project-admin Oct 12 13:21:53.098601 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:21:53.098601 n-d-861076-2 devstack@n-api.service[120933]: {"status": null, "maintenance_mode": null} Oct 12 13:21:53.098601 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:21:53.098601 n-d-861076-2 devstack@n-api.service[120933]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 12 13:21:53.098601 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'n-d-861076-2', 'body': {'status': None, 'maintenance_mode': None}} Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise error Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'disable', Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'Enable', Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'Disable', Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi On instance: Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi None Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:53.099391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:53.101048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:53.101048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:53.101048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:21:53.101048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:21:53.101048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:53.101048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:53.101048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 13:21:53.101048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 13:21:53.101048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 13:21:53.101048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 13:21:53.101048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 13:21:53.101048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 13:21:53.101048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 12 13:21:53.101048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:53.101048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:53.101048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:53.101048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:53.101048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:53.101048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:53.102110 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 13:21:53.102110 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 13:21:53.102110 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 12 13:21:53.102110 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:53.104051 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a3cb52b8-d403-442c-b873-fac08a2e7a29 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:53.105371 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a3cb52b8-d403-442c-b873-fac08a2e7a29 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/n-d-861076-2" status: 400 len: 127 microversion: 2.1 time: 0.024338 Oct 12 13:21:53.106473 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 62/112] 10.222.0.52 () {60 vars in 1187 bytes} [Wed Oct 12 13:21:53 2022] PUT /compute/v2.1/os-hosts/n-d-861076-2 => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:21:53.111097 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a4ba9f6b-e1d7-4850-8a2f-c75474b22aec tempest-FlavorsAccessTestJSON-474636403 tempest-FlavorsAccessTestJSON-474636403-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:53.140593 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a4ba9f6b-e1d7-4850-8a2f-c75474b22aec tempest-FlavorsAccessTestJSON-474636403 tempest-FlavorsAccessTestJSON-474636403-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5487 microversion: 2.1 time: 0.032774 Oct 12 13:21:53.142653 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 63/113] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:53 2022] GET /compute/v2.1/flavors/detail => generated 5487 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:53.164549 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b14bb747-436b-46d9-b22d-455ead6a4f07 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:53.278614 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b14bb747-436b-46d9-b22d-455ead6a4f07 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/c33cc87f-c836-45ae-95c5-cce30ec6b27f" status: 202 len: 0 microversion: 2.1 time: 0.136311 Oct 12 13:21:53.279539 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 64/114] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:21:53 2022] DELETE /compute/v2.1/flavors/c33cc87f-c836-45ae-95c5-cce30ec6b27f => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:21:53.289056 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-df4325a2-f51f-48d4-94cb-4440b2347529 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Action: 'update', calling method: .version_select at 0x7f8aa0763dc0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:53.293058 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.hosts [None req-df4325a2-f51f-48d4-94cb-4440b2347529 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Enabling host nonexistent_hostname. Oct 12 13:21:53.303080 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-df4325a2-f51f-48d4-94cb-4440b2347529 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:53.306004 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-df4325a2-f51f-48d4-94cb-4440b2347529 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Request method failure captured: Oct 12 13:21:53.306004 n-d-861076-2 devstack@n-api.service[120933]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 12 13:21:53.306004 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:21:53.306004 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:21:53.306004 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:21:53.306004 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 50 Oct 12 13:21:53.306004 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:21:53.306004 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:21:53.306004 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:21:53.306004 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:53.306004 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9s7T7d-F40YAn1umWVdTSp_aq4dJryZOHMqK9J6Zlo0vFqP8Ul0hFvW1626FNALghi0atvzi9p3PuYODHgW-1tAFri8B0WqzW4KV_lCshnIaUUSJkq_wU7OpNFOr1-bRp_OQ19pQE6BlG12Gwc5PFDjQSqlEM9m7vjQ91EzTKShOA Oct 12 13:21:53.306004 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:21:53.306004 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:21:53.306004 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:21:53.306004 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:21:53.306004 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:21:53.306004 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:21:53.306004 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: f0f9edee0d924a34a1d470a046c82d9f Oct 12 13:21:53.306004 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:53.306004 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:21:53.306004 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:21:53.307510 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f0f9edee0d924a34a1d470a046c82d9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f0f9edee0d924a34a1d470a046c82d9f"}]}] Oct 12 13:21:53.307510 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:53.307510 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: f0f9edee0d924a34a1d470a046c82d9f Oct 12 13:21:53.307510 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1090889828 Oct 12 13:21:53.307510 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-HostsAdminNegativeTestJSON-1090889828-project-admin Oct 12 13:21:53.307510 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:21:53.307510 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:21:53.307510 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 226d831c08134a1a9c23ce467c2369ae Oct 12 13:21:53.307510 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1090889828-project-admin Oct 12 13:21:53.307510 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:21:53.307510 n-d-861076-2 devstack@n-api.service[120933]: {"status": "enable", "maintenance_mode": "enable"} Oct 12 13:21:53.307510 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:21:53.307510 n-d-861076-2 devstack@n-api.service[120933]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:53.307510 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 12 13:21:53.308462 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:53.308462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:53.308462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 12 13:21:53.308462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 12 13:21:53.308462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 13:21:53.308462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 13:21:53.308462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:21:53.308462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:21:53.308462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:21:53.308462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:21:53.308462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 13:21:53.308462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 13:21:53.308462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 12 13:21:53.308462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 12 13:21:53.308462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:21:53.308462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:21:53.308462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 13:21:53.308462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 13:21:53.309762 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:21:53.309762 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:21:53.309762 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 13:21:53.309762 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 13:21:53.309762 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:53.309762 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:53.309762 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:53.309762 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:53.309762 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:53.309762 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:53.309762 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:53.309762 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:53.309762 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:53.309762 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:21:53.309762 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:21:53.309762 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:53.309762 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:53.309762 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:21:53.309762 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:21:53.309762 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 12 13:21:53.311898 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 12 13:21:53.311898 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 12 13:21:53.311898 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:21:53.311898 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:53.311898 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:53.311898 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:53.311898 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:53.311898 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:53.311898 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:53.311898 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:53.311898 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:21:53.311898 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:21:53.311898 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 13:21:53.311898 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:53.317932 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-df4325a2-f51f-48d4-94cb-4440b2347529 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:53.317932 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-df4325a2-f51f-48d4-94cb-4440b2347529 tempest-HostsAdminNegativeTestJSON-1090889828 tempest-HostsAdminNegativeTestJSON-1090889828-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.032000 Oct 12 13:21:53.317932 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 65/115] 10.222.0.52 () {60 vars in 1211 bytes} [Wed Oct 12 13:21:53 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:21:53.331299 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ad555273-ce45-4f8a-b865-696ad5076caa tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:53.369966 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ad555273-ce45-4f8a-b865-696ad5076caa tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046743 Oct 12 13:21:53.392562 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 66/116] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:53.409697 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c74367d5-63e0-424e-ad51-1ed423b1f168 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1421894805", "id": "39f1c86f-c23f-462a-9c29-d9cab8af4a48", "os-flavor-access:is_public": "True"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:53.545128 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c74367d5-63e0-424e-ad51-1ed423b1f168 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.144850 Oct 12 13:21:53.545128 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 67/117] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:21:53 2022] POST /compute/v2.1/flavors => generated 507 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:53.566443 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c1924710-50f3-4a72-a170-2a65c091b0e6 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:53.609504 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7406b13a-42d3-4f54-b480-7eb79dc9c4e6 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1681260725/action" status: 200 len: 97 microversion: 2.1 time: 0.521465 Oct 12 13:21:53.616519 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 51/118] 10.222.0.52 () {60 vars in 1200 bytes} [Wed Oct 12 13:21:53 2022] POST /compute/v2.1/flavors/1681260725/action => generated 97 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:21:53.624067 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6d2d19f9-663c-4469-87d8-7d6f3d19300c tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:53.628268 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6d2d19f9-663c-4469-87d8-7d6f3d19300c tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:21:53.638444 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6d2d19f9-663c-4469-87d8-7d6f3d19300c tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:53.639219 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6d2d19f9-663c-4469-87d8-7d6f3d19300c tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:53.639764 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6d2d19f9-663c-4469-87d8-7d6f3d19300c tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:53.640671 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6d2d19f9-663c-4469-87d8-7d6f3d19300c tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:53.641278 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6d2d19f9-663c-4469-87d8-7d6f3d19300c tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:53.641800 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6d2d19f9-663c-4469-87d8-7d6f3d19300c tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:53.693309 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c1924710-50f3-4a72-a170-2a65c091b0e6 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/39f1c86f-c23f-462a-9c29-d9cab8af4a48" status: 202 len: 0 microversion: 2.1 time: 0.138307 Oct 12 13:21:53.693897 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 68/119] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:21:53 2022] DELETE /compute/v2.1/flavors/39f1c86f-c23f-462a-9c29-d9cab8af4a48 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:21:53.701750 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cb4fce79-cc85-4203-84d3-8b4bfa39c9b1 tempest-FlavorsAccessNegativeTestJSON-1604402001 tempest-FlavorsAccessNegativeTestJSON-1604402001-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "28c452a91b02417fada142df25ae7cc7"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:53.724258 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-cb4fce79-cc85-4203-84d3-8b4bfa39c9b1 tempest-FlavorsAccessNegativeTestJSON-1604402001 tempest-FlavorsAccessNegativeTestJSON-1604402001-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '222a437b1cb344fd8a295a601b0b9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c452a91b02417fada142df25ae7cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:21:53.733446 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cb4fce79-cc85-4203-84d3-8b4bfa39c9b1 tempest-FlavorsAccessNegativeTestJSON-1604402001 tempest-FlavorsAccessNegativeTestJSON-1604402001-project] Request method failure captured: Oct 12 13:21:53.733446 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/flavors/1681260725/action HTTP/1.1 Oct 12 13:21:53.733446 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:21:53.733446 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:21:53.733446 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:21:53.733446 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 70 Oct 12 13:21:53.733446 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:21:53.733446 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:21:53.733446 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:21:53.733446 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:53.733446 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9kkmALDtyJZVCm7q2mBwlCSH6obE0_3ALxSyWGDprmsJvsEzCSv4TkS0dnJ5omffr3kKlyEd7e3OrzhGbl1--myeUr2YDA_nbbXgg465zsEpJk5ochHx1YrnUGNpmqNhGLmfUuVBetQZP49qB25w2MBRMMur1qPIW72Y6mlTfJ9GQ Oct 12 13:21:53.733446 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:21:53.733446 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:21:53.733446 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:21:53.733446 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:21:53.733446 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:21:53.733446 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:21:53.733446 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 28c452a91b02417fada142df25ae7cc7 Oct 12 13:21:53.733446 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1604402001 Oct 12 13:21:53.733446 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:21:53.733446 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:21:53.734594 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/28c452a91b02417fada142df25ae7cc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_28c452a91b02417fada142df25ae7cc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28c452a91b02417fada142df25ae7cc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28c452a91b02417fada142df25ae7cc7"}]}] Oct 12 13:21:53.734594 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1604402001 Oct 12 13:21:53.734594 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 28c452a91b02417fada142df25ae7cc7 Oct 12 13:21:53.734594 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1604402001 Oct 12 13:21:53.734594 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-FlavorsAccessNegativeTestJSON-1604402001-project Oct 12 13:21:53.734594 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:21:53.734594 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:21:53.734594 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 222a437b1cb344fd8a295a601b0b9952 Oct 12 13:21:53.734594 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1604402001-project Oct 12 13:21:53.734594 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:21:53.734594 n-d-861076-2 devstack@n-api.service[120933]: {"removeTenantAccess": {"tenant": "28c452a91b02417fada142df25ae7cc7"}} Oct 12 13:21:53.734594 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:21:53.735273 n-d-861076-2 devstack@n-api.service[120933]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 12 13:21:53.735273 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '1681260725', 'body': {'removeTenantAccess': {'tenant': '28c452a91b02417fada142df25ae7cc7'}}} Oct 12 13:21:53.735273 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:53.735273 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:53.735273 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:53.735273 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:53.735273 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:53.735273 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:53.735273 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:53.735273 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:53.735273 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:21:53.735273 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:21:53.735273 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 12 13:21:53.735273 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi context.can( Oct 12 13:21:53.735273 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:21:53.735273 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:21:53.735273 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:21:53.735273 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:21:53.735273 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:21:53.735273 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:21:53.736313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:21:53.736313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:21:53.736313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:21:53.736313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:21:53.736313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:21:53.736313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:21:53.736313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:21:53.736313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:21:53.736313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 12 13:21:53.736313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:53.736313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:53.736313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:53.736313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:53.736313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:53.736313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:53.736313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:21:53.736313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:21:53.736313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 12 13:21:53.736313 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:53.737315 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cb4fce79-cc85-4203-84d3-8b4bfa39c9b1 tempest-FlavorsAccessNegativeTestJSON-1604402001 tempest-FlavorsAccessNegativeTestJSON-1604402001-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:53.737315 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-cb4fce79-cc85-4203-84d3-8b4bfa39c9b1 tempest-FlavorsAccessNegativeTestJSON-1604402001 tempest-FlavorsAccessNegativeTestJSON-1604402001-project] 10.222.0.52 "POST /compute/v2.1/flavors/1681260725/action" status: 403 len: 133 microversion: 2.1 time: 0.039308 Oct 12 13:21:53.744268 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 69/120] 10.222.0.52 () {60 vars in 1200 bytes} [Wed Oct 12 13:21:53 2022] POST /compute/v2.1/flavors/1681260725/action => generated 133 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:21:53.759380 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-168a50e9-2303-4a02-a84e-e2c5da625dbf tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:53.820120 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-168a50e9-2303-4a02-a84e-e2c5da625dbf tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.074620 Oct 12 13:21:53.822608 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 70/121] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:53.827977 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-de1b349a-0e45-48b5-8fdc-d7efe78a39e2 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "28c452a91b02417fada142df25ae7cc7"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:54.383769 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-6d2d19f9-663c-4469-87d8-7d6f3d19300c tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbfb915900c442c0999a39440a8228fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a760f270b741faa8363f5142561aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:21:54.425157 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6d2d19f9-663c-4469-87d8-7d6f3d19300c tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1338 microversion: 2.1 time: 0.807186 Oct 12 13:21:54.428811 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 52/122] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:21:53 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1338 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:54.445921 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-17bcbfc7-1a82-4fb7-8eea-6ed8bef3c754 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1336316690", "id": 572306440, "os-flavor-access:is_public": "True"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:54.587927 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-17bcbfc7-1a82-4fb7-8eea-6ed8bef3c754 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.157436 Oct 12 13:21:54.595020 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 53/123] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:21:54 2022] POST /compute/v2.1/flavors => generated 411 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:54.602347 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-59643e37-d075-4575-b499-b5d6978780b8 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:54.611262 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-59643e37-d075-4575-b499-b5d6978780b8 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/572306440" status: 200 len: 411 microversion: 2.1 time: 0.012743 Oct 12 13:21:54.615014 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 54/124] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 12 13:21:54 2022] GET /compute/v2.1/flavors/572306440 => generated 411 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:54.668956 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=10 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:21:54.731664 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=6 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:21:54.807210 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-de1b349a-0e45-48b5-8fdc-d7efe78a39e2 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1681260725/action" status: 200 len: 21 microversion: 2.1 time: 0.983829 Oct 12 13:21:54.808672 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 71/125] 10.222.0.52 () {60 vars in 1200 bytes} [Wed Oct 12 13:21:53 2022] POST /compute/v2.1/flavors/1681260725/action => generated 21 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:21:54.819714 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c626b281-f9aa-4544-9862-8ae1709e200f tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:54.930240 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c626b281-f9aa-4544-9862-8ae1709e200f tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1681260725" status: 202 len: 0 microversion: 2.1 time: 0.115053 Oct 12 13:21:54.931173 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 72/126] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 12 13:21:54 2022] DELETE /compute/v2.1/flavors/1681260725 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:21:54.947564 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-38bff45f-960c-42a6-9dae-752db0c08137 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:54.985404 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fa29cc1a-84f3-4784-b79d-7c046d8a253c tempest-FlavorsAdminTestJSON-1320742849 tempest-FlavorsAdminTestJSON-1320742849-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:55.023663 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-38bff45f-960c-42a6-9dae-752db0c08137 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.080938 Oct 12 13:21:55.044492 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 73/127] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:54 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:21:55.048644 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fa29cc1a-84f3-4784-b79d-7c046d8a253c tempest-FlavorsAdminTestJSON-1320742849 tempest-FlavorsAdminTestJSON-1320742849-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.414384 Oct 12 13:21:55.057224 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-554fcafc-f08e-4009-8b02-9665928b8d6e tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1107767257", "id": 292079243, "os-flavor-access:is_public": "False"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:55.065185 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 55/128] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:54 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:55.076785 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d8e93f8b-c464-4fcd-b3e6-bcba1170d178 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:55.159746 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-554fcafc-f08e-4009-8b02-9665928b8d6e tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.107418 Oct 12 13:21:55.175077 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 74/129] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:21:55 2022] POST /compute/v2.1/flavors => generated 436 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:55.179790 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d8e93f8b-c464-4fcd-b3e6-bcba1170d178 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/572306440" status: 202 len: 0 microversion: 2.1 time: 0.107413 Oct 12 13:21:55.180514 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 56/130] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 12 13:21:55 2022] DELETE /compute/v2.1/flavors/572306440 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:21:55.181871 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cde1b864-139f-4e1a-8637-cafd0b92633c tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2c143fd7fc634d6396686370c9af7702"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:55.190171 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f6da1dba-7b56-4997-ab61-b4455bd9c81b tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:55.277701 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f6da1dba-7b56-4997-ab61-b4455bd9c81b tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.092766 Oct 12 13:21:55.280700 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 57/131] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:55.301525 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e4c441cd-48ed-4f20-a1a3-3c298ce4aaf7 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-339430946", "id": 2016260804, "os-flavor-access:is_public": "False"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:55.408307 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-cde1b864-139f-4e1a-8637-cafd0b92633c tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] HTTP exception thrown: Flavor access not found for 29 / 2c143fd7fc634d6396686370c9af7702 combination. Oct 12 13:21:55.415184 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cde1b864-139f-4e1a-8637-cafd0b92633c tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Request method failure captured: Oct 12 13:21:55.415184 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/flavors/292079243/action HTTP/1.1 Oct 12 13:21:55.415184 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:21:55.415184 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:21:55.415184 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:21:55.415184 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 70 Oct 12 13:21:55.415184 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:21:55.415184 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:21:55.415184 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:21:55.415184 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:55.415184 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9nXRsV1tExwt4w8v4HKkDSyjSpSaFOfiZL2mps4XkoHIyEUE_LFzp3QqYu7CaGIX4NwCQsGTmLEehVHcz0xpc0Y22PvU5T3fejz7um7_4gzy9K4Ot_SbG3x3GM3d5LiMxvJMaTkeqU9NXEpVLZJhFb0PNxl3YF9vf4rTkW0W0KNmc Oct 12 13:21:55.415184 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:21:55.415184 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:21:55.415184 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:21:55.415184 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:21:55.415184 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:21:55.415184 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:21:55.415184 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 191330f2e54b43cc8804c9bc6e97888f Oct 12 13:21:55.415184 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1438474687 Oct 12 13:21:55.415184 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:21:55.415184 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:21:55.416293 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/191330f2e54b43cc8804c9bc6e97888f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_191330f2e54b43cc8804c9bc6e97888f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/191330f2e54b43cc8804c9bc6e97888f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/191330f2e54b43cc8804c9bc6e97888f"}]}] Oct 12 13:21:55.416293 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1438474687 Oct 12 13:21:55.416293 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 191330f2e54b43cc8804c9bc6e97888f Oct 12 13:21:55.416293 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1438474687 Oct 12 13:21:55.416293 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin Oct 12 13:21:55.416293 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:21:55.416293 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:21:55.416293 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 0afde2761eb14780b45766754b8ea753 Oct 12 13:21:55.416293 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin Oct 12 13:21:55.416293 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:21:55.416293 n-d-861076-2 devstack@n-api.service[120933]: {"removeTenantAccess": {"tenant": "2c143fd7fc634d6396686370c9af7702"}} Oct 12 13:21:55.416293 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:21:55.417136 n-d-861076-2 devstack@n-api.service[120933]: exception: Flavor access not found for 29 / 2c143fd7fc634d6396686370c9af7702 combination. Oct 12 13:21:55.417136 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '292079243', 'body': {'removeTenantAccess': {'tenant': '2c143fd7fc634d6396686370c9af7702'}}} Oct 12 13:21:55.417136 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:55.417136 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:55.417136 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 12 13:21:55.417136 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 12 13:21:55.417136 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 13:21:55.417136 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 13:21:55.417136 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 12 13:21:55.417136 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 12 13:21:55.417136 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 12 13:21:55.417136 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 12 13:21:55.417136 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 12 13:21:55.417136 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 12 13:21:55.417136 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:21:55.417136 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:21:55.417136 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 12 13:21:55.417136 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 12 13:21:55.418204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 29 / 2c143fd7fc634d6396686370c9af7702 combination. Oct 12 13:21:55.418204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:55.418204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:55.418204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:55.418204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:55.418204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:55.418204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:55.418204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:55.418204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:55.418204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:55.418204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:55.418204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:21:55.418204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:21:55.418204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 12 13:21:55.418204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:21:55.418204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 29 / 2c143fd7fc634d6396686370c9af7702 combination. Oct 12 13:21:55.418204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:55.418204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:55.418204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:55.418204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:55.421834 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:55.421834 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:55.421834 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:21:55.421834 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:21:55.421834 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 29 / 2c143fd7fc634d6396686370c9af7702 combination. Oct 12 13:21:55.421834 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:21:55.421834 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cde1b864-139f-4e1a-8637-cafd0b92633c tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Returning 404 to user: Flavor access not found for 29 / 2c143fd7fc634d6396686370c9af7702 combination. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:55.421834 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-cde1b864-139f-4e1a-8637-cafd0b92633c tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/292079243/action" status: 404 len: 124 microversion: 2.1 time: 0.240434 Oct 12 13:21:55.421834 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 75/132] 10.222.0.52 () {60 vars in 1197 bytes} [Wed Oct 12 13:21:55 2022] POST /compute/v2.1/flavors/292079243/action => generated 124 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:21:55.422323 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e4c441cd-48ed-4f20-a1a3-3c298ce4aaf7 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.121893 Oct 12 13:21:55.422323 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 58/133] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:21:55 2022] POST /compute/v2.1/flavors => generated 429 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:55.442227 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-84657991-de71-4a5a-9ee9-acf8e60d97b7 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:55.453683 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-51cecdb8-d74d-4578-8b1d-027fd6747d3f tempest-FlavorsAdminTestJSON-1320742849 tempest-FlavorsAdminTestJSON-1320742849-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "2016260804"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:55.476591 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-51cecdb8-d74d-4578-8b1d-027fd6747d3f tempest-FlavorsAdminTestJSON-1320742849 tempest-FlavorsAdminTestJSON-1320742849-project] HTTP exception thrown: Flavor 2016260804 could not be found. Oct 12 13:21:55.479294 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-51cecdb8-d74d-4578-8b1d-027fd6747d3f tempest-FlavorsAdminTestJSON-1320742849 tempest-FlavorsAdminTestJSON-1320742849-project] Request method failure captured: Oct 12 13:21:55.479294 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:21:55.479294 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:21:55.479294 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:21:55.479294 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:21:55.479294 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 107 Oct 12 13:21:55.479294 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:21:55.479294 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:21:55.479294 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:21:55.479294 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:21:55.479294 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr9qV4gKvLIOUTlXTOMrGgGIdRQGOSuN9M7pbekmF--hYzlUW7GhdBCUbQE0smBvIpSmePEQ3JwajWPhW6b_lS4jTmBqdTzdbGUlBWsb_dGOcLG8pREh0ihZEpb1qZsTVXGZZ_5zVDI-CjdeQBaAPIj--TUPP_a_K4GMEkhkbGhIlnw Oct 12 13:21:55.479294 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:21:55.479294 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:21:55.479294 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:21:55.479294 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:21:55.479294 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:21:55.479294 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:21:55.479294 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: d95225c22e1840aab527d23c04719c3e Oct 12 13:21:55.479294 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-FlavorsAdminTestJSON-1320742849 Oct 12 13:21:55.479294 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:21:55.479294 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:21:55.480794 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d95225c22e1840aab527d23c04719c3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d95225c22e1840aab527d23c04719c3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d95225c22e1840aab527d23c04719c3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d95225c22e1840aab527d23c04719c3e"}]}] Oct 12 13:21:55.480794 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-FlavorsAdminTestJSON-1320742849 Oct 12 13:21:55.480794 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: d95225c22e1840aab527d23c04719c3e Oct 12 13:21:55.480794 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1320742849 Oct 12 13:21:55.480794 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-FlavorsAdminTestJSON-1320742849-project Oct 12 13:21:55.480794 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:21:55.480794 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:21:55.480794 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 3c1470e2f72847fc992f5807d3467665 Oct 12 13:21:55.480794 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-FlavorsAdminTestJSON-1320742849-project Oct 12 13:21:55.480794 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:21:55.480794 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "test", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "2016260804"}} Oct 12 13:21:55.480794 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:21:55.480794 n-d-861076-2 devstack@n-api.service[120932]: exception: Flavor 2016260804 could not be found. Oct 12 13:21:55.481653 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '2016260804'}}} Oct 12 13:21:55.481653 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:21:55.481653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:55.481653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 12 13:21:55.481653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 12 13:21:55.481653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 13:21:55.481653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 13:21:55.481653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:21:55.481653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:21:55.481653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 13:21:55.481653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 13:21:55.481653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 13:21:55.481653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:55.481653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 13:21:55.481653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 13:21:55.481653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2016260804 could not be found. Oct 12 13:21:55.481653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:55.481653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:55.481653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:55.481653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:55.482871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:55.482871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:55.482871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:21:55.482871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:21:55.482871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:21:55.482871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:21:55.482871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:21:55.482871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:21:55.482871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:21:55.482871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:21:55.482871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:21:55.482871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:21:55.482871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:21:55.482871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 12 13:21:55.482871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 12 13:21:55.482871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2016260804 could not be found. Oct 12 13:21:55.482871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:55.482871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:21:55.482871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:55.482871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:21:55.482871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:21:55.484383 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:21:55.484383 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:21:55.484383 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:21:55.484383 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2016260804 could not be found. Oct 12 13:21:55.484383 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:21:55.484383 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-51cecdb8-d74d-4578-8b1d-027fd6747d3f tempest-FlavorsAdminTestJSON-1320742849 tempest-FlavorsAdminTestJSON-1320742849-project] Returning 400 to user: Flavor 2016260804 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:21:55.484383 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-51cecdb8-d74d-4578-8b1d-027fd6747d3f tempest-FlavorsAdminTestJSON-1320742849 tempest-FlavorsAdminTestJSON-1320742849-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.052363 Oct 12 13:21:55.494026 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 59/134] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:21:55 2022] POST /compute/v2.1/servers => generated 81 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 12 13:21:55.501500 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f1f28b4f-c14b-4392-bd1a-e19cd62245d1 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:55.502611 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f1f28b4f-c14b-4392-bd1a-e19cd62245d1 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:21:55.511343 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1f28b4f-c14b-4392-bd1a-e19cd62245d1 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:55.512698 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1f28b4f-c14b-4392-bd1a-e19cd62245d1 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:55.513575 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1f28b4f-c14b-4392-bd1a-e19cd62245d1 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:55.514677 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1f28b4f-c14b-4392-bd1a-e19cd62245d1 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:55.515591 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1f28b4f-c14b-4392-bd1a-e19cd62245d1 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:55.517467 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1f28b4f-c14b-4392-bd1a-e19cd62245d1 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:55.577335 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-84657991-de71-4a5a-9ee9-acf8e60d97b7 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/292079243" status: 202 len: 0 microversion: 2.1 time: 0.149756 Oct 12 13:21:55.582339 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 76/135] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 12 13:21:55 2022] DELETE /compute/v2.1/flavors/292079243 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:21:55.590617 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0310822b-3662-412d-855b-671361766abf tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:55.701585 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0310822b-3662-412d-855b-671361766abf tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/2016260804" status: 202 len: 0 microversion: 2.1 time: 0.116978 Oct 12 13:21:55.702254 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 77/136] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 12 13:21:55 2022] DELETE /compute/v2.1/flavors/2016260804 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:21:55.712201 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b4075067-725c-4f48-9881-cc1de970e369 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:55.757120 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b4075067-725c-4f48-9881-cc1de970e369 tempest-FlavorsAccessNegativeTestJSON-1438474687 tempest-FlavorsAccessNegativeTestJSON-1438474687-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049656 Oct 12 13:21:55.758449 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 78/137] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:55.764026 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-715b8b6d-5e86-4e0c-8c49-cdf9a07cd944 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:55.806677 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-715b8b6d-5e86-4e0c-8c49-cdf9a07cd944 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046440 Oct 12 13:21:55.818249 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f1f28b4f-c14b-4392-bd1a-e19cd62245d1 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbfb915900c442c0999a39440a8228fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a760f270b741faa8363f5142561aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:21:55.831596 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 79/138] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:55.831715 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f1f28b4f-c14b-4392-bd1a-e19cd62245d1 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1338 microversion: 2.1 time: 0.333467 Oct 12 13:21:55.848649 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8dd37236-c43e-4af7-ae7b-24967059143c tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1079793321", "id": 1442996210, "os-flavor-access:is_public": "False"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:55.851269 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 60/139] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:21:55 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1338 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:55.923983 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-8dd37236-c43e-4af7-ae7b-24967059143c tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.088790 Oct 12 13:21:55.924602 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 80/140] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:21:55 2022] POST /compute/v2.1/flavors => generated 415 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:55.939227 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ec152528-2358-4d0a-8818-5f13e0431479 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-712231847", "id": 1473814590, "os-flavor-access:is_public": "True"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:56.062107 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ec152528-2358-4d0a-8818-5f13e0431479 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.128131 Oct 12 13:21:56.063339 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 61/141] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:21:55 2022] POST /compute/v2.1/flavors => generated 413 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:21:56.076247 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1bb8acd3-8998-4bf2-9273-f08bcc13a140 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:56.133790 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1bb8acd3-8998-4bf2-9273-f08bcc13a140 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.061257 Oct 12 13:21:56.149186 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-48f1665b-ffd0-48b0-accb-43c204f1581f tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:56.161203 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 81/142] 10.222.0.52 () {58 vars in 1169 bytes} [Wed Oct 12 13:21:56 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:56.210349 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-48f1665b-ffd0-48b0-accb-43c204f1581f tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.065308 Oct 12 13:21:56.214226 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 62/143] 10.222.0.52 () {58 vars in 1177 bytes} [Wed Oct 12 13:21:56 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:56.229116 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8e55c2fa-7239-4f0e-9057-83a43b990d38 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:56.254869 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-8e55c2fa-7239-4f0e-9057-83a43b990d38 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.030259 Oct 12 13:21:56.263123 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 82/144] 10.222.0.52 () {58 vars in 1171 bytes} [Wed Oct 12 13:21:56 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:56.269234 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-48fb6669-8581-4aec-9d25-611af577a23a tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:56.292010 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:21:56.296487 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-48fb6669-8581-4aec-9d25-611af577a23a tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.030675 Oct 12 13:21:56.307255 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 63/145] 10.222.0.52 () {58 vars in 1169 bytes} [Wed Oct 12 13:21:56 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:56.312408 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-27864ae9-fdbc-48ea-bbd8-4fee26ed5793 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:56.376492 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-27864ae9-fdbc-48ea-bbd8-4fee26ed5793 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.068036 Oct 12 13:21:56.397382 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 83/146] 10.222.0.52 () {58 vars in 1169 bytes} [Wed Oct 12 13:21:56 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:56.420116 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-30f01693-2a8b-463b-aa1d-16863c3b3c49 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:56.475022 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-30f01693-2a8b-463b-aa1d-16863c3b3c49 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.059894 Oct 12 13:21:56.484973 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 64/147] 10.222.0.52 () {58 vars in 1175 bytes} [Wed Oct 12 13:21:56 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:56.496646 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1edbbd9a-225c-4b85-932c-44125ac5465e tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:56.541425 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1edbbd9a-225c-4b85-932c-44125ac5465e tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.049288 Oct 12 13:21:56.542386 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 84/148] 10.222.0.52 () {58 vars in 1173 bytes} [Wed Oct 12 13:21:56 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:56.561007 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d0d45607-f57b-4ca0-8a09-838e29c3370d tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:56.603074 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d0d45607-f57b-4ca0-8a09-838e29c3370d tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.046248 Oct 12 13:21:56.619285 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 65/149] 10.222.0.52 () {58 vars in 1169 bytes} [Wed Oct 12 13:21:56 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:56.640129 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5ec6ac1b-09c6-4d35-91e0-cb80242eed60 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:56.685485 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=22 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:21:56.754191 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5ec6ac1b-09c6-4d35-91e0-cb80242eed60 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1473814590" status: 202 len: 0 microversion: 2.1 time: 0.118021 Oct 12 13:21:56.754887 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 85/150] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 12 13:21:56 2022] DELETE /compute/v2.1/flavors/1473814590 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 13:21:56.777012 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4add1880-443a-4407-8331-579960444534 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:56.832546 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4add1880-443a-4407-8331-579960444534 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063892 Oct 12 13:21:56.853321 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 66/151] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:56.863015 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-966e791d-1827-471e-89ef-47b0b0beb1dc tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:56.867166 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1cb21374-f26b-4f68-bcfe-f69b4f8f42d4 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:56.869494 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1cb21374-f26b-4f68-bcfe-f69b4f8f42d4 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:21:56.880480 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1cb21374-f26b-4f68-bcfe-f69b4f8f42d4 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:56.886253 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1cb21374-f26b-4f68-bcfe-f69b4f8f42d4 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:56.886253 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1cb21374-f26b-4f68-bcfe-f69b4f8f42d4 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:56.886253 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1cb21374-f26b-4f68-bcfe-f69b4f8f42d4 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:56.886253 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1cb21374-f26b-4f68-bcfe-f69b4f8f42d4 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:56.886706 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1cb21374-f26b-4f68-bcfe-f69b4f8f42d4 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:57.005664 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-966e791d-1827-471e-89ef-47b0b0beb1dc tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1442996210" status: 202 len: 0 microversion: 2.1 time: 0.149234 Oct 12 13:21:57.010398 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 86/152] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 12 13:21:56 2022] DELETE /compute/v2.1/flavors/1442996210 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:21:57.021121 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-440a1eb7-d96f-483e-b24d-a206cd0dd768 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:57.093692 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-440a1eb7-d96f-483e-b24d-a206cd0dd768 tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.080892 Oct 12 13:21:57.094294 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 87/153] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:57.132285 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-18262029-b6bb-450d-9b38-495bb46f10bc tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-601676168", "id": 818054403, "os-flavor-access:is_public": "False"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:57.269359 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-18262029-b6bb-450d-9b38-495bb46f10bc tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.150444 Oct 12 13:21:57.270288 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 88/154] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:21:57 2022] POST /compute/v2.1/flavors => generated 411 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:57.290508 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-32a0ffe0-0bde-4abb-b7e1-36655797f48e tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:57.365352 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-32a0ffe0-0bde-4abb-b7e1-36655797f48e tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.086731 Oct 12 13:21:57.365959 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 89/155] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:57.392145 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a115fcf0-24c5-4601-9bec-744d158364ef tempest-FlavorsAdminTestJSON-1320742849 tempest-FlavorsAdminTestJSON-1320742849-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:57.474217 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a115fcf0-24c5-4601-9bec-744d158364ef tempest-FlavorsAdminTestJSON-1320742849 tempest-FlavorsAdminTestJSON-1320742849-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.090129 Oct 12 13:21:57.489647 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 90/156] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:57.511286 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3fefac05-8c7b-4049-9367-5461070a3cef tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:57.644089 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3fefac05-8c7b-4049-9367-5461070a3cef tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/818054403" status: 202 len: 0 microversion: 2.1 time: 0.137105 Oct 12 13:21:57.644669 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 91/157] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 12 13:21:57 2022] DELETE /compute/v2.1/flavors/818054403 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 13:21:57.653557 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f711f7ee-725d-4598-9a62-9f3fa9ea0f1c tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:57.713931 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f711f7ee-725d-4598-9a62-9f3fa9ea0f1c tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064575 Oct 12 13:21:57.717065 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 92/158] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:21:57.736462 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b86ad06b-2a77-4549-9866-7258ffff6d1e tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1647200292", "id": 1592195127, "os-flavor-access:is_public": "True"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:57.857095 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b86ad06b-2a77-4549-9866-7258ffff6d1e tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.125032 Oct 12 13:21:57.872694 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 93/159] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:21:57 2022] POST /compute/v2.1/flavors => generated 414 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:21:57.883545 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6a0435bd-b249-4aeb-ab98-1780a3c7d4e1 tempest-FlavorsAdminTestJSON-1320742849 tempest-FlavorsAdminTestJSON-1320742849-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:57.933762 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-1cb21374-f26b-4f68-bcfe-f69b4f8f42d4 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbfb915900c442c0999a39440a8228fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a760f270b741faa8363f5142561aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:21:57.951536 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1cb21374-f26b-4f68-bcfe-f69b4f8f42d4 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1338 microversion: 2.1 time: 1.092437 Oct 12 13:21:57.967374 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 67/160] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:21:56 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1338 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:57.982940 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6a0435bd-b249-4aeb-ab98-1780a3c7d4e1 tempest-FlavorsAdminTestJSON-1320742849 tempest-FlavorsAdminTestJSON-1320742849-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.108379 Oct 12 13:21:57.987358 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 94/161] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:57 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:58.012698 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-612cfd96-a512-4b4a-814a-b7a2939bfb5a tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:58.147198 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-612cfd96-a512-4b4a-814a-b7a2939bfb5a tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1592195127" status: 202 len: 0 microversion: 2.1 time: 0.141712 Oct 12 13:21:58.148208 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 68/162] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 12 13:21:58 2022] DELETE /compute/v2.1/flavors/1592195127 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:21:58.162227 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-79d7a85f-81a0-4e66-b60e-1a2240ad875a tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:58.223937 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-79d7a85f-81a0-4e66-b60e-1a2240ad875a tempest-FlavorsAdminTestJSON-236223979 tempest-FlavorsAdminTestJSON-236223979-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070923 Oct 12 13:21:58.249298 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 95/163] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:21:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:21:58.836609 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:21:58.979197 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f32b1591-f29e-417b-9ff5-5f9c038d4b1b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:21:58.979868 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f32b1591-f29e-417b-9ff5-5f9c038d4b1b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:21:58.991534 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f32b1591-f29e-417b-9ff5-5f9c038d4b1b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:58.994036 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f32b1591-f29e-417b-9ff5-5f9c038d4b1b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:59.010092 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f32b1591-f29e-417b-9ff5-5f9c038d4b1b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:59.029524 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f32b1591-f29e-417b-9ff5-5f9c038d4b1b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:59.030327 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f32b1591-f29e-417b-9ff5-5f9c038d4b1b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:59.030919 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f32b1591-f29e-417b-9ff5-5f9c038d4b1b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:59.498279 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f32b1591-f29e-417b-9ff5-5f9c038d4b1b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbfb915900c442c0999a39440a8228fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a760f270b741faa8363f5142561aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:21:59.509845 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f32b1591-f29e-417b-9ff5-5f9c038d4b1b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1338 microversion: 2.1 time: 0.534718 Oct 12 13:21:59.529306 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 96/164] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:21:58 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1338 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:21:59.898089 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-38c403c1-97da-4375-8890-de2f24670558 req-a434dae5-cecb-4e16-9f4a-2a26042ab9da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a10a32a-d01d-4530-a93e-66f425a5bd06", "tag": "2592e3cd-ac7a-4563-b93f-98436307c44f"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:21:59.917495 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-38c403c1-97da-4375-8890-de2f24670558 req-a434dae5-cecb-4e16-9f4a-2a26042ab9da service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:59.925351 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-38c403c1-97da-4375-8890-de2f24670558 req-a434dae5-cecb-4e16-9f4a-2a26042ab9da service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:59.926891 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-38c403c1-97da-4375-8890-de2f24670558 req-a434dae5-cecb-4e16-9f4a-2a26042ab9da service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:59.956125 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-38c403c1-97da-4375-8890-de2f24670558 req-a434dae5-cecb-4e16-9f4a-2a26042ab9da service nova] Creating event network-changed:2592e3cd-ac7a-4563-b93f-98436307c44f for instance 9a10a32a-d01d-4530-a93e-66f425a5bd06 on n-h1-861076-2 Oct 12 13:21:59.957073 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-38c403c1-97da-4375-8890-de2f24670558 req-a434dae5-cecb-4e16-9f4a-2a26042ab9da service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120932) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 13:21:59.957666 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-38c403c1-97da-4375-8890-de2f24670558 req-a434dae5-cecb-4e16-9f4a-2a26042ab9da service nova] Acquired lock "compute-rpcapi-router" {{(pid=120932) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 13:21:59.959021 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff207792-28e2-4871-801a-b7c7b8f0e210 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:59.960288 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff207792-28e2-4871-801a-b7c7b8f0e210 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:59.960916 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff207792-28e2-4871-801a-b7c7b8f0e210 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:59.961805 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff207792-28e2-4871-801a-b7c7b8f0e210 None None] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:21:59.962408 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff207792-28e2-4871-801a-b7c7b8f0e210 None None] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:21:59.962977 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff207792-28e2-4871-801a-b7c7b8f0e210 None None] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:21:59.995322 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.compute.rpcapi [None req-ff207792-28e2-4871-801a-b7c7b8f0e210 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 12 13:21:59.996693 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff207792-28e2-4871-801a-b7c7b8f0e210 None None] Releasing lock "compute-rpcapi-router" {{(pid=120932) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 13:22:00.022682 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ff207792-28e2-4871-801a-b7c7b8f0e210 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.191217 Oct 12 13:22:00.032704 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 69/165] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:00.535913 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-03cf449a-7fda-4ec5-bf67-18805b824f4d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:00.536667 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-03cf449a-7fda-4ec5-bf67-18805b824f4d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:00.545095 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03cf449a-7fda-4ec5-bf67-18805b824f4d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:00.545580 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03cf449a-7fda-4ec5-bf67-18805b824f4d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:00.546015 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03cf449a-7fda-4ec5-bf67-18805b824f4d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:00.546795 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03cf449a-7fda-4ec5-bf67-18805b824f4d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:00.552100 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03cf449a-7fda-4ec5-bf67-18805b824f4d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:00.552662 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03cf449a-7fda-4ec5-bf67-18805b824f4d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:00.961992 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-03cf449a-7fda-4ec5-bf67-18805b824f4d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbfb915900c442c0999a39440a8228fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a760f270b741faa8363f5142561aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:00.975823 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-03cf449a-7fda-4ec5-bf67-18805b824f4d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1338 microversion: 2.1 time: 0.444136 Oct 12 13:22:00.994737 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 97/166] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:00 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1338 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:22:02.007955 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0a4af052-9252-44bc-a3fa-1ced8c8dc440 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:02.009529 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0a4af052-9252-44bc-a3fa-1ced8c8dc440 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:02.018650 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0a4af052-9252-44bc-a3fa-1ced8c8dc440 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:02.019453 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0a4af052-9252-44bc-a3fa-1ced8c8dc440 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:02.020169 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0a4af052-9252-44bc-a3fa-1ced8c8dc440 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:02.021107 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0a4af052-9252-44bc-a3fa-1ced8c8dc440 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:02.022202 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0a4af052-9252-44bc-a3fa-1ced8c8dc440 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:02.022985 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0a4af052-9252-44bc-a3fa-1ced8c8dc440 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:02.301383 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-0a4af052-9252-44bc-a3fa-1ced8c8dc440 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbfb915900c442c0999a39440a8228fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a760f270b741faa8363f5142561aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:02.309715 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0a4af052-9252-44bc-a3fa-1ced8c8dc440 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1338 microversion: 2.1 time: 0.306187 Oct 12 13:22:02.310266 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 70/167] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:02 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1338 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:22:03.332058 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c2e2e212-fcdb-4a41-8bf9-d9e4e6f8b2b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:03.333353 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c2e2e212-fcdb-4a41-8bf9-d9e4e6f8b2b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:03.340415 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2e2e212-fcdb-4a41-8bf9-d9e4e6f8b2b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:03.342474 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2e2e212-fcdb-4a41-8bf9-d9e4e6f8b2b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:03.342474 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2e2e212-fcdb-4a41-8bf9-d9e4e6f8b2b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:03.342474 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2e2e212-fcdb-4a41-8bf9-d9e4e6f8b2b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:03.343577 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2e2e212-fcdb-4a41-8bf9-d9e4e6f8b2b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:03.344180 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2e2e212-fcdb-4a41-8bf9-d9e4e6f8b2b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:03.526570 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-c2e2e212-fcdb-4a41-8bf9-d9e4e6f8b2b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbfb915900c442c0999a39440a8228fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a760f270b741faa8363f5142561aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:03.537104 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c2e2e212-fcdb-4a41-8bf9-d9e4e6f8b2b9 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1338 microversion: 2.1 time: 0.209041 Oct 12 13:22:03.538212 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 98/168] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:03 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1338 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:22:04.560634 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-84f8dfcb-87c4-4545-a5df-6e833ee7e563 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:04.561281 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-84f8dfcb-87c4-4545-a5df-6e833ee7e563 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:04.568044 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-84f8dfcb-87c4-4545-a5df-6e833ee7e563 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:04.568535 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-84f8dfcb-87c4-4545-a5df-6e833ee7e563 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:04.568998 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-84f8dfcb-87c4-4545-a5df-6e833ee7e563 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:04.569701 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-84f8dfcb-87c4-4545-a5df-6e833ee7e563 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:04.570368 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-84f8dfcb-87c4-4545-a5df-6e833ee7e563 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:04.570946 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-84f8dfcb-87c4-4545-a5df-6e833ee7e563 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:04.594050 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=73 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:04.796718 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-84f8dfcb-87c4-4545-a5df-6e833ee7e563 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbfb915900c442c0999a39440a8228fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a760f270b741faa8363f5142561aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:04.805241 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-84f8dfcb-87c4-4545-a5df-6e833ee7e563 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1338 microversion: 2.1 time: 0.248315 Oct 12 13:22:04.806451 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 71/169] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:04 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1338 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:22:05.753653 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ef803e10-cf68-4a60-87ed-d5e990c306ff tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1828295000", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": "none"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:05.832681 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f542efb0-4b60-4af0-832a-5f3c88c122ee tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:05.834532 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f542efb0-4b60-4af0-832a-5f3c88c122ee tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:05.847865 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f542efb0-4b60-4af0-832a-5f3c88c122ee tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:05.849388 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f542efb0-4b60-4af0-832a-5f3c88c122ee tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:05.850600 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f542efb0-4b60-4af0-832a-5f3c88c122ee tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:05.852029 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f542efb0-4b60-4af0-832a-5f3c88c122ee tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:05.852687 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f542efb0-4b60-4af0-832a-5f3c88c122ee tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:05.853251 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-ef803e10-cf68-4a60-87ed-d5e990c306ff tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:22:05.853794 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f542efb0-4b60-4af0-832a-5f3c88c122ee tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:05.857243 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-ef803e10-cf68-4a60-87ed-d5e990c306ff tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:22:05.857828 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-ef803e10-cf68-4a60-87ed-d5e990c306ff tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:22:05.858251 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-ef803e10-cf68-4a60-87ed-d5e990c306ff tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:22:05.858668 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-ef803e10-cf68-4a60-87ed-d5e990c306ff tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:22:05.872337 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ef803e10-cf68-4a60-87ed-d5e990c306ff tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:05.872830 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ef803e10-cf68-4a60-87ed-d5e990c306ff tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:05.873439 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ef803e10-cf68-4a60-87ed-d5e990c306ff tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:05.874442 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ef803e10-cf68-4a60-87ed-d5e990c306ff tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:05.875086 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ef803e10-cf68-4a60-87ed-d5e990c306ff tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:05.875564 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ef803e10-cf68-4a60-87ed-d5e990c306ff tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:05.900507 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-ef803e10-cf68-4a60-87ed-d5e990c306ff tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Getting quotas for project 9fe783d615584c7d9ea3f9fca3d3a3fb. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:22:05.908795 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-ef803e10-cf68-4a60-87ed-d5e990c306ff tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Getting quotas for user 5fa5d90baf414f32abdda772daaca4bd and project 9fe783d615584c7d9ea3f9fca3d3a3fb. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:22:05.932865 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-ef803e10-cf68-4a60-87ed-d5e990c306ff tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Going to run 1 instances... {{(pid=120933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:22:05.936930 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-ef803e10-cf68-4a60-87ed-d5e990c306ff tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:22:06.038253 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ef803e10-cf68-4a60-87ed-d5e990c306ff tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.591859 Oct 12 13:22:06.039589 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 99/170] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 12 13:22:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 13:22:06.056610 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3f3ba625-0286-4779-a742-3e664b252217 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:06.060453 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-3f3ba625-0286-4779-a742-3e664b252217 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:06.182441 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f542efb0-4b60-4af0-832a-5f3c88c122ee tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbfb915900c442c0999a39440a8228fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a760f270b741faa8363f5142561aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:06.208768 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f542efb0-4b60-4af0-832a-5f3c88c122ee tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1338 microversion: 2.1 time: 0.379872 Oct 12 13:22:06.211219 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 72/171] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:05 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1338 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:22:06.251624 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-3f3ba625-0286-4779-a742-3e664b252217 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:06.269474 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-3f3ba625-0286-4779-a742-3e664b252217 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:06.271380 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-3f3ba625-0286-4779-a742-3e664b252217 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:06.287107 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3f3ba625-0286-4779-a742-3e664b252217 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "PUT /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1359 microversion: 2.75 time: 0.233438 Oct 12 13:22:06.287107 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 100/172] 10.222.0.52 () {62 vars in 1297 bytes} [Wed Oct 12 13:22:06 2022] PUT /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1359 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:06.313348 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e703223b-7274-49ea-81df-8b4020ad0f7e tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:06.314363 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e703223b-7274-49ea-81df-8b4020ad0f7e tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:06.419196 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-e703223b-7274-49ea-81df-8b4020ad0f7e tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:06.427351 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-e703223b-7274-49ea-81df-8b4020ad0f7e tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:06.429034 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-e703223b-7274-49ea-81df-8b4020ad0f7e tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:06.436671 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e703223b-7274-49ea-81df-8b4020ad0f7e tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1359 microversion: 2.75 time: 0.128351 Oct 12 13:22:06.437974 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 73/173] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:06 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1359 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:07.009060 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1c6a2113-01cc-4560-b049-022630a5a9f8 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-800235723", "ram": 512, "vcpus": 1, "disk": 10, "id": 396249933, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:07.133755 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1c6a2113-01cc-4560-b049-022630a5a9f8 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.577517 Oct 12 13:22:07.134351 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 101/174] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:22:06 2022] POST /compute/v2.1/flavors => generated 412 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:07.449397 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5a19bc26-c3e4-418a-92f1-74a304a96166 tempest-HypervisorAdminV228Test-1322726712 tempest-HypervisorAdminV228Test-1322726712-project-admin] Calling method '.version_select at 0x7f8aa0515790>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:07.449397 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5a19bc26-c3e4-418a-92f1-74a304a96166 tempest-HypervisorAdminV228Test-1322726712 tempest-HypervisorAdminV228Test-1322726712-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:07.449397 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5a19bc26-c3e4-418a-92f1-74a304a96166 tempest-HypervisorAdminV228Test-1322726712 tempest-HypervisorAdminV228Test-1322726712-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:07.449397 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5a19bc26-c3e4-418a-92f1-74a304a96166 tempest-HypervisorAdminV228Test-1322726712 tempest-HypervisorAdminV228Test-1322726712-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:07.463907 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5a19bc26-c3e4-418a-92f1-74a304a96166 tempest-HypervisorAdminV228Test-1322726712 tempest-HypervisorAdminV228Test-1322726712-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:07.464396 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5a19bc26-c3e4-418a-92f1-74a304a96166 tempest-HypervisorAdminV228Test-1322726712 tempest-HypervisorAdminV228Test-1322726712-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:07.465051 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5a19bc26-c3e4-418a-92f1-74a304a96166 tempest-HypervisorAdminV228Test-1322726712 tempest-HypervisorAdminV228Test-1322726712-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:07.478415 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5a19bc26-c3e4-418a-92f1-74a304a96166 tempest-HypervisorAdminV228Test-1322726712 tempest-HypervisorAdminV228Test-1322726712-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:07.479252 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5a19bc26-c3e4-418a-92f1-74a304a96166 tempest-HypervisorAdminV228Test-1322726712 tempest-HypervisorAdminV228Test-1322726712-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:07.479856 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5a19bc26-c3e4-418a-92f1-74a304a96166 tempest-HypervisorAdminV228Test-1322726712 tempest-HypervisorAdminV228Test-1322726712-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:07.489974 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-921dd709-9d4e-4051-8a6a-bc0901f89aad tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:07.491937 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5a19bc26-c3e4-418a-92f1-74a304a96166 tempest-HypervisorAdminV228Test-1322726712 tempest-HypervisorAdminV228Test-1322726712-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.570575 Oct 12 13:22:07.499340 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 74/175] 10.222.0.52 () {60 vars in 1187 bytes} [Wed Oct 12 13:22:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:22:07.504238 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-921dd709-9d4e-4051-8a6a-bc0901f89aad tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project] HTTP exception thrown: Flavor 396249933 has no extra specs with key hw:cpu_thread_policy. Oct 12 13:22:07.504453 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-62eeb548-d8c0-455f-99e3-ff96e68b41f6 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:07.504937 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-62eeb548-d8c0-455f-99e3-ff96e68b41f6 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:07.505925 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-921dd709-9d4e-4051-8a6a-bc0901f89aad tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project] Request method failure captured: Oct 12 13:22:07.505925 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/flavors/396249933/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 12 13:22:07.505925 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:07.505925 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:07.505925 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:07.505925 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:22:07.505925 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:07.505925 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:07.505925 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:07.505925 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:07.505925 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr98Th9X-FLdamJHE2hB0K1GnsGfYRnU_Nlu4GsL3nD9Y8p-OohMQi0B3PNyvKm91J1Nph_hCf5NGpqKhl1j1-waExD5hWZRPT6l2qsoZCY14g8DcM9qw7WG9ujP5T0XUMrHESe4SxQP9LATUgvEC93avicepIanraOMWWRiDeHdxCw Oct 12 13:22:07.505925 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:07.505925 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:07.505925 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:07.505925 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:07.505925 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:07.505925 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:07.505925 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: a4ca99c57f5e4f188051e96a0bf3728b Oct 12 13:22:07.505925 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 Oct 12 13:22:07.505925 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:22:07.505925 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:22:07.507331 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a4ca99c57f5e4f188051e96a0bf3728b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a4ca99c57f5e4f188051e96a0bf3728b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a4ca99c57f5e4f188051e96a0bf3728b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a4ca99c57f5e4f188051e96a0bf3728b"}]}] Oct 12 13:22:07.507331 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 Oct 12 13:22:07.507331 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: a4ca99c57f5e4f188051e96a0bf3728b Oct 12 13:22:07.507331 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 Oct 12 13:22:07.507331 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project Oct 12 13:22:07.507331 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:07.507331 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:07.507331 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 58c492671c5b4948b937cafa33a64361 Oct 12 13:22:07.507331 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project Oct 12 13:22:07.507331 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:22:07.507331 n-d-861076-2 devstack@n-api.service[120933]: exception: Flavor 396249933 has no extra specs with key hw:cpu_thread_policy. Oct 12 13:22:07.510108 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'flavor_id': '396249933', 'id': 'hw:cpu_thread_policy'} Oct 12 13:22:07.510108 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:07.510108 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:07.510108 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 12 13:22:07.510108 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 12 13:22:07.510108 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 12 13:22:07.510108 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:07.510108 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:07.510108 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:07.510108 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:07.510108 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:07.510108 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:07.510108 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:07.510108 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:07.510108 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:07.510108 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:07.510108 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 12 13:22:07.510108 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 13:22:07.510108 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 396249933 has no extra specs with key hw:cpu_thread_policy. Oct 12 13:22:07.510108 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:07.510108 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:07.510108 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:07.512263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:07.512263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:07.512263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:07.512263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:22:07.512263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:22:07.512263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 396249933 has no extra specs with key hw:cpu_thread_policy. Oct 12 13:22:07.512263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:07.512263 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-921dd709-9d4e-4051-8a6a-bc0901f89aad tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project] Returning 404 to user: Flavor 396249933 has no extra specs with key hw:cpu_thread_policy. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:07.512263 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-921dd709-9d4e-4051-8a6a-bc0901f89aad tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project] 10.222.0.52 "GET /compute/v2.1/flavors/396249933/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.365754 Oct 12 13:22:07.513389 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 102/176] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 12 13:22:07 2022] GET /compute/v2.1/flavors/396249933/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 370 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 13:22:07.519772 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62eeb548-d8c0-455f-99e3-ff96e68b41f6 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:07.520355 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62eeb548-d8c0-455f-99e3-ff96e68b41f6 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:07.521187 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62eeb548-d8c0-455f-99e3-ff96e68b41f6 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:07.522052 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62eeb548-d8c0-455f-99e3-ff96e68b41f6 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:07.522673 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62eeb548-d8c0-455f-99e3-ff96e68b41f6 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:07.523242 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62eeb548-d8c0-455f-99e3-ff96e68b41f6 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:07.523839 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b6915376-42ca-4008-8138-7003c1825b60 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:07.524464 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-b6915376-42ca-4008-8138-7003c1825b60 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:07.631752 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b6915376-42ca-4008-8138-7003c1825b60 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:07.639730 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b6915376-42ca-4008-8138-7003c1825b60 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:07.642090 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b6915376-42ca-4008-8138-7003c1825b60 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:07.648408 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b6915376-42ca-4008-8138-7003c1825b60 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1359 microversion: 2.75 time: 0.133285 Oct 12 13:22:07.669715 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 103/177] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:07 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:07.680787 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-670070a9-81fd-4348-bfbb-c1f5c9d24bfd tempest-HypervisorAdminV228Test-1322726712 tempest-HypervisorAdminV228Test-1322726712-project-admin] Calling method '.version_select at 0x7f8aa07a6940>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:07.682824 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-670070a9-81fd-4348-bfbb-c1f5c9d24bfd tempest-HypervisorAdminV228Test-1322726712 tempest-HypervisorAdminV228Test-1322726712-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:07.683491 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-670070a9-81fd-4348-bfbb-c1f5c9d24bfd tempest-HypervisorAdminV228Test-1322726712 tempest-HypervisorAdminV228Test-1322726712-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:07.683920 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-670070a9-81fd-4348-bfbb-c1f5c9d24bfd tempest-HypervisorAdminV228Test-1322726712 tempest-HypervisorAdminV228Test-1322726712-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:07.691051 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=71 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:07.701960 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-670070a9-81fd-4348-bfbb-c1f5c9d24bfd tempest-HypervisorAdminV228Test-1322726712 tempest-HypervisorAdminV228Test-1322726712-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:07.702423 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-670070a9-81fd-4348-bfbb-c1f5c9d24bfd tempest-HypervisorAdminV228Test-1322726712 tempest-HypervisorAdminV228Test-1322726712-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:07.703403 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-670070a9-81fd-4348-bfbb-c1f5c9d24bfd tempest-HypervisorAdminV228Test-1322726712 tempest-HypervisorAdminV228Test-1322726712-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:07.711600 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-670070a9-81fd-4348-bfbb-c1f5c9d24bfd tempest-HypervisorAdminV228Test-1322726712 tempest-HypervisorAdminV228Test-1322726712-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.040348 Oct 12 13:22:07.712214 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 104/178] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Oct 12 13:22:07 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:22:07.717877 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d1ba01f1-b4a7-4108-8e47-100cfe449898 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:07.725979 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d1ba01f1-b4a7-4108-8e47-100cfe449898 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '58c492671c5b4948b937cafa33a64361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ca99c57f5e4f188051e96a0bf3728b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:07.727839 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d1ba01f1-b4a7-4108-8e47-100cfe449898 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project] Request method failure captured: Oct 12 13:22:07.727839 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/flavors/396249933/os-extra_specs HTTP/1.1 Oct 12 13:22:07.727839 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:07.727839 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:07.727839 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:07.727839 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 66 Oct 12 13:22:07.727839 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:07.727839 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:07.727839 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:07.727839 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:07.727839 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr98Th9X-FLdamJHE2hB0K1GnsGfYRnU_Nlu4GsL3nD9Y8p-OohMQi0B3PNyvKm91J1Nph_hCf5NGpqKhl1j1-waExD5hWZRPT6l2qsoZCY14g8DcM9qw7WG9ujP5T0XUMrHESe4SxQP9LATUgvEC93avicepIanraOMWWRiDeHdxCw Oct 12 13:22:07.727839 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:07.727839 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:07.727839 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:07.727839 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:07.727839 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:07.727839 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:07.727839 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: a4ca99c57f5e4f188051e96a0bf3728b Oct 12 13:22:07.727839 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 Oct 12 13:22:07.727839 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:22:07.727839 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:22:07.729068 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a4ca99c57f5e4f188051e96a0bf3728b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a4ca99c57f5e4f188051e96a0bf3728b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a4ca99c57f5e4f188051e96a0bf3728b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a4ca99c57f5e4f188051e96a0bf3728b"}]}] Oct 12 13:22:07.729068 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 Oct 12 13:22:07.729068 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: a4ca99c57f5e4f188051e96a0bf3728b Oct 12 13:22:07.729068 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 Oct 12 13:22:07.729068 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project Oct 12 13:22:07.729068 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:07.729068 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:07.729068 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 58c492671c5b4948b937cafa33a64361 Oct 12 13:22:07.729068 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project Oct 12 13:22:07.729068 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:22:07.729068 n-d-861076-2 devstack@n-api.service[120933]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 12 13:22:07.729068 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:22:07.729715 n-d-861076-2 devstack@n-api.service[120933]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 12 13:22:07.729715 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'flavor_id': '396249933', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 12 13:22:07.729715 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:07.729715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:07.729715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:07.729715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:07.729715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:07.729715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:07.729715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:07.729715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:07.729715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:07.729715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:07.729715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 12 13:22:07.729715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 12 13:22:07.729715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:22:07.729715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:22:07.729715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:22:07.729715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:22:07.729715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:22:07.730780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:22:07.730780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:22:07.730780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:22:07.730780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:22:07.730780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:22:07.730780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:22:07.730780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:22:07.730780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:22:07.730780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:22:07.730780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 12 13:22:07.730780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:07.730780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:07.730780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:07.730780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:07.730780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:07.730780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:07.730780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:22:07.730780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:22:07.730780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 12 13:22:07.730780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:07.732138 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d1ba01f1-b4a7-4108-8e47-100cfe449898 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:07.732138 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d1ba01f1-b4a7-4108-8e47-100cfe449898 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project] 10.222.0.52 "POST /compute/v2.1/flavors/396249933/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.015312 Oct 12 13:22:07.736627 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 105/179] 10.222.0.52 () {60 vars in 1221 bytes} [Wed Oct 12 13:22:07 2022] POST /compute/v2.1/flavors/396249933/os-extra_specs => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:22:07.740327 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a3bb149e-9692-4f0b-98e5-9bcb7abdf09f tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:07.778798 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-62eeb548-d8c0-455f-99e3-ff96e68b41f6 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbfb915900c442c0999a39440a8228fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a760f270b741faa8363f5142561aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:07.793844 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-62eeb548-d8c0-455f-99e3-ff96e68b41f6 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1338 microversion: 2.1 time: 0.293327 Oct 12 13:22:07.798514 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 75/180] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:07 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1338 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:22:08.304218 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a3bb149e-9692-4f0b-98e5-9bcb7abdf09f tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/396249933/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.568663 Oct 12 13:22:08.305603 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 106/181] 10.222.0.52 () {60 vars in 1221 bytes} [Wed Oct 12 13:22:07 2022] POST /compute/v2.1/flavors/396249933/os-extra_specs => generated 66 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:22:08.319789 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9e317bf6-9e64-4a80-88be-f5a4a197e433 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:08.323166 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-9e317bf6-9e64-4a80-88be-f5a4a197e433 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '58c492671c5b4948b937cafa33a64361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ca99c57f5e4f188051e96a0bf3728b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:08.327164 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9e317bf6-9e64-4a80-88be-f5a4a197e433 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project] Request method failure captured: Oct 12 13:22:08.327164 n-d-861076-2 devstack@n-api.service[120932]: request: DELETE /compute/v2.1/flavors/396249933/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 12 13:22:08.327164 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:22:08.327164 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:22:08.327164 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:22:08.327164 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:22:08.327164 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:22:08.327164 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:22:08.327164 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:22:08.327164 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:08.327164 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr98Th9X-FLdamJHE2hB0K1GnsGfYRnU_Nlu4GsL3nD9Y8p-OohMQi0B3PNyvKm91J1Nph_hCf5NGpqKhl1j1-waExD5hWZRPT6l2qsoZCY14g8DcM9qw7WG9ujP5T0XUMrHESe4SxQP9LATUgvEC93avicepIanraOMWWRiDeHdxCw Oct 12 13:22:08.327164 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:22:08.327164 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:22:08.327164 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:22:08.327164 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:22:08.327164 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:22:08.327164 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:22:08.327164 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: a4ca99c57f5e4f188051e96a0bf3728b Oct 12 13:22:08.327164 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 Oct 12 13:22:08.327164 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:22:08.327164 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:22:08.335472 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a4ca99c57f5e4f188051e96a0bf3728b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a4ca99c57f5e4f188051e96a0bf3728b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a4ca99c57f5e4f188051e96a0bf3728b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a4ca99c57f5e4f188051e96a0bf3728b"}]}] Oct 12 13:22:08.335472 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 Oct 12 13:22:08.335472 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: a4ca99c57f5e4f188051e96a0bf3728b Oct 12 13:22:08.335472 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 Oct 12 13:22:08.335472 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project Oct 12 13:22:08.335472 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:22:08.335472 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:22:08.335472 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 58c492671c5b4948b937cafa33a64361 Oct 12 13:22:08.335472 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project Oct 12 13:22:08.335472 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:22:08.335472 n-d-861076-2 devstack@n-api.service[120932]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 12 13:22:08.336467 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'flavor_id': '396249933', 'id': 'hw:numa_nodes'} Oct 12 13:22:08.336467 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:08.336467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:08.336467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:08.336467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:08.336467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:08.336467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:08.336467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:08.336467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:08.336467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 12 13:22:08.336467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 12 13:22:08.336467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:22:08.336467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:22:08.336467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:22:08.336467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:22:08.336467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:22:08.336467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:22:08.336467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:22:08.336467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:22:08.336467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:22:08.337607 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:22:08.337607 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:22:08.337607 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:22:08.337607 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:22:08.337607 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:22:08.337607 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 12 13:22:08.337607 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:08.337607 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:08.337607 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:08.337607 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:08.337607 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:08.337607 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:08.337607 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:22:08.337607 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:22:08.337607 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 12 13:22:08.337607 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:08.337607 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9e317bf6-9e64-4a80-88be-f5a4a197e433 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:08.338507 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9e317bf6-9e64-4a80-88be-f5a4a197e433 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project] 10.222.0.52 "DELETE /compute/v2.1/flavors/396249933/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.018758 Oct 12 13:22:08.338507 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 76/182] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:22:08 2022] DELETE /compute/v2.1/flavors/396249933/os-extra_specs/hw:numa_nodes => generated 124 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:22:08.345717 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-83e9e20f-3e8e-41b8-9f41-7959e01d9843 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:08.366209 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=7,nova_api:INSERT=8,nova_api:SAVEPOINT=3,nova_api:RELEASE=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:08.377159 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-83e9e20f-3e8e-41b8-9f41-7959e01d9843 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/396249933/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035391 Oct 12 13:22:08.388560 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3f6c28c2-80fa-43a3-afb1-3ec70475fe5e tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:08.392668 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-3f6c28c2-80fa-43a3-afb1-3ec70475fe5e tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '58c492671c5b4948b937cafa33a64361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ca99c57f5e4f188051e96a0bf3728b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:08.393693 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 107/183] 10.222.0.52 () {60 vars in 1221 bytes} [Wed Oct 12 13:22:08 2022] POST /compute/v2.1/flavors/396249933/os-extra_specs => generated 66 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:22:08.395386 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3f6c28c2-80fa-43a3-afb1-3ec70475fe5e tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project] Request method failure captured: Oct 12 13:22:08.395386 n-d-861076-2 devstack@n-api.service[120932]: request: PUT /compute/v2.1/flavors/396249933/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 12 13:22:08.395386 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:22:08.395386 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:22:08.395386 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:22:08.395386 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 22 Oct 12 13:22:08.395386 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:22:08.395386 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:22:08.395386 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:22:08.395386 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:08.395386 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr98Th9X-FLdamJHE2hB0K1GnsGfYRnU_Nlu4GsL3nD9Y8p-OohMQi0B3PNyvKm91J1Nph_hCf5NGpqKhl1j1-waExD5hWZRPT6l2qsoZCY14g8DcM9qw7WG9ujP5T0XUMrHESe4SxQP9LATUgvEC93avicepIanraOMWWRiDeHdxCw Oct 12 13:22:08.395386 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:22:08.395386 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:22:08.395386 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:22:08.395386 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:22:08.395386 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:22:08.395386 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:22:08.395386 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: a4ca99c57f5e4f188051e96a0bf3728b Oct 12 13:22:08.395386 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 Oct 12 13:22:08.395386 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:22:08.395386 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:22:08.397075 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a4ca99c57f5e4f188051e96a0bf3728b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a4ca99c57f5e4f188051e96a0bf3728b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a4ca99c57f5e4f188051e96a0bf3728b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a4ca99c57f5e4f188051e96a0bf3728b"}]}] Oct 12 13:22:08.397075 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 Oct 12 13:22:08.397075 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: a4ca99c57f5e4f188051e96a0bf3728b Oct 12 13:22:08.397075 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 Oct 12 13:22:08.397075 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project Oct 12 13:22:08.397075 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:22:08.397075 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:22:08.397075 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 58c492671c5b4948b937cafa33a64361 Oct 12 13:22:08.397075 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project Oct 12 13:22:08.397075 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:22:08.397075 n-d-861076-2 devstack@n-api.service[120932]: {"hw:numa_nodes": "1"} Oct 12 13:22:08.397075 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:22:08.397075 n-d-861076-2 devstack@n-api.service[120932]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 12 13:22:08.398018 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'flavor_id': '396249933', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 12 13:22:08.398018 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:08.398018 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:08.398018 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:08.398018 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:08.398018 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:08.398018 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:08.398018 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:08.398018 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:08.398018 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:08.398018 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:08.398018 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 12 13:22:08.398018 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 12 13:22:08.398018 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:22:08.398018 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:22:08.398018 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:22:08.398018 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:22:08.398018 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:22:08.398018 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:22:08.399199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:22:08.399199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:22:08.399199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:22:08.399199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:22:08.399199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:22:08.399199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:22:08.399199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:22:08.399199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:22:08.399199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 12 13:22:08.399199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:08.399199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:08.399199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:08.399199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:08.399199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:08.399199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:08.399199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:22:08.399199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:22:08.399199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 12 13:22:08.399199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:08.402052 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3f6c28c2-80fa-43a3-afb1-3ec70475fe5e tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:08.402052 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3f6c28c2-80fa-43a3-afb1-3ec70475fe5e tempest-FlavorsExtraSpecsNegativeTestJSON-616027371 tempest-FlavorsExtraSpecsNegativeTestJSON-616027371-project] 10.222.0.52 "PUT /compute/v2.1/flavors/396249933/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.015426 Oct 12 13:22:08.402052 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 77/184] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 12 13:22:08 2022] PUT /compute/v2.1/flavors/396249933/os-extra_specs/hw:numa_nodes => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:22:08.411476 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-faeaf9ae-68a0-4027-9a32-4f36f7d34c03 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:08.424579 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-faeaf9ae-68a0-4027-9a32-4f36f7d34c03 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] HTTP exception thrown: Flavor 396249933 has no extra specs with key hw:cpu_thread_policy. Oct 12 13:22:08.429092 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-faeaf9ae-68a0-4027-9a32-4f36f7d34c03 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] Request method failure captured: Oct 12 13:22:08.429092 n-d-861076-2 devstack@n-api.service[120933]: request: DELETE /compute/v2.1/flavors/396249933/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 12 13:22:08.429092 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:08.429092 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:08.429092 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:08.429092 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:22:08.429092 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:08.429092 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:08.429092 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:08.429092 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:08.429092 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9-fK1g0uRSuPXdLpAAxtO6t0gxrJjvApDEFNjTLeAB6WT5cSV5UaBbjcIiuWJEDIyty-BJtZXnJA5aGTb1QOU1KEkNjMSihIFI1DEzaRRBHWAmfJu43vBgTFlyyu9yfrdA-_NmT7XIf7azsJzhJxhAxCAsxBfOSqA2b83CVKRNDWw Oct 12 13:22:08.429092 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:08.429092 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:08.429092 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:08.429092 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:08.429092 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:08.429092 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:08.429092 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 75e260e6422f404a89e53a64cae2b8e7 Oct 12 13:22:08.429092 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 Oct 12 13:22:08.429092 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:22:08.429092 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:22:08.430493 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/75e260e6422f404a89e53a64cae2b8e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_75e260e6422f404a89e53a64cae2b8e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/75e260e6422f404a89e53a64cae2b8e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/75e260e6422f404a89e53a64cae2b8e7"}]}] Oct 12 13:22:08.430493 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 Oct 12 13:22:08.430493 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 75e260e6422f404a89e53a64cae2b8e7 Oct 12 13:22:08.430493 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 Oct 12 13:22:08.430493 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin Oct 12 13:22:08.430493 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:08.430493 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:08.430493 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 2ad5cd933f3d467b9727f99e087d2e94 Oct 12 13:22:08.430493 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin Oct 12 13:22:08.430493 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:22:08.430493 n-d-861076-2 devstack@n-api.service[120933]: exception: Flavor 396249933 has no extra specs with key hw:cpu_thread_policy. Oct 12 13:22:08.431170 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'flavor_id': '396249933', 'id': 'hw:cpu_thread_policy'} Oct 12 13:22:08.431170 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:08.431170 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:08.431170 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 12 13:22:08.431170 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 12 13:22:08.431170 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 12 13:22:08.431170 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:08.431170 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:08.431170 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:08.431170 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:08.431170 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:08.431170 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:08.431170 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:08.431170 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:08.431170 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:08.431170 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:08.431170 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 12 13:22:08.431170 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 13:22:08.431170 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 396249933 has no extra specs with key hw:cpu_thread_policy. Oct 12 13:22:08.431170 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:08.431170 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:08.431170 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:08.432492 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:08.432492 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:08.432492 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:08.432492 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:22:08.432492 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:22:08.432492 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 396249933 has no extra specs with key hw:cpu_thread_policy. Oct 12 13:22:08.432492 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:08.437020 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-faeaf9ae-68a0-4027-9a32-4f36f7d34c03 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] Returning 404 to user: Flavor 396249933 has no extra specs with key hw:cpu_thread_policy. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:08.439024 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-faeaf9ae-68a0-4027-9a32-4f36f7d34c03 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/396249933/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.031511 Oct 12 13:22:08.447194 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 108/185] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 12 13:22:08 2022] DELETE /compute/v2.1/flavors/396249933/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:22:08.458751 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9fc0a60b-7d84-488c-9019-5ab3bea26517 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:08.463244 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-9fc0a60b-7d84-488c-9019-5ab3bea26517 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 12 13:22:08.464722 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9fc0a60b-7d84-488c-9019-5ab3bea26517 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] Request method failure captured: Oct 12 13:22:08.464722 n-d-861076-2 devstack@n-api.service[120932]: request: PUT /compute/v2.1/flavors/396249933/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 12 13:22:08.464722 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:22:08.464722 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:22:08.464722 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:22:08.464722 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 27 Oct 12 13:22:08.464722 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:22:08.464722 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:22:08.464722 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:22:08.464722 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:08.464722 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr9-fK1g0uRSuPXdLpAAxtO6t0gxrJjvApDEFNjTLeAB6WT5cSV5UaBbjcIiuWJEDIyty-BJtZXnJA5aGTb1QOU1KEkNjMSihIFI1DEzaRRBHWAmfJu43vBgTFlyyu9yfrdA-_NmT7XIf7azsJzhJxhAxCAsxBfOSqA2b83CVKRNDWw Oct 12 13:22:08.464722 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:22:08.464722 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:22:08.464722 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:22:08.464722 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:22:08.464722 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:22:08.464722 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:22:08.464722 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 75e260e6422f404a89e53a64cae2b8e7 Oct 12 13:22:08.464722 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 Oct 12 13:22:08.464722 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,admin,reader Oct 12 13:22:08.464722 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,admin,reader Oct 12 13:22:08.466149 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/75e260e6422f404a89e53a64cae2b8e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_75e260e6422f404a89e53a64cae2b8e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/75e260e6422f404a89e53a64cae2b8e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/75e260e6422f404a89e53a64cae2b8e7"}]}] Oct 12 13:22:08.466149 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 Oct 12 13:22:08.466149 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 75e260e6422f404a89e53a64cae2b8e7 Oct 12 13:22:08.466149 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 Oct 12 13:22:08.466149 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin Oct 12 13:22:08.466149 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:22:08.466149 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:22:08.466149 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 2ad5cd933f3d467b9727f99e087d2e94 Oct 12 13:22:08.466149 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin Oct 12 13:22:08.466149 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:22:08.466149 n-d-861076-2 devstack@n-api.service[120932]: {"hw:cpu_policy": "shared"} Oct 12 13:22:08.466149 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:22:08.466149 n-d-861076-2 devstack@n-api.service[120932]: exception: Request body and URI mismatch Oct 12 13:22:08.467000 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'flavor_id': '396249933', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 12 13:22:08.467000 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:08.467000 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:08.467000 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:08.467000 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:08.467000 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:08.467000 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:08.467000 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:08.467000 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:08.467000 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:08.467000 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:08.467000 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 12 13:22:08.467000 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 12 13:22:08.467000 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 12 13:22:08.467000 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:08.467000 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:08.467000 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:08.467000 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:08.467000 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:08.467000 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:08.468692 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:22:08.468692 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:22:08.468692 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 12 13:22:08.468692 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:08.468692 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9fc0a60b-7d84-488c-9019-5ab3bea26517 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:08.477958 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9fc0a60b-7d84-488c-9019-5ab3bea26517 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/396249933/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.017514 Oct 12 13:22:08.478622 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 78/186] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 12 13:22:08 2022] PUT /compute/v2.1/flavors/396249933/os-extra_specs/hw:numa_nodes => generated 73 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 13:22:08.491943 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0e2b969d-ca08-4bf3-a58b-3b302d79b6a7 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:08.501789 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0e2b969d-ca08-4bf3-a58b-3b302d79b6a7 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] Request method failure captured: Oct 12 13:22:08.501789 n-d-861076-2 devstack@n-api.service[120933]: request: PUT /compute/v2.1/flavors/396249933/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 12 13:22:08.501789 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:08.501789 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:08.501789 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:08.501789 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 49 Oct 12 13:22:08.501789 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:08.501789 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:08.501789 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:08.501789 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:08.501789 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9-fK1g0uRSuPXdLpAAxtO6t0gxrJjvApDEFNjTLeAB6WT5cSV5UaBbjcIiuWJEDIyty-BJtZXnJA5aGTb1QOU1KEkNjMSihIFI1DEzaRRBHWAmfJu43vBgTFlyyu9yfrdA-_NmT7XIf7azsJzhJxhAxCAsxBfOSqA2b83CVKRNDWw Oct 12 13:22:08.501789 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:08.501789 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:08.501789 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:08.501789 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:08.501789 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:08.501789 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:08.501789 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 75e260e6422f404a89e53a64cae2b8e7 Oct 12 13:22:08.501789 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 Oct 12 13:22:08.501789 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:22:08.501789 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:22:08.503504 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/75e260e6422f404a89e53a64cae2b8e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_75e260e6422f404a89e53a64cae2b8e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/75e260e6422f404a89e53a64cae2b8e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/75e260e6422f404a89e53a64cae2b8e7"}]}] Oct 12 13:22:08.503504 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 Oct 12 13:22:08.503504 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 75e260e6422f404a89e53a64cae2b8e7 Oct 12 13:22:08.503504 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 Oct 12 13:22:08.503504 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin Oct 12 13:22:08.503504 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:08.503504 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:08.503504 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 2ad5cd933f3d467b9727f99e087d2e94 Oct 12 13:22:08.503504 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin Oct 12 13:22:08.503504 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:22:08.503504 n-d-861076-2 devstack@n-api.service[120933]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 12 13:22:08.503504 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:22:08.508069 n-d-861076-2 devstack@n-api.service[120933]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 12 13:22:08.508069 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'flavor_id': '396249933', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 12 13:22:08.508069 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:08.508069 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:08.508069 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 13:22:08.508069 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 13:22:08.508069 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 13:22:08.508069 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise error Oct 12 13:22:08.508069 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 12 13:22:08.508069 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:08.508069 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 12 13:22:08.508069 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 13:22:08.508069 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 12 13:22:08.508069 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 12 13:22:08.508069 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 13:22:08.508069 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 12 13:22:08.508069 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 12 13:22:08.508069 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 13:22:08.508069 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:08.508069 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi On instance: Oct 12 13:22:08.508069 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 12 13:22:08.508069 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:08.509809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:08.509809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:08.509809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:08.509809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:08.509809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:08.509809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:08.509809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:08.509809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:08.509809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:08.509809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 13:22:08.509809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 13:22:08.509809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 13:22:08.509809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 13:22:08.509809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 13:22:08.509809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 13:22:08.509809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 12 13:22:08.509809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:08.509809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:08.509809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:08.509809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:08.512696 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:08.512696 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:08.512696 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 13:22:08.512696 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 13:22:08.512696 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 12 13:22:08.512696 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:08.512696 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0e2b969d-ca08-4bf3-a58b-3b302d79b6a7 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:08.512696 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0e2b969d-ca08-4bf3-a58b-3b302d79b6a7 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/396249933/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.018080 Oct 12 13:22:08.512696 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 109/187] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 12 13:22:08 2022] PUT /compute/v2.1/flavors/396249933/os-extra_specs/hw:numa_nodes => generated 117 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:22:08.518511 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-26d80544-f3fa-4904-bd97-c0a9e4bec422 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:08.637715 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-26d80544-f3fa-4904-bd97-c0a9e4bec422 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/396249933" status: 202 len: 0 microversion: 2.1 time: 0.127552 Oct 12 13:22:08.640954 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 79/188] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 12 13:22:08 2022] DELETE /compute/v2.1/flavors/396249933 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:22:08.647246 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-48a84b5f-e974-4814-b1c0-a3f2df368f1f tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:08.666840 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-48a84b5f-e974-4814-b1c0-a3f2df368f1f tempest-FlavorsExtraSpecsNegativeTestJSON-314852172 tempest-FlavorsExtraSpecsNegativeTestJSON-314852172-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023341 Oct 12 13:22:08.667610 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 110/189] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:22:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:22:08.689418 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0528ed62-4a3d-4a94-b0b3-ba7aa8e9f27d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:08.690033 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0528ed62-4a3d-4a94-b0b3-ba7aa8e9f27d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:08.698157 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0528ed62-4a3d-4a94-b0b3-ba7aa8e9f27d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:08.698847 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0528ed62-4a3d-4a94-b0b3-ba7aa8e9f27d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:08.699496 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0528ed62-4a3d-4a94-b0b3-ba7aa8e9f27d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:08.700213 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0528ed62-4a3d-4a94-b0b3-ba7aa8e9f27d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:08.700672 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0528ed62-4a3d-4a94-b0b3-ba7aa8e9f27d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:08.701134 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0528ed62-4a3d-4a94-b0b3-ba7aa8e9f27d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:08.823316 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a31becd6-3e8b-4fe2-86a2-7ef657d41a48 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:08.824282 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a31becd6-3e8b-4fe2-86a2-7ef657d41a48 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:08.832457 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a31becd6-3e8b-4fe2-86a2-7ef657d41a48 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:08.833221 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a31becd6-3e8b-4fe2-86a2-7ef657d41a48 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:08.833810 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a31becd6-3e8b-4fe2-86a2-7ef657d41a48 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:08.834667 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a31becd6-3e8b-4fe2-86a2-7ef657d41a48 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:08.835271 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a31becd6-3e8b-4fe2-86a2-7ef657d41a48 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:08.835855 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a31becd6-3e8b-4fe2-86a2-7ef657d41a48 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:08.952374 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-0528ed62-4a3d-4a94-b0b3-ba7aa8e9f27d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:08.961880 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-0528ed62-4a3d-4a94-b0b3-ba7aa8e9f27d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:08.966588 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-0528ed62-4a3d-4a94-b0b3-ba7aa8e9f27d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:08.979052 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0528ed62-4a3d-4a94-b0b3-ba7aa8e9f27d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1363 microversion: 2.75 time: 0.294161 Oct 12 13:22:08.979696 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 80/190] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:08 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:09.042385 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a31becd6-3e8b-4fe2-86a2-7ef657d41a48 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbfb915900c442c0999a39440a8228fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a760f270b741faa8363f5142561aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:09.057545 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a31becd6-3e8b-4fe2-86a2-7ef657d41a48 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1338 microversion: 2.1 time: 0.238357 Oct 12 13:22:09.058852 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 111/191] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:08 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1338 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:22:10.011933 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-160c7a30-3af7-43e3-bb63-3ecee98d6465 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:10.013822 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-160c7a30-3af7-43e3-bb63-3ecee98d6465 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:10.017018 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:10.022151 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-160c7a30-3af7-43e3-bb63-3ecee98d6465 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:10.022807 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-160c7a30-3af7-43e3-bb63-3ecee98d6465 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:10.023553 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-160c7a30-3af7-43e3-bb63-3ecee98d6465 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:10.025757 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-160c7a30-3af7-43e3-bb63-3ecee98d6465 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:10.025757 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-160c7a30-3af7-43e3-bb63-3ecee98d6465 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:10.025757 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-160c7a30-3af7-43e3-bb63-3ecee98d6465 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:10.120089 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-160c7a30-3af7-43e3-bb63-3ecee98d6465 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:10.128535 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-160c7a30-3af7-43e3-bb63-3ecee98d6465 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:10.130888 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-160c7a30-3af7-43e3-bb63-3ecee98d6465 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:10.136321 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-160c7a30-3af7-43e3-bb63-3ecee98d6465 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1411 microversion: 2.75 time: 0.128617 Oct 12 13:22:10.149071 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 81/192] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:10 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1411 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:10.152723 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-160c7a30-3af7-43e3-bb63-3ecee98d6465 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:10.156277 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-160c7a30-3af7-43e3-bb63-3ecee98d6465 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002662 Oct 12 13:22:10.157922 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 82/193] 10.222.0.52 () {56 vars in 886 bytes} [Wed Oct 12 13:22:10 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 12 13:22:10.167173 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-26fd2179-64b6-4711-880d-4578c74621ba tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:10.168114 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-26fd2179-64b6-4711-880d-4578c74621ba tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:10.175413 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:DELETE=9 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:10.177399 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-26fd2179-64b6-4711-880d-4578c74621ba tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:10.178119 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-26fd2179-64b6-4711-880d-4578c74621ba tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:10.178715 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-26fd2179-64b6-4711-880d-4578c74621ba tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:10.180092 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-26fd2179-64b6-4711-880d-4578c74621ba tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:10.180849 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-26fd2179-64b6-4711-880d-4578c74621ba tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:10.181565 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-26fd2179-64b6-4711-880d-4578c74621ba tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:10.318333 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-df78b049-18b6-4cbc-a1b3-26bfda0f91ba req-021a433a-2ed4-4a91-8f98-3d5ad3ea9277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a10a32a-d01d-4530-a93e-66f425a5bd06", "name": "network-vif-plugged", "status": "completed", "tag": "2592e3cd-ac7a-4563-b93f-98436307c44f"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:10.341396 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-df78b049-18b6-4cbc-a1b3-26bfda0f91ba req-021a433a-2ed4-4a91-8f98-3d5ad3ea9277 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:10.341396 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-df78b049-18b6-4cbc-a1b3-26bfda0f91ba req-021a433a-2ed4-4a91-8f98-3d5ad3ea9277 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:10.345762 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-df78b049-18b6-4cbc-a1b3-26bfda0f91ba req-021a433a-2ed4-4a91-8f98-3d5ad3ea9277 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:10.394147 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-df78b049-18b6-4cbc-a1b3-26bfda0f91ba req-021a433a-2ed4-4a91-8f98-3d5ad3ea9277 service nova] Creating event network-vif-plugged:2592e3cd-ac7a-4563-b93f-98436307c44f for instance 9a10a32a-d01d-4530-a93e-66f425a5bd06 on n-h1-861076-2 Oct 12 13:22:10.394301 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-df78b049-18b6-4cbc-a1b3-26bfda0f91ba req-021a433a-2ed4-4a91-8f98-3d5ad3ea9277 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120933) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 13:22:10.395762 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-df78b049-18b6-4cbc-a1b3-26bfda0f91ba req-021a433a-2ed4-4a91-8f98-3d5ad3ea9277 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120933) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 13:22:10.402110 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1044447d-6efb-4b37-a0bd-1854eb3b707a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:10.402743 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1044447d-6efb-4b37-a0bd-1854eb3b707a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:10.403349 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1044447d-6efb-4b37-a0bd-1854eb3b707a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:10.404443 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1044447d-6efb-4b37-a0bd-1854eb3b707a None None] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:10.405207 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1044447d-6efb-4b37-a0bd-1854eb3b707a None None] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:10.405758 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1044447d-6efb-4b37-a0bd-1854eb3b707a None None] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:10.413269 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-26fd2179-64b6-4711-880d-4578c74621ba tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbfb915900c442c0999a39440a8228fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a760f270b741faa8363f5142561aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:10.417820 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.compute.rpcapi [None req-1044447d-6efb-4b37-a0bd-1854eb3b707a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 12 13:22:10.421941 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1044447d-6efb-4b37-a0bd-1854eb3b707a None None] Releasing lock "compute-rpcapi-router" {{(pid=120933) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 13:22:10.427111 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-26fd2179-64b6-4711-880d-4578c74621ba tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1338 microversion: 2.1 time: 0.266332 Oct 12 13:22:10.439990 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 83/194] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:10 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1338 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:22:10.456946 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1044447d-6efb-4b37-a0bd-1854eb3b707a None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.428181 Oct 12 13:22:10.457931 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 112/195] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:10.630830 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fefaad1c-0e2d-43e6-867b-f7f43a7b4dc5 tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-808265107", "ram": 512, "vcpus": 1, "disk": 10, "id": 2013078934, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:10.738433 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fefaad1c-0e2d-43e6-867b-f7f43a7b4dc5 tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.188210 Oct 12 13:22:10.739184 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 84/196] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:22:10 2022] POST /compute/v2.1/flavors => generated 415 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:22:10.765869 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-aff983ed-2b86-4132-8feb-19081923e9dc tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:10.890390 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-aff983ed-2b86-4132-8feb-19081923e9dc tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/2013078934/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.140311 Oct 12 13:22:10.892042 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 113/197] 10.222.0.52 () {60 vars in 1224 bytes} [Wed Oct 12 13:22:10 2022] POST /compute/v2.1/flavors/2013078934/os-extra_specs => generated 66 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:22:11.167504 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b06376a3-0039-4cb7-919e-517571cfb876 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:11.170921 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-b06376a3-0039-4cb7-919e-517571cfb876 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:11.178777 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b06376a3-0039-4cb7-919e-517571cfb876 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:11.179466 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b06376a3-0039-4cb7-919e-517571cfb876 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:11.180329 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b06376a3-0039-4cb7-919e-517571cfb876 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:11.181402 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b06376a3-0039-4cb7-919e-517571cfb876 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:11.182017 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b06376a3-0039-4cb7-919e-517571cfb876 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:11.182672 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b06376a3-0039-4cb7-919e-517571cfb876 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:11.213499 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6223ac79-cf78-4320-9f75-15b2ff92b391 tempest-FlavorsExtraSpecsTestJSON-867407877 tempest-FlavorsExtraSpecsTestJSON-867407877-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:11.267697 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6223ac79-cf78-4320-9f75-15b2ff92b391 tempest-FlavorsExtraSpecsTestJSON-867407877 tempest-FlavorsExtraSpecsTestJSON-867407877-project] 10.222.0.52 "GET /compute/v2.1/flavors/2013078934/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.368440 Oct 12 13:22:11.277034 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 85/198] 10.222.0.52 () {58 vars in 1203 bytes} [Wed Oct 12 13:22:10 2022] GET /compute/v2.1/flavors/2013078934/os-extra_specs => generated 66 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:22:11.291105 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ab49785c-98bb-4051-9477-c7b8984c171e tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:11.373225 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ab49785c-98bb-4051-9477-c7b8984c171e tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/2013078934/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.094641 Oct 12 13:22:11.375601 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 86/199] 10.222.0.52 () {60 vars in 1224 bytes} [Wed Oct 12 13:22:11 2022] POST /compute/v2.1/flavors/2013078934/os-extra_specs => generated 66 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:22:11.386617 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fd1ed206-fab5-458b-9dd5-3a812aea6ec8 tempest-FlavorsExtraSpecsTestJSON-867407877 tempest-FlavorsExtraSpecsTestJSON-867407877-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:11.393560 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b06376a3-0039-4cb7-919e-517571cfb876 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:11.464574 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fd1ed206-fab5-458b-9dd5-3a812aea6ec8 tempest-FlavorsExtraSpecsTestJSON-867407877 tempest-FlavorsExtraSpecsTestJSON-867407877-project] 10.222.0.52 "GET /compute/v2.1/flavors/2013078934/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.071248 Oct 12 13:22:11.465623 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 87/200] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:22:11 2022] GET /compute/v2.1/flavors/2013078934/os-extra_specs/hw:numa_nodes => generated 22 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 13:22:11.480178 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b06376a3-0039-4cb7-919e-517571cfb876 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:11.481420 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8c058bd0-093a-4e98-95a3-02a9d5e2528c tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:11.486821 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8c058bd0-093a-4e98-95a3-02a9d5e2528c tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:11.492412 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b06376a3-0039-4cb7-919e-517571cfb876 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:11.502370 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8c058bd0-093a-4e98-95a3-02a9d5e2528c tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:11.509164 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8c058bd0-093a-4e98-95a3-02a9d5e2528c tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:11.509533 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b06376a3-0039-4cb7-919e-517571cfb876 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1417 microversion: 2.75 time: 0.345785 Oct 12 13:22:11.510131 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 114/201] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:11 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1417 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:11.512933 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8c058bd0-093a-4e98-95a3-02a9d5e2528c tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:11.512933 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8c058bd0-093a-4e98-95a3-02a9d5e2528c tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:11.516740 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8c058bd0-093a-4e98-95a3-02a9d5e2528c tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:11.521240 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8c058bd0-093a-4e98-95a3-02a9d5e2528c tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:11.527034 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-529d30f7-db69-4b64-b14e-770e37abe958 tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:11.601852 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-529d30f7-db69-4b64-b14e-770e37abe958 tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/2013078934/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.088713 Oct 12 13:22:11.610022 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 115/202] 10.222.0.52 () {60 vars in 1224 bytes} [Wed Oct 12 13:22:11 2022] POST /compute/v2.1/flavors/2013078934/os-extra_specs => generated 66 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:22:11.615899 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-37bbde35-7ae8-4fff-868c-3918ffcefd7e tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:11.634060 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-37bbde35-7ae8-4fff-868c-3918ffcefd7e tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/2013078934/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.022409 Oct 12 13:22:11.641798 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 116/203] 10.222.0.52 () {58 vars in 1203 bytes} [Wed Oct 12 13:22:11 2022] GET /compute/v2.1/flavors/2013078934/os-extra_specs => generated 66 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:22:11.648356 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fa2dc8e9-6933-40eb-90aa-cc07a5bd572d tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:11.813820 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fa2dc8e9-6933-40eb-90aa-cc07a5bd572d tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/2013078934/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.169690 Oct 12 13:22:11.814776 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 117/204] 10.222.0.52 () {60 vars in 1265 bytes} [Wed Oct 12 13:22:11 2022] PUT /compute/v2.1/flavors/2013078934/os-extra_specs/hw:numa_nodes => generated 22 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:22:11.830664 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-53649a50-912c-4ed3-9d89-bcabe2d47d02 tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:11.854822 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-53649a50-912c-4ed3-9d89-bcabe2d47d02 tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/2013078934/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.022923 Oct 12 13:22:11.855960 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 118/205] 10.222.0.52 () {58 vars in 1203 bytes} [Wed Oct 12 13:22:11 2022] GET /compute/v2.1/flavors/2013078934/os-extra_specs => generated 66 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:22:11.867855 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c5cae035-dd7b-4333-a69f-064bb39d5a0d tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:11.934148 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8c058bd0-093a-4e98-95a3-02a9d5e2528c tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbfb915900c442c0999a39440a8228fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a760f270b741faa8363f5142561aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:11.943507 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8c058bd0-093a-4e98-95a3-02a9d5e2528c tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1338 microversion: 2.1 time: 0.476805 Oct 12 13:22:11.944096 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 88/206] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:11 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1338 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:22:11.997732 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c5cae035-dd7b-4333-a69f-064bb39d5a0d tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/2013078934/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.130976 Oct 12 13:22:12.002724 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3bc9bf04-975a-48b5-ba64-7c13379b384b tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:12.004412 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 119/207] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 12 13:22:11 2022] DELETE /compute/v2.1/flavors/2013078934/os-extra_specs/hw:numa_nodes => generated 0 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 13:22:12.093004 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3bc9bf04-975a-48b5-ba64-7c13379b384b tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/2013078934/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.094007 Oct 12 13:22:12.094031 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 89/208] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 12 13:22:11 2022] DELETE /compute/v2.1/flavors/2013078934/os-extra_specs/hw:cpu_policy => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 12 13:22:12.103355 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-bdf1b609-f38b-4811-a3c9-5fe73a99a649 tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:12.113606 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-bdf1b609-f38b-4811-a3c9-5fe73a99a649 tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/2013078934/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015226 Oct 12 13:22:12.117703 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 120/209] 10.222.0.52 () {58 vars in 1203 bytes} [Wed Oct 12 13:22:12 2022] GET /compute/v2.1/flavors/2013078934/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:22:12.128064 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0a4430df-71fe-49b3-9f1c-92b17f042f06 tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:12.234799 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0a4430df-71fe-49b3-9f1c-92b17f042f06 tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/2013078934" status: 202 len: 0 microversion: 2.1 time: 0.111162 Oct 12 13:22:12.236660 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 90/210] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 12 13:22:12 2022] DELETE /compute/v2.1/flavors/2013078934 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:22:12.247767 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-769bc006-3230-46a9-8ce7-d3fc16fdfd6a tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:12.308661 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-769bc006-3230-46a9-8ce7-d3fc16fdfd6a tempest-FlavorsExtraSpecsTestJSON-1759379593 tempest-FlavorsExtraSpecsTestJSON-1759379593-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068081 Oct 12 13:22:12.309829 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 121/211] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:22:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:22:12.545469 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b06943fa-5331-4240-9592-eb6e0906d810 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:12.546354 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b06943fa-5331-4240-9592-eb6e0906d810 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:12.553814 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b06943fa-5331-4240-9592-eb6e0906d810 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:12.554361 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b06943fa-5331-4240-9592-eb6e0906d810 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:12.554795 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b06943fa-5331-4240-9592-eb6e0906d810 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:12.555577 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b06943fa-5331-4240-9592-eb6e0906d810 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:12.556218 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b06943fa-5331-4240-9592-eb6e0906d810 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:12.569551 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b06943fa-5331-4240-9592-eb6e0906d810 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:12.688093 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-b06943fa-5331-4240-9592-eb6e0906d810 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:12.706684 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-b06943fa-5331-4240-9592-eb6e0906d810 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:12.710242 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-b06943fa-5331-4240-9592-eb6e0906d810 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:12.742949 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b06943fa-5331-4240-9592-eb6e0906d810 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1417 microversion: 2.75 time: 0.204589 Oct 12 13:22:12.743550 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 91/212] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:12 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1417 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:12.967337 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-854df409-2463-48eb-9c04-f46fced4c8aa tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:12.968271 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-854df409-2463-48eb-9c04-f46fced4c8aa tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:12.994918 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-854df409-2463-48eb-9c04-f46fced4c8aa tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:12.996459 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-854df409-2463-48eb-9c04-f46fced4c8aa tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:12.996957 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-854df409-2463-48eb-9c04-f46fced4c8aa tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:12.998326 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-854df409-2463-48eb-9c04-f46fced4c8aa tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:12.998792 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-854df409-2463-48eb-9c04-f46fced4c8aa tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:12.999219 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-854df409-2463-48eb-9c04-f46fced4c8aa tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:13.283008 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-854df409-2463-48eb-9c04-f46fced4c8aa tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbfb915900c442c0999a39440a8228fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a760f270b741faa8363f5142561aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:13.296391 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-854df409-2463-48eb-9c04-f46fced4c8aa tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1338 microversion: 2.1 time: 0.333136 Oct 12 13:22:13.297378 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 122/213] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:12 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1338 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:22:13.772625 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8f6dbc32-41d6-48b4-bb51-b08a30a64a8d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:13.773279 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8f6dbc32-41d6-48b4-bb51-b08a30a64a8d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:13.781340 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8f6dbc32-41d6-48b4-bb51-b08a30a64a8d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:13.781844 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8f6dbc32-41d6-48b4-bb51-b08a30a64a8d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:13.782307 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8f6dbc32-41d6-48b4-bb51-b08a30a64a8d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:13.783169 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8f6dbc32-41d6-48b4-bb51-b08a30a64a8d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:13.783776 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8f6dbc32-41d6-48b4-bb51-b08a30a64a8d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:13.784206 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8f6dbc32-41d6-48b4-bb51-b08a30a64a8d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:14.131994 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8f6dbc32-41d6-48b4-bb51-b08a30a64a8d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:14.141668 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8f6dbc32-41d6-48b4-bb51-b08a30a64a8d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:14.145004 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8f6dbc32-41d6-48b4-bb51-b08a30a64a8d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:14.158312 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8f6dbc32-41d6-48b4-bb51-b08a30a64a8d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1417 microversion: 2.75 time: 0.389772 Oct 12 13:22:14.172942 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 92/214] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:13 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1417 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:14.319688 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2c1c5fa5-ffdf-4483-8b7f-beffbd922578 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:14.320264 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2c1c5fa5-ffdf-4483-8b7f-beffbd922578 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:14.327295 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c1c5fa5-ffdf-4483-8b7f-beffbd922578 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:14.327777 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c1c5fa5-ffdf-4483-8b7f-beffbd922578 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:14.329031 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c1c5fa5-ffdf-4483-8b7f-beffbd922578 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:14.329923 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c1c5fa5-ffdf-4483-8b7f-beffbd922578 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:14.330600 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c1c5fa5-ffdf-4483-8b7f-beffbd922578 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:14.331253 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c1c5fa5-ffdf-4483-8b7f-beffbd922578 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:14.560683 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-2c1c5fa5-ffdf-4483-8b7f-beffbd922578 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbfb915900c442c0999a39440a8228fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a760f270b741faa8363f5142561aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:14.568796 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2c1c5fa5-ffdf-4483-8b7f-beffbd922578 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1488 microversion: 2.1 time: 0.253586 Oct 12 13:22:14.575126 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 93/215] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:14 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1488 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:22:14.601267 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-72b929db-4051-49f9-9f86-07dc2af31643 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:14.602235 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-72b929db-4051-49f9-9f86-07dc2af31643 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:14.609379 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72b929db-4051-49f9-9f86-07dc2af31643 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:14.610246 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72b929db-4051-49f9-9f86-07dc2af31643 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:14.610942 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72b929db-4051-49f9-9f86-07dc2af31643 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:14.614583 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72b929db-4051-49f9-9f86-07dc2af31643 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:14.614583 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72b929db-4051-49f9-9f86-07dc2af31643 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:14.614583 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72b929db-4051-49f9-9f86-07dc2af31643 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:14.630569 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5719ce8a-65e2-4465-af95-9c6be2ce72d4 tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-484792210", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "f8b19b17-bd23-4f27-bfe1-281ccaba4d85"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:14.750406 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-5719ce8a-65e2-4465-af95-9c6be2ce72d4 tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] validate_networks() for [('f8b19b17-bd23-4f27-bfe1-281ccaba4d85', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:22:15.595264 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-72b929db-4051-49f9-9f86-07dc2af31643 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1639 microversion: 2.1 time: 0.999214 Oct 12 13:22:15.599553 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 94/216] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:14 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1639 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:22:15.602187 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-543e6a1e-eecf-4a64-b434-ee412856475c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:15.607215 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-543e6a1e-eecf-4a64-b434-ee412856475c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:15.617784 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-543e6a1e-eecf-4a64-b434-ee412856475c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:15.618280 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-543e6a1e-eecf-4a64-b434-ee412856475c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:15.618722 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-543e6a1e-eecf-4a64-b434-ee412856475c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:15.619453 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-543e6a1e-eecf-4a64-b434-ee412856475c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:15.622967 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-543e6a1e-eecf-4a64-b434-ee412856475c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:15.624371 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-543e6a1e-eecf-4a64-b434-ee412856475c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:15.876588 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-543e6a1e-eecf-4a64-b434-ee412856475c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:15.891995 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-543e6a1e-eecf-4a64-b434-ee412856475c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:15.893468 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-543e6a1e-eecf-4a64-b434-ee412856475c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:15.901118 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-543e6a1e-eecf-4a64-b434-ee412856475c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1417 microversion: 2.75 time: 0.301101 Oct 12 13:22:15.901118 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 95/217] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:15 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1417 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:15.904883 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bbde44ed-fcd1-43c9-9a14-a3394762294d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:15.906361 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-bbde44ed-fcd1-43c9-9a14-a3394762294d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:15.912282 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bbde44ed-fcd1-43c9-9a14-a3394762294d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:15.912876 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bbde44ed-fcd1-43c9-9a14-a3394762294d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:15.913572 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bbde44ed-fcd1-43c9-9a14-a3394762294d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:15.914465 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bbde44ed-fcd1-43c9-9a14-a3394762294d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:15.918546 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bbde44ed-fcd1-43c9-9a14-a3394762294d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:15.919095 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bbde44ed-fcd1-43c9-9a14-a3394762294d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:15.959535 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-bbde44ed-fcd1-43c9-9a14-a3394762294d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:22:15.996512 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-5719ce8a-65e2-4465-af95-9c6be2ce72d4 tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c5b0873f-10ff-4382-b506-89c0935e86ce) Oct 12 13:22:15.996512 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:15.996512 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:15.996512 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:15.996512 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:15.996512 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:15.996512 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:15.996512 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:15.996512 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:15.996512 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:15.996512 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:22:15.996512 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:22:15.996512 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:22:15.996512 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:22:15.996512 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:22:15.996512 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:22:15.998026 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:22:15.998026 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:22:15.998026 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:22:15.998026 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:22:15.998026 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:22:15.998026 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:22:15.998026 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:22:15.998026 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:22:15.998026 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:22:15.998026 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:22:15.998026 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:22:15.998026 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:15.998026 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:15.998026 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:22:15.998026 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:22:15.998026 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:15.998026 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:15.998026 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:22:15.999259 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:22:15.999259 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:15.999259 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:15.999259 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:22:15.999259 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:22:15.999259 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:15.999259 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:15.999259 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:22:15.999259 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:22:15.999259 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:22:15.999259 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:22:15.999259 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:22:15.999259 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:22:15.999259 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:22:15.999259 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:22:15.999259 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:22:15.999259 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:22:15.999259 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:22:16.001248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:22:16.001248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:22:16.001248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:22:16.001248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:22:16.001248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:22:16.001248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:22:16.001248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:22:16.001248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:22:16.001248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:22:16.001248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:22:16.001248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:22:16.001248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:22:16.001248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:22:16.001248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:22:16.001248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:22:16.002328 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c5b0873f-10ff-4382-b506-89c0935e86ce) Oct 12 13:22:16.002328 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:16.003957 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-5719ce8a-65e2-4465-af95-9c6be2ce72d4 tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:22:16.003957 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:22:16.008456 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5719ce8a-65e2-4465-af95-9c6be2ce72d4 tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] Request method failure captured: Oct 12 13:22:16.008456 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:22:16.008456 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:16.008456 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:16.008456 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:16.008456 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 215 Oct 12 13:22:16.008456 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:16.008456 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:16.008456 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:16.008456 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:16.008456 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr94e9Lovd_6wKxNl_JdjNknQjnVEEV0iEB1Wv4X1GnAYah2d6SLZ1cdu5yb_P2VD3YueOK5el--I7xgrTV1Ivko28VuoL8DV3x4iyalWBU8ProRzP7gH_7Rd_edn-YZLsXIHxcHBsLHvinvny9pvZo6yqBaLRm_O6GdA_XZgCu9sR8 Oct 12 13:22:16.008456 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:16.008456 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:16.008456 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:16.008456 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:16.008456 n-d-861076-2 devstack@n-api.service[120933]: X-Openstack-Nova-Api-Version: 2.25 Oct 12 13:22:16.008456 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:16.008456 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:16.008456 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: b6be2b28cd33472bbdb04d6db1526921 Oct 12 13:22:16.008456 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-579442985 Oct 12 13:22:16.008456 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:22:16.008456 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:22:16.020292 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b6be2b28cd33472bbdb04d6db1526921"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b6be2b28cd33472bbdb04d6db1526921"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b6be2b28cd33472bbdb04d6db1526921"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b6be2b28cd33472bbdb04d6db1526921"}]}] Oct 12 13:22:16.020292 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-579442985 Oct 12 13:22:16.020292 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: b6be2b28cd33472bbdb04d6db1526921 Oct 12 13:22:16.020292 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-579442985 Oct 12 13:22:16.020292 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-LiveAutoBlockMigrationV225Test-579442985-project Oct 12 13:22:16.020292 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:16.020292 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:16.020292 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: fd24f238584e443cbb549e4799eb5c4f Oct 12 13:22:16.020292 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-579442985-project Oct 12 13:22:16.020292 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:22:16.020292 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-484792210", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "f8b19b17-bd23-4f27-bfe1-281ccaba4d85"}]}} Oct 12 13:22:16.021016 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:22:16.021016 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:22:16.021016 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:22:16.021016 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-LiveAutoBlockMigrationV225Test-server-484792210', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': 'f8b19b17-bd23-4f27-bfe1-281ccaba4d85'}]}}} Oct 12 13:22:16.021016 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:16.021016 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:16.021016 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:16.021016 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:16.021016 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:16.021016 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:16.021016 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:16.021016 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:16.021016 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:16.021016 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:16.021016 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:22:16.021016 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:22:16.021016 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:22:16.021016 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:22:16.021016 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:22:16.022714 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:22:16.022714 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:22:16.022714 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:22:16.022714 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:22:16.022714 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:22:16.022714 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:22:16.022714 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:22:16.022714 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:22:16.022714 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:22:16.022714 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:22:16.022714 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:22:16.022714 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:22:16.022714 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:16.022714 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:16.022714 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:22:16.022714 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:22:16.022714 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:16.022714 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:16.023664 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:22:16.023664 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:22:16.023664 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:16.023664 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:16.023664 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:22:16.023664 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:22:16.023664 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:16.023664 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:16.023664 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:22:16.023664 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:22:16.023664 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:22:16.023664 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:22:16.023664 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:22:16.023664 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:22:16.023664 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:22:16.023664 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:22:16.023664 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:22:16.023664 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:22:16.024589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:22:16.024589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:22:16.024589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:22:16.024589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:22:16.024589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:22:16.024589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:22:16.024589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:22:16.024589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:22:16.024589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:22:16.024589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:22:16.024589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:22:16.024589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:22:16.024589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:22:16.024589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:22:16.024589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:22:16.024589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:22:16.025730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c5b0873f-10ff-4382-b506-89c0935e86ce) Oct 12 13:22:16.025730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:16.025730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:16.025730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:16.025730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:16.025730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:16.025730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:16.025730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:16.025730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:16.025730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:22:16.025730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:22:16.025730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:22:16.025730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:16.025730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:16.025730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:16.025730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:16.025730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:16.025730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:16.025730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:16.026966 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:22:16.026966 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:22:16.026966 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:22:16.026966 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:16.026966 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:16.026966 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5719ce8a-65e2-4465-af95-9c6be2ce72d4 tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:22:16.026966 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:16.026966 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5719ce8a-65e2-4465-af95-9c6be2ce72d4 tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.25 time: 2.202223 Oct 12 13:22:16.026966 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 123/218] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 12 13:22:13 2022] POST /compute/v2.1/servers => generated 214 bytes in 2204 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Oct 12 13:22:16.302010 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b693eac6-72e2-4496-81db-587ab08e9faf tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1849799715", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "f8b19b17-bd23-4f27-bfe1-281ccaba4d85"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:16.393864 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-b693eac6-72e2-4496-81db-587ab08e9faf tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] validate_networks() for [('f8b19b17-bd23-4f27-bfe1-281ccaba4d85', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:22:16.426651 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:16.490647 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bbde44ed-fcd1-43c9-9a14-a3394762294d tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 204 len: 0 microversion: 2.1 time: 0.589263 Oct 12 13:22:16.491813 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 96/219] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:22:15 2022] DELETE /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:22:16.502233 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cb5512ea-2efe-41c9-a985-decc0fa64a2e tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:16.503600 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cb5512ea-2efe-41c9-a985-decc0fa64a2e tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:16.521127 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cb5512ea-2efe-41c9-a985-decc0fa64a2e tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:16.523182 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cb5512ea-2efe-41c9-a985-decc0fa64a2e tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:16.533715 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cb5512ea-2efe-41c9-a985-decc0fa64a2e tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:16.534605 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cb5512ea-2efe-41c9-a985-decc0fa64a2e tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:16.535259 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cb5512ea-2efe-41c9-a985-decc0fa64a2e tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:16.535791 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cb5512ea-2efe-41c9-a985-decc0fa64a2e tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:16.813016 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-cb5512ea-2efe-41c9-a985-decc0fa64a2e tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbfb915900c442c0999a39440a8228fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a760f270b741faa8363f5142561aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:16.823016 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cb5512ea-2efe-41c9-a985-decc0fa64a2e tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1494 microversion: 2.1 time: 0.325208 Oct 12 13:22:16.826043 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 97/220] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:16 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1494 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:22:16.938402 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5b5ffb81-ba94-4631-9b73-9eca17b9e1d9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:16.939025 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5b5ffb81-ba94-4631-9b73-9eca17b9e1d9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:16.945785 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5b5ffb81-ba94-4631-9b73-9eca17b9e1d9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:16.946285 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5b5ffb81-ba94-4631-9b73-9eca17b9e1d9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:16.946718 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5b5ffb81-ba94-4631-9b73-9eca17b9e1d9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:16.947612 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5b5ffb81-ba94-4631-9b73-9eca17b9e1d9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:16.948063 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5b5ffb81-ba94-4631-9b73-9eca17b9e1d9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:16.948481 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5b5ffb81-ba94-4631-9b73-9eca17b9e1d9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:16.951457 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:17.015679 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-5b5ffb81-ba94-4631-9b73-9eca17b9e1d9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:17.026065 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-5b5ffb81-ba94-4631-9b73-9eca17b9e1d9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:17.027766 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-5b5ffb81-ba94-4631-9b73-9eca17b9e1d9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:17.035180 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5b5ffb81-ba94-4631-9b73-9eca17b9e1d9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1417 microversion: 2.75 time: 0.101584 Oct 12 13:22:17.036117 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 98/221] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:16 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1417 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:22:17.072288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-b693eac6-72e2-4496-81db-587ab08e9faf tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ba909473-627b-4e72-a3a7-0450dad13add) Oct 12 13:22:17.072288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:17.072288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:17.072288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:17.072288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:17.072288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:17.072288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:17.072288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:17.072288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:17.072288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:17.072288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:22:17.072288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:22:17.072288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:22:17.072288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:22:17.072288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:22:17.072288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:22:17.073620 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:22:17.073620 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:22:17.073620 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:22:17.073620 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:22:17.073620 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:22:17.073620 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:22:17.073620 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:22:17.073620 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:22:17.073620 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:22:17.073620 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:22:17.073620 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:22:17.073620 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:17.073620 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:17.073620 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:22:17.073620 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:22:17.073620 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:17.073620 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:17.073620 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:22:17.074520 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:22:17.074520 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:17.074520 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:17.074520 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:22:17.074520 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:22:17.074520 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:17.074520 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:17.074520 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:22:17.074520 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:22:17.074520 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:22:17.074520 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:22:17.074520 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:22:17.074520 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:22:17.074520 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:22:17.074520 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:22:17.074520 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:22:17.074520 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:22:17.074520 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:22:17.075447 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:22:17.075447 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:22:17.075447 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:22:17.075447 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:22:17.075447 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:22:17.075447 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:22:17.075447 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:22:17.075447 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:22:17.075447 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:22:17.075447 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:22:17.075447 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:22:17.075447 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:22:17.075447 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:22:17.075447 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:22:17.075447 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ba909473-627b-4e72-a3a7-0450dad13add) Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-b693eac6-72e2-4496-81db-587ab08e9faf tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b693eac6-72e2-4496-81db-587ab08e9faf tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] Request method failure captured: Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 216 Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr94e9Lovd_6wKxNl_JdjNknQjnVEEV0iEB1Wv4X1GnAYah2d6SLZ1cdu5yb_P2VD3YueOK5el--I7xgrTV1Ivko28VuoL8DV3x4iyalWBU8ProRzP7gH_7Rd_edn-YZLsXIHxcHBsLHvinvny9pvZo6yqBaLRm_O6GdA_XZgCu9sR8 Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: X-Openstack-Nova-Api-Version: 2.25 Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: b6be2b28cd33472bbdb04d6db1526921 Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-579442985 Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:22:17.076223 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:22:17.086706 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b6be2b28cd33472bbdb04d6db1526921"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b6be2b28cd33472bbdb04d6db1526921"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b6be2b28cd33472bbdb04d6db1526921"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b6be2b28cd33472bbdb04d6db1526921"}]}] Oct 12 13:22:17.086706 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-579442985 Oct 12 13:22:17.086706 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: b6be2b28cd33472bbdb04d6db1526921 Oct 12 13:22:17.086706 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-579442985 Oct 12 13:22:17.086706 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-LiveAutoBlockMigrationV225Test-579442985-project Oct 12 13:22:17.086706 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:17.086706 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:17.086706 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: fd24f238584e443cbb549e4799eb5c4f Oct 12 13:22:17.086706 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-579442985-project Oct 12 13:22:17.086706 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:22:17.086706 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1849799715", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "f8b19b17-bd23-4f27-bfe1-281ccaba4d85"}]}} Oct 12 13:22:17.087448 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:22:17.087448 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:22:17.087448 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:22:17.087448 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-LiveAutoBlockMigrationV225Test-server-1849799715', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': 'f8b19b17-bd23-4f27-bfe1-281ccaba4d85'}]}}} Oct 12 13:22:17.087448 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:17.087448 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:17.087448 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:17.087448 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:17.087448 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:17.087448 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:17.087448 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:17.087448 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:17.087448 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:17.087448 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:17.087448 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:22:17.087448 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:22:17.087448 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:22:17.087448 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:22:17.087448 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:22:17.089028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:22:17.089028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:22:17.089028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:22:17.089028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:22:17.089028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:22:17.089028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:22:17.089028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:22:17.089028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:22:17.089028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:22:17.089028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:22:17.089028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:22:17.089028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:22:17.089028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:17.089028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:17.089028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:22:17.089028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:22:17.089028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:17.089028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:17.090257 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:22:17.090257 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:22:17.090257 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:17.090257 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:17.090257 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:22:17.090257 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:22:17.090257 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:17.090257 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:17.090257 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:22:17.090257 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:22:17.090257 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:22:17.090257 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:22:17.090257 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:22:17.090257 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:22:17.090257 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:22:17.090257 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:22:17.090257 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:22:17.090257 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:22:17.091429 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:22:17.091429 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:22:17.091429 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:22:17.091429 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:22:17.091429 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:22:17.091429 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:22:17.091429 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:22:17.091429 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:22:17.091429 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:22:17.091429 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:22:17.091429 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:22:17.091429 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:22:17.091429 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:22:17.091429 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:22:17.091429 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:22:17.091429 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:22:17.092445 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ba909473-627b-4e72-a3a7-0450dad13add) Oct 12 13:22:17.092445 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:17.092445 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:17.092445 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:17.092445 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:17.092445 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:17.092445 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:17.092445 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:17.092445 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:17.092445 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:22:17.092445 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:22:17.092445 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:22:17.092445 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:17.092445 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:17.092445 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:17.092445 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:17.092445 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:17.092445 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:17.092445 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:17.095474 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:22:17.095474 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:22:17.095474 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:22:17.095474 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:17.095474 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:17.095474 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b693eac6-72e2-4496-81db-587ab08e9faf tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:22:17.095474 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:17.095474 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b693eac6-72e2-4496-81db-587ab08e9faf tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.25 time: 0.790579 Oct 12 13:22:17.095474 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 124/222] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 12 13:22:16 2022] POST /compute/v2.1/servers => generated 214 bytes in 794 msecs (HTTP/1.1 500) 9 headers in 393 bytes (2 switches on core 0) Oct 12 13:22:17.109125 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-40a3f017-97fd-4657-b24a-84885a3c5dc6 tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] Action: 'create', calling method: .version_select at 0x7f8aa053f550>, body: {"keypair": {"name": "tempest-keypair-1019596395", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVsTUi8bVZKtLPCxh7oVMzsArQa7ZWtZaFVpTOcoKEisPM0aKHA4OCP4EUBHR0R/NkeTlAsOX723/lR+alMVeyZMfCyGK7WcRoA2j2TE1wZnfQB/8dpRr7nBNchqZoY0Q=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:17.145767 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-40a3f017-97fd-4657-b24a-84885a3c5dc6 tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] Getting quotas for project b6be2b28cd33472bbdb04d6db1526921. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:22:17.150778 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-40a3f017-97fd-4657-b24a-84885a3c5dc6 tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] Getting quotas for user fd24f238584e443cbb549e4799eb5c4f and project b6be2b28cd33472bbdb04d6db1526921. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:22:17.287556 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-40a3f017-97fd-4657-b24a-84885a3c5dc6 tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.182864 Oct 12 13:22:17.289955 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 99/223] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Oct 12 13:22:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 186 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 13:22:17.847440 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=10 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:17.852988 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c000f68f-a231-4852-aab4-c76bbc494a80 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:17.854252 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c000f68f-a231-4852-aab4-c76bbc494a80 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:17.862331 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c000f68f-a231-4852-aab4-c76bbc494a80 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:17.863360 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c000f68f-a231-4852-aab4-c76bbc494a80 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:17.864009 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c000f68f-a231-4852-aab4-c76bbc494a80 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:17.864930 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c000f68f-a231-4852-aab4-c76bbc494a80 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:17.865546 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c000f68f-a231-4852-aab4-c76bbc494a80 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:17.865975 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c000f68f-a231-4852-aab4-c76bbc494a80 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:18.017036 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-c000f68f-a231-4852-aab4-c76bbc494a80 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbfb915900c442c0999a39440a8228fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a760f270b741faa8363f5142561aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:18.025024 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c000f68f-a231-4852-aab4-c76bbc494a80 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1494 microversion: 2.1 time: 0.178509 Oct 12 13:22:18.025768 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 125/224] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:17 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1494 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:22:18.063654 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5072ff1f-3425-403d-aa0a-745574d6561b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:18.064264 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5072ff1f-3425-403d-aa0a-745574d6561b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:18.070231 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5072ff1f-3425-403d-aa0a-745574d6561b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:18.070714 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5072ff1f-3425-403d-aa0a-745574d6561b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:18.071692 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5072ff1f-3425-403d-aa0a-745574d6561b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:18.072638 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5072ff1f-3425-403d-aa0a-745574d6561b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:18.073330 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5072ff1f-3425-403d-aa0a-745574d6561b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:18.073962 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5072ff1f-3425-403d-aa0a-745574d6561b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:18.173847 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-5072ff1f-3425-403d-aa0a-745574d6561b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:18.190780 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-5072ff1f-3425-403d-aa0a-745574d6561b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:18.195538 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-5072ff1f-3425-403d-aa0a-745574d6561b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:18.204353 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5072ff1f-3425-403d-aa0a-745574d6561b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1417 microversion: 2.75 time: 0.145180 Oct 12 13:22:18.209148 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 100/225] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:18 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1417 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:18.822611 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-f076832f-3c41-4aee-8c5b-47ec6521d55e req-a25aed45-d153-4df4-baf1-74a33db51c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a10a32a-d01d-4530-a93e-66f425a5bd06", "name": "network-vif-deleted", "tag": "2592e3cd-ac7a-4563-b93f-98436307c44f"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:18.843715 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-f076832f-3c41-4aee-8c5b-47ec6521d55e req-a25aed45-d153-4df4-baf1-74a33db51c35 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:18.844375 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-f076832f-3c41-4aee-8c5b-47ec6521d55e req-a25aed45-d153-4df4-baf1-74a33db51c35 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:18.845004 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-f076832f-3c41-4aee-8c5b-47ec6521d55e req-a25aed45-d153-4df4-baf1-74a33db51c35 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:18.860595 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-f076832f-3c41-4aee-8c5b-47ec6521d55e req-a25aed45-d153-4df4-baf1-74a33db51c35 service nova] Creating event network-vif-deleted:2592e3cd-ac7a-4563-b93f-98436307c44f for instance 9a10a32a-d01d-4530-a93e-66f425a5bd06 on n-h1-861076-2 Oct 12 13:22:18.868256 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-f076832f-3c41-4aee-8c5b-47ec6521d55e req-a25aed45-d153-4df4-baf1-74a33db51c35 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059075 Oct 12 13:22:18.869128 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 126/226] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:19.056086 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-453d7868-0e26-40f3-9c57-8ecbe6abea9b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:19.056779 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-453d7868-0e26-40f3-9c57-8ecbe6abea9b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:19.063436 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-453d7868-0e26-40f3-9c57-8ecbe6abea9b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:19.063889 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-453d7868-0e26-40f3-9c57-8ecbe6abea9b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:19.064364 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-453d7868-0e26-40f3-9c57-8ecbe6abea9b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:19.075511 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-453d7868-0e26-40f3-9c57-8ecbe6abea9b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:19.075511 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-453d7868-0e26-40f3-9c57-8ecbe6abea9b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:19.075511 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-453d7868-0e26-40f3-9c57-8ecbe6abea9b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:19.153596 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-453d7868-0e26-40f3-9c57-8ecbe6abea9b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbfb915900c442c0999a39440a8228fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a760f270b741faa8363f5142561aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:19.164814 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-453d7868-0e26-40f3-9c57-8ecbe6abea9b tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 200 len: 1452 microversion: 2.1 time: 0.112543 Oct 12 13:22:19.166092 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 127/227] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:19 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 1452 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:22:19.242899 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4452b1f7-08ff-4aff-a1a6-3e644f0ef199 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:19.243603 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-4452b1f7-08ff-4aff-a1a6-3e644f0ef199 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:19.250633 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4452b1f7-08ff-4aff-a1a6-3e644f0ef199 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:19.251328 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4452b1f7-08ff-4aff-a1a6-3e644f0ef199 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:19.251961 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4452b1f7-08ff-4aff-a1a6-3e644f0ef199 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:19.252824 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4452b1f7-08ff-4aff-a1a6-3e644f0ef199 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:19.253565 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4452b1f7-08ff-4aff-a1a6-3e644f0ef199 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:19.254345 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4452b1f7-08ff-4aff-a1a6-3e644f0ef199 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:19.335022 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-4452b1f7-08ff-4aff-a1a6-3e644f0ef199 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:19.345019 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-4452b1f7-08ff-4aff-a1a6-3e644f0ef199 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:19.349888 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-4452b1f7-08ff-4aff-a1a6-3e644f0ef199 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:19.352982 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4452b1f7-08ff-4aff-a1a6-3e644f0ef199 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1417 microversion: 2.75 time: 0.114726 Oct 12 13:22:19.353744 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 128/228] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:19 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1417 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:22:19.364563 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-046e2ef5-85e7-4a91-b56a-bd7ab73c4146 tempest-FlavorsV261TestJSON-223587045 tempest-FlavorsV261TestJSON-223587045-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1309297684", "id": 1385427815, "os-flavor-access:is_public": "True"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:19.473657 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-046e2ef5-85e7-4a91-b56a-bd7ab73c4146 tempest-FlavorsV261TestJSON-223587045 tempest-FlavorsV261TestJSON-223587045-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.574826 Oct 12 13:22:19.474313 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 101/229] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 12 13:22:18 2022] POST /compute/v2.1/flavors => generated 468 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:22:19.493715 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-329f1752-94ba-4b12-83fb-efc7a3d3e82e tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] Calling method '.version_select at 0x7f8aa04ef040>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:19.495517 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-329f1752-94ba-4b12-83fb-efc7a3d3e82e tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '0d65cf2a72594038b743ed7967ede1a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0cf8272e59549b787f8dbb8504421a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:19.497766 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-329f1752-94ba-4b12-83fb-efc7a3d3e82e tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] Request method failure captured: Oct 12 13:22:19.497766 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 12 13:22:19.497766 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:19.497766 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:19.497766 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:19.497766 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:22:19.497766 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:19.497766 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:19.497766 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:19.497766 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:19.497766 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr-IvMGmKEpj6YQnEsPnEGZxnyBKibCGzcvv4K7qmJ3xzRgBf3q1gG3E90OPaSV9rNEdZTH4F8RcP1ZqLsV3gfnDT-fxqsz4PcblY5JUbBjWmjnhciZjKgaRwZX8QSrGE2LcunBXR1h8ta844TKEpdHvftdpgemJnClPP6V67lGJbUk Oct 12 13:22:19.497766 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:19.497766 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:19.497766 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:19.497766 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:19.497766 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:19.497766 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:19.497766 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: c0cf8272e59549b787f8dbb8504421a9 Oct 12 13:22:19.497766 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1518701456 Oct 12 13:22:19.497766 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:22:19.497766 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:22:19.499210 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c0cf8272e59549b787f8dbb8504421a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c0cf8272e59549b787f8dbb8504421a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c0cf8272e59549b787f8dbb8504421a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c0cf8272e59549b787f8dbb8504421a9"}]}] Oct 12 13:22:19.499210 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1518701456 Oct 12 13:22:19.499210 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: c0cf8272e59549b787f8dbb8504421a9 Oct 12 13:22:19.499210 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1518701456 Oct 12 13:22:19.499210 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-HypervisorAdminNegativeTestJSON-1518701456-project Oct 12 13:22:19.499210 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:19.499210 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:19.499210 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 0d65cf2a72594038b743ed7967ede1a6 Oct 12 13:22:19.499210 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1518701456-project Oct 12 13:22:19.499210 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:22:19.499210 n-d-861076-2 devstack@n-api.service[120933]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 12 13:22:19.499210 n-d-861076-2 devstack@n-api.service[120933]: action_args: {} Oct 12 13:22:19.499210 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:19.500457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:19.500457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:19.500457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:19.500457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:19.500457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:19.500457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:22:19.500457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:22:19.500457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:19.500457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:19.500457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 12 13:22:19.500457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 12 13:22:19.500457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 12 13:22:19.500457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 12 13:22:19.500457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:22:19.500457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:22:19.500457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:22:19.500457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:22:19.500457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:22:19.500457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:22:19.501504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:22:19.501504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:22:19.501504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:22:19.501504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:22:19.501504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:22:19.501504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:22:19.501504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:22:19.501504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:22:19.501504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 12 13:22:19.501504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:19.501504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:19.501504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:19.501504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:19.501504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:19.501504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:19.501504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:22:19.501504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:22:19.501504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 12 13:22:19.501504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:19.503759 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-329f1752-94ba-4b12-83fb-efc7a3d3e82e tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:19.504837 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-329f1752-94ba-4b12-83fb-efc7a3d3e82e tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.126260 Oct 12 13:22:19.505346 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 129/230] 10.222.0.52 () {58 vars in 1167 bytes} [Wed Oct 12 13:22:19 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 128 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:22:19.525568 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0babeadc-48f8-4d00-ad25-ffd4002c9ab2 tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] Calling method '.version_select at 0x7f8aa054f820>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:19.531987 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-0babeadc-48f8-4d00-ad25-ffd4002c9ab2 tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '0d65cf2a72594038b743ed7967ede1a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0cf8272e59549b787f8dbb8504421a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:19.531987 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0babeadc-48f8-4d00-ad25-ffd4002c9ab2 tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] Request method failure captured: Oct 12 13:22:19.531987 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 12 13:22:19.531987 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:19.531987 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:19.531987 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:19.531987 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:22:19.531987 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:19.531987 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:19.531987 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:19.531987 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:19.531987 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr-IvMGmKEpj6YQnEsPnEGZxnyBKibCGzcvv4K7qmJ3xzRgBf3q1gG3E90OPaSV9rNEdZTH4F8RcP1ZqLsV3gfnDT-fxqsz4PcblY5JUbBjWmjnhciZjKgaRwZX8QSrGE2LcunBXR1h8ta844TKEpdHvftdpgemJnClPP6V67lGJbUk Oct 12 13:22:19.531987 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:19.531987 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:19.531987 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:19.531987 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:19.531987 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:19.531987 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:19.531987 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: c0cf8272e59549b787f8dbb8504421a9 Oct 12 13:22:19.531987 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1518701456 Oct 12 13:22:19.531987 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:22:19.531987 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:22:19.534171 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c0cf8272e59549b787f8dbb8504421a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c0cf8272e59549b787f8dbb8504421a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c0cf8272e59549b787f8dbb8504421a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c0cf8272e59549b787f8dbb8504421a9"}]}] Oct 12 13:22:19.534171 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1518701456 Oct 12 13:22:19.534171 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: c0cf8272e59549b787f8dbb8504421a9 Oct 12 13:22:19.534171 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1518701456 Oct 12 13:22:19.534171 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-HypervisorAdminNegativeTestJSON-1518701456-project Oct 12 13:22:19.534171 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:19.534171 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:19.534171 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 0d65cf2a72594038b743ed7967ede1a6 Oct 12 13:22:19.534171 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1518701456-project Oct 12 13:22:19.534171 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:22:19.534171 n-d-861076-2 devstack@n-api.service[120933]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 12 13:22:19.534171 n-d-861076-2 devstack@n-api.service[120933]: action_args: {} Oct 12 13:22:19.534171 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:19.535813 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:19.535813 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:19.535813 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:19.535813 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:19.535813 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:19.535813 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:22:19.535813 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:22:19.535813 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:19.535813 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:19.535813 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 12 13:22:19.535813 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 12 13:22:19.535813 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 12 13:22:19.535813 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 12 13:22:19.535813 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:22:19.535813 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:22:19.535813 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:22:19.535813 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:22:19.535813 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:22:19.535813 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:22:19.538060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:22:19.538060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:22:19.538060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:22:19.538060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:22:19.538060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:22:19.538060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:22:19.538060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:22:19.538060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:22:19.538060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 12 13:22:19.538060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:19.538060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:19.538060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:19.538060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:19.538060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:19.538060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:19.538060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:22:19.538060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:22:19.538060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 12 13:22:19.538060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:19.540674 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0babeadc-48f8-4d00-ad25-ffd4002c9ab2 tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:19.540674 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0babeadc-48f8-4d00-ad25-ffd4002c9ab2 tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.008598 Oct 12 13:22:19.540674 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 130/231] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:22:19 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:22:19.549250 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5532e61a-e11c-436f-8135-3606440d92c3 tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] Calling method '.version_select at 0x7f8aa04fd820>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:19.551433 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-5532e61a-e11c-436f-8135-3606440d92c3 tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '0d65cf2a72594038b743ed7967ede1a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0cf8272e59549b787f8dbb8504421a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:19.553726 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5532e61a-e11c-436f-8135-3606440d92c3 tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] Request method failure captured: Oct 12 13:22:19.553726 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 12 13:22:19.553726 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:19.553726 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:19.553726 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:19.553726 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:22:19.553726 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:19.553726 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:19.553726 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:19.553726 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:19.553726 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr-IvMGmKEpj6YQnEsPnEGZxnyBKibCGzcvv4K7qmJ3xzRgBf3q1gG3E90OPaSV9rNEdZTH4F8RcP1ZqLsV3gfnDT-fxqsz4PcblY5JUbBjWmjnhciZjKgaRwZX8QSrGE2LcunBXR1h8ta844TKEpdHvftdpgemJnClPP6V67lGJbUk Oct 12 13:22:19.553726 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:19.553726 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:19.553726 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:19.553726 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:19.553726 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:19.553726 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:19.553726 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: c0cf8272e59549b787f8dbb8504421a9 Oct 12 13:22:19.553726 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1518701456 Oct 12 13:22:19.553726 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:22:19.553726 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:22:19.554945 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c0cf8272e59549b787f8dbb8504421a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c0cf8272e59549b787f8dbb8504421a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c0cf8272e59549b787f8dbb8504421a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c0cf8272e59549b787f8dbb8504421a9"}]}] Oct 12 13:22:19.554945 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1518701456 Oct 12 13:22:19.554945 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: c0cf8272e59549b787f8dbb8504421a9 Oct 12 13:22:19.554945 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1518701456 Oct 12 13:22:19.554945 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-HypervisorAdminNegativeTestJSON-1518701456-project Oct 12 13:22:19.554945 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:19.554945 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:19.554945 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 0d65cf2a72594038b743ed7967ede1a6 Oct 12 13:22:19.554945 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1518701456-project Oct 12 13:22:19.554945 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:22:19.554945 n-d-861076-2 devstack@n-api.service[120933]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 12 13:22:19.554945 n-d-861076-2 devstack@n-api.service[120933]: action_args: {} Oct 12 13:22:19.554945 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:19.555623 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:19.555623 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:19.555623 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:19.555623 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:19.555623 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:19.555623 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:22:19.555623 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:22:19.555623 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:19.555623 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:19.555623 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 12 13:22:19.555623 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 12 13:22:19.555623 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:22:19.555623 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:22:19.555623 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:22:19.555623 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:22:19.555623 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:22:19.555623 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:22:19.555623 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:22:19.555623 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:22:19.556596 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:22:19.556596 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:22:19.556596 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:22:19.556596 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:22:19.556596 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:22:19.556596 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:22:19.556596 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 12 13:22:19.556596 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:19.556596 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:19.556596 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:19.556596 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:19.556596 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:19.556596 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:19.556596 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:22:19.556596 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:22:19.556596 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 12 13:22:19.556596 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:19.558920 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5532e61a-e11c-436f-8135-3606440d92c3 tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:19.559944 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5532e61a-e11c-436f-8135-3606440d92c3 tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.021395 Oct 12 13:22:19.565824 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 131/232] 10.222.0.52 () {58 vars in 1179 bytes} [Wed Oct 12 13:22:19 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:22:19.747248 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c5fc92bc-768e-40f9-8e2f-e55991b62967 tempest-FlavorsV261TestJSON-1178238565 tempest-FlavorsV261TestJSON-1178238565-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:19.749046 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c5fc92bc-768e-40f9-8e2f-e55991b62967 tempest-FlavorsV261TestJSON-1178238565 tempest-FlavorsV261TestJSON-1178238565-project] 10.222.0.52 "GET /compute/v2.1/flavors/1385427815" status: 200 len: 468 microversion: 2.61 time: 0.264318 Oct 12 13:22:19.758615 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 102/233] 10.222.0.52 () {60 vars in 1199 bytes} [Wed Oct 12 13:22:19 2022] GET /compute/v2.1/flavors/1385427815 => generated 468 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:22:19.764163 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b08e0253-2912-44e9-ad7b-9233cb4c10c6 tempest-FlavorsV261TestJSON-223587045 tempest-FlavorsV261TestJSON-223587045-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:19.897031 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b08e0253-2912-44e9-ad7b-9233cb4c10c6 tempest-FlavorsV261TestJSON-223587045 tempest-FlavorsV261TestJSON-223587045-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/1385427815" status: 200 len: 469 microversion: 2.61 time: 0.136665 Oct 12 13:22:19.906841 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 103/234] 10.222.0.52 () {62 vars in 1219 bytes} [Wed Oct 12 13:22:19 2022] PUT /compute/v2.1/flavors/1385427815 => generated 469 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 13:22:19.912466 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cb7ae2ee-862f-4a01-a7b7-83ee16acab56 tempest-FlavorsV261TestJSON-1178238565 tempest-FlavorsV261TestJSON-1178238565-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:19.938079 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cb7ae2ee-862f-4a01-a7b7-83ee16acab56 tempest-FlavorsV261TestJSON-1178238565 tempest-FlavorsV261TestJSON-1178238565-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.029736 Oct 12 13:22:19.938755 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 104/235] 10.222.0.52 () {60 vars in 1187 bytes} [Wed Oct 12 13:22:19 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:19.964718 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6934eda0-c54f-4ef9-8a33-a5e9de8aec0f tempest-FlavorsV261TestJSON-1178238565 tempest-FlavorsV261TestJSON-1178238565-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:19.974409 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ab623f55-36b4-491d-a02b-e19d7b0da796 tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Calling method '.version_select at 0x7f8aa04ef8b0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:19.976169 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ab623f55-36b4-491d-a02b-e19d7b0da796 tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:19.976646 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ab623f55-36b4-491d-a02b-e19d7b0da796 tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:19.977113 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ab623f55-36b4-491d-a02b-e19d7b0da796 tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.001911 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6934eda0-c54f-4ef9-8a33-a5e9de8aec0f tempest-FlavorsV261TestJSON-1178238565 tempest-FlavorsV261TestJSON-1178238565-project] 10.222.0.52 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.042773 Oct 12 13:22:20.002711 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 105/236] 10.222.0.52 () {60 vars in 1166 bytes} [Wed Oct 12 13:22:19 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:22:20.023173 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7248cd4e-dee8-445a-a4b3-158ee135938c tempest-FlavorsV261TestJSON-223587045 tempest-FlavorsV261TestJSON-223587045-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:20.023322 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ab623f55-36b4-491d-a02b-e19d7b0da796 tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.023728 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ab623f55-36b4-491d-a02b-e19d7b0da796 tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.024156 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ab623f55-36b4-491d-a02b-e19d7b0da796 tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.037203 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=5,nova_api:UPDATE=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:20.056826 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ab623f55-36b4-491d-a02b-e19d7b0da796 tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.058123 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ab623f55-36b4-491d-a02b-e19d7b0da796 tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.059000 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ab623f55-36b4-491d-a02b-e19d7b0da796 tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.072189 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ab623f55-36b4-491d-a02b-e19d7b0da796 tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.505048 Oct 12 13:22:20.074987 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 132/237] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:22:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:20.093315 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-75277ccf-db34-4a62-b5cc-aa9e8a6fbb17 tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] Calling method '.version_select at 0x7f8aa04ef160>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:20.095613 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-75277ccf-db34-4a62-b5cc-aa9e8a6fbb17 tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '0d65cf2a72594038b743ed7967ede1a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0cf8272e59549b787f8dbb8504421a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:20.097389 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-75277ccf-db34-4a62-b5cc-aa9e8a6fbb17 tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] Request method failure captured: Oct 12 13:22:20.097389 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 12 13:22:20.097389 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:20.097389 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:20.097389 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:20.097389 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:22:20.097389 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:20.097389 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:20.097389 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:20.097389 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:20.097389 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr-IvMGmKEpj6YQnEsPnEGZxnyBKibCGzcvv4K7qmJ3xzRgBf3q1gG3E90OPaSV9rNEdZTH4F8RcP1ZqLsV3gfnDT-fxqsz4PcblY5JUbBjWmjnhciZjKgaRwZX8QSrGE2LcunBXR1h8ta844TKEpdHvftdpgemJnClPP6V67lGJbUk Oct 12 13:22:20.097389 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:20.097389 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:20.097389 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:20.097389 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:20.097389 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:20.097389 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:20.097389 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: c0cf8272e59549b787f8dbb8504421a9 Oct 12 13:22:20.097389 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1518701456 Oct 12 13:22:20.097389 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:22:20.097389 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:22:20.098584 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c0cf8272e59549b787f8dbb8504421a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c0cf8272e59549b787f8dbb8504421a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c0cf8272e59549b787f8dbb8504421a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c0cf8272e59549b787f8dbb8504421a9"}]}] Oct 12 13:22:20.098584 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1518701456 Oct 12 13:22:20.098584 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: c0cf8272e59549b787f8dbb8504421a9 Oct 12 13:22:20.098584 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1518701456 Oct 12 13:22:20.098584 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-HypervisorAdminNegativeTestJSON-1518701456-project Oct 12 13:22:20.098584 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:20.098584 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:20.098584 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 0d65cf2a72594038b743ed7967ede1a6 Oct 12 13:22:20.098584 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1518701456-project Oct 12 13:22:20.098584 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:22:20.098584 n-d-861076-2 devstack@n-api.service[120933]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 12 13:22:20.098584 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '1'} Oct 12 13:22:20.098584 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:20.099278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:20.099278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:20.099278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:20.099278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:20.099278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:20.099278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:22:20.099278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:22:20.099278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:20.099278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:20.099278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 12 13:22:20.099278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 12 13:22:20.099278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:22:20.099278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:22:20.099278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:22:20.099278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:22:20.099278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:22:20.099278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:22:20.099278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:22:20.099278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:22:20.100295 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:22:20.100295 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:22:20.100295 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:22:20.100295 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:22:20.100295 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:22:20.100295 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:22:20.100295 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 12 13:22:20.100295 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.100295 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:20.100295 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.100295 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:20.100295 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:20.100295 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:20.100295 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:22:20.100295 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:22:20.100295 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 12 13:22:20.100295 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.101278 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-75277ccf-db34-4a62-b5cc-aa9e8a6fbb17 tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:20.101278 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-75277ccf-db34-4a62-b5cc-aa9e8a6fbb17 tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.013511 Oct 12 13:22:20.101278 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 133/238] 10.222.0.52 () {58 vars in 1173 bytes} [Wed Oct 12 13:22:20 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:22:20.108303 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ef17f454-5f09-47ca-83be-d829bd0b437d tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Calling method '.version_select at 0x7f8aa04e7e50>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:20.110512 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-ef17f454-5f09-47ca-83be-d829bd0b437d tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] HTTP exception thrown: Hypervisor with ID '90593bd9-18f1-4606-8ef8-9a779f4d7d54' could not be found. Oct 12 13:22:20.118427 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ef17f454-5f09-47ca-83be-d829bd0b437d tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Request method failure captured: Oct 12 13:22:20.118427 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-hypervisors/90593bd9-18f1-4606-8ef8-9a779f4d7d54/uptime HTTP/1.1 Oct 12 13:22:20.118427 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:20.118427 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:20.118427 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:20.118427 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:22:20.118427 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:20.118427 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:20.118427 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:20.118427 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:20.118427 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr-Lt4DCxlXSHSNtoTHP531sc4by3RB70Rz2vsefYVY3XsYM0CQYESdF0HkQxYz2L8EaSFG9w6YVUnXIpCrmnEBYfsy5nm4wczbyD5Gf7cJzKiEbTkwpFWQEatHd5vD3aZlwM_D_Vv3Sxovyo-yxB8apS1b-9jR4WfIbaeanUovxZVk Oct 12 13:22:20.118427 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:20.118427 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:20.118427 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:20.118427 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:20.118427 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:20.118427 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:20.118427 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: ea2d077f0e7c4c28a8e6b76cc5f4b58b Oct 12 13:22:20.118427 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-441278501 Oct 12 13:22:20.118427 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:22:20.118427 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:22:20.119710 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea2d077f0e7c4c28a8e6b76cc5f4b58b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea2d077f0e7c4c28a8e6b76cc5f4b58b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea2d077f0e7c4c28a8e6b76cc5f4b58b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea2d077f0e7c4c28a8e6b76cc5f4b58b"}]}] Oct 12 13:22:20.119710 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-441278501 Oct 12 13:22:20.119710 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: ea2d077f0e7c4c28a8e6b76cc5f4b58b Oct 12 13:22:20.119710 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-441278501 Oct 12 13:22:20.119710 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin Oct 12 13:22:20.119710 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:20.119710 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:20.119710 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 847f1ae79b1541769bf8e3c1f3ff37a5 Oct 12 13:22:20.119710 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin Oct 12 13:22:20.119710 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:22:20.119710 n-d-861076-2 devstack@n-api.service[120933]: exception: Hypervisor with ID '90593bd9-18f1-4606-8ef8-9a779f4d7d54' could not be found. Oct 12 13:22:20.119710 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '90593bd9-18f1-4606-8ef8-9a779f4d7d54'} Oct 12 13:22:20.120376 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:20.120376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:20.120376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 12 13:22:20.120376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 12 13:22:20.120376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '90593bd9-18f1-4606-8ef8-9a779f4d7d54' Oct 12 13:22:20.120376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.120376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:20.120376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.120376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:20.120376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 12 13:22:20.120376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 12 13:22:20.120376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 12 13:22:20.120376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 12 13:22:20.120376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 12 13:22:20.120376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.120376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:20.120376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.120376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:20.120376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 12 13:22:20.120376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 12 13:22:20.120376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 12 13:22:20.120376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 12 13:22:20.122135 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 12 13:22:20.122135 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.122135 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:20.122135 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.122135 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:20.122135 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:20.122135 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:20.122135 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:20.122135 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:20.122135 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:22:20.122135 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:22:20.122135 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:20.122135 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:20.122135 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 12 13:22:20.122135 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 12 13:22:20.122135 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 12 13:22:20.122135 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 13:22:20.122135 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '90593bd9-18f1-4606-8ef8-9a779f4d7d54' could not be found. Oct 12 13:22:20.122135 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.122135 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:20.122135 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.123341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:20.123341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:20.123341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:20.123341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:22:20.123341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:22:20.123341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '90593bd9-18f1-4606-8ef8-9a779f4d7d54' could not be found. Oct 12 13:22:20.123341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.123341 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ef17f454-5f09-47ca-83be-d829bd0b437d tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Returning 404 to user: Hypervisor with ID '90593bd9-18f1-4606-8ef8-9a779f4d7d54' could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:20.123341 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ef17f454-5f09-47ca-83be-d829bd0b437d tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/90593bd9-18f1-4606-8ef8-9a779f4d7d54/uptime" status: 404 len: 123 microversion: 2.1 time: 0.015156 Oct 12 13:22:20.123341 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 134/239] 10.222.0.52 () {58 vars in 1278 bytes} [Wed Oct 12 13:22:20 2022] GET /compute/v2.1/os-hypervisors/90593bd9-18f1-4606-8ef8-9a779f4d7d54/uptime => generated 123 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:22:20.130940 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a81bd700-5af0-4ddb-a5f2-44110d8a5196 tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Calling method '.version_select at 0x7f8aa053f8b0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:20.132714 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a81bd700-5af0-4ddb-a5f2-44110d8a5196 tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.133230 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a81bd700-5af0-4ddb-a5f2-44110d8a5196 tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.133667 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a81bd700-5af0-4ddb-a5f2-44110d8a5196 tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.154213 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a81bd700-5af0-4ddb-a5f2-44110d8a5196 tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.155730 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a81bd700-5af0-4ddb-a5f2-44110d8a5196 tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.156324 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a81bd700-5af0-4ddb-a5f2-44110d8a5196 tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.167788 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a81bd700-5af0-4ddb-a5f2-44110d8a5196 tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.168268 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a81bd700-5af0-4ddb-a5f2-44110d8a5196 tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.174568 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a81bd700-5af0-4ddb-a5f2-44110d8a5196 tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.175297 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a81bd700-5af0-4ddb-a5f2-44110d8a5196 tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.048469 Oct 12 13:22:20.175874 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 135/240] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:22:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:20.188972 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c0bc2787-a746-4ca1-b228-597a79d5ed7b tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] Calling method '.version_select at 0x7f8aa04fd9d0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:20.189182 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7248cd4e-dee8-445a-a4b3-158ee135938c tempest-FlavorsV261TestJSON-223587045 tempest-FlavorsV261TestJSON-223587045-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1385427815" status: 202 len: 0 microversion: 2.61 time: 0.172161 Oct 12 13:22:20.193904 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 106/241] 10.222.0.52 () {60 vars in 1202 bytes} [Wed Oct 12 13:22:20 2022] DELETE /compute/v2.1/flavors/1385427815 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 12 13:22:20.194154 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-c0bc2787-a746-4ca1-b228-597a79d5ed7b tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '0d65cf2a72594038b743ed7967ede1a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0cf8272e59549b787f8dbb8504421a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:20.194154 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c0bc2787-a746-4ca1-b228-597a79d5ed7b tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] Request method failure captured: Oct 12 13:22:20.194154 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 12 13:22:20.194154 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:20.194154 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:20.194154 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:20.194154 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:22:20.194154 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:20.194154 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:20.194154 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:20.194154 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:20.194154 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr-IvMGmKEpj6YQnEsPnEGZxnyBKibCGzcvv4K7qmJ3xzRgBf3q1gG3E90OPaSV9rNEdZTH4F8RcP1ZqLsV3gfnDT-fxqsz4PcblY5JUbBjWmjnhciZjKgaRwZX8QSrGE2LcunBXR1h8ta844TKEpdHvftdpgemJnClPP6V67lGJbUk Oct 12 13:22:20.194154 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:20.194154 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:20.194154 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:20.194154 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:20.194154 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:20.194154 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:20.194154 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: c0cf8272e59549b787f8dbb8504421a9 Oct 12 13:22:20.194154 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1518701456 Oct 12 13:22:20.194154 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:22:20.194154 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:22:20.195742 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c0cf8272e59549b787f8dbb8504421a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c0cf8272e59549b787f8dbb8504421a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c0cf8272e59549b787f8dbb8504421a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c0cf8272e59549b787f8dbb8504421a9"}]}] Oct 12 13:22:20.195742 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1518701456 Oct 12 13:22:20.195742 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: c0cf8272e59549b787f8dbb8504421a9 Oct 12 13:22:20.195742 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1518701456 Oct 12 13:22:20.195742 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-HypervisorAdminNegativeTestJSON-1518701456-project Oct 12 13:22:20.195742 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:20.195742 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:20.195742 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 0d65cf2a72594038b743ed7967ede1a6 Oct 12 13:22:20.195742 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1518701456-project Oct 12 13:22:20.195742 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:22:20.195742 n-d-861076-2 devstack@n-api.service[120933]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 12 13:22:20.195742 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '1'} Oct 12 13:22:20.195742 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:20.196681 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:20.196681 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:20.196681 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:20.196681 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:20.196681 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:20.196681 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:22:20.196681 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:22:20.196681 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:20.196681 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:20.196681 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 12 13:22:20.196681 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 12 13:22:20.196681 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 12 13:22:20.196681 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 12 13:22:20.196681 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:22:20.196681 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:22:20.196681 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:22:20.196681 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:22:20.196681 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:22:20.196681 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:22:20.197715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:22:20.197715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:22:20.197715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:22:20.197715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:22:20.197715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:22:20.197715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:22:20.197715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:22:20.197715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:22:20.197715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 12 13:22:20.197715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.197715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:20.197715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.197715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:20.197715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:20.197715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:20.197715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:22:20.197715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:22:20.197715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 12 13:22:20.197715 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.200232 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-92103239-4603-4b48-9ade-fba5000d99f8 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:20.200865 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-92103239-4603-4b48-9ade-fba5000d99f8 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:20.209115 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92103239-4603-4b48-9ade-fba5000d99f8 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.209607 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92103239-4603-4b48-9ade-fba5000d99f8 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.210041 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92103239-4603-4b48-9ade-fba5000d99f8 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.213515 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92103239-4603-4b48-9ade-fba5000d99f8 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.213515 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92103239-4603-4b48-9ade-fba5000d99f8 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.213515 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92103239-4603-4b48-9ade-fba5000d99f8 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.217407 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c0bc2787-a746-4ca1-b228-597a79d5ed7b tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:20.220119 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c0bc2787-a746-4ca1-b228-597a79d5ed7b tempest-HypervisorAdminNegativeTestJSON-1518701456 tempest-HypervisorAdminNegativeTestJSON-1518701456-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.035432 Oct 12 13:22:20.226375 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 136/242] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:22:20 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:22:20.238214 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8d713198-d74b-4c23-934a-d49678378d02 tempest-FlavorsV261TestJSON-223587045 tempest-FlavorsV261TestJSON-223587045-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:20.239314 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-92103239-4603-4b48-9ade-fba5000d99f8 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] HTTP exception thrown: Instance 9a10a32a-d01d-4530-a93e-66f425a5bd06 could not be found. Oct 12 13:22:20.242251 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-92103239-4603-4b48-9ade-fba5000d99f8 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Request method failure captured: Oct 12 13:22:20.242251 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 HTTP/1.1 Oct 12 13:22:20.242251 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:22:20.242251 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:22:20.242251 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:22:20.242251 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:22:20.242251 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:22:20.242251 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:22:20.242251 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:22:20.242251 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:20.242251 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr9edkwQLGY3NFpzE5RABKU3xe-HFcgvmXhfwBzGpQvbC-54Ccceq0u4yCUHKA39rkViQCKLOfpgJLvHR5bC9nD37ieWTSelhZelTTb8SMJS8RqOu21MVEW77xKVONhdfpmlNf8VvC4dWOx7FN6kCE8wiA-Rg90oln-1MtIh8wZGzpc Oct 12 13:22:20.242251 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:22:20.242251 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:22:20.242251 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:22:20.242251 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:22:20.242251 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:22:20.242251 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:22:20.242251 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 79a760f270b741faa8363f5142561aa0 Oct 12 13:22:20.242251 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-AggregatesAdminTestJSON-1047935697 Oct 12 13:22:20.242251 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:22:20.242251 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:22:20.243424 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/79a760f270b741faa8363f5142561aa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_79a760f270b741faa8363f5142561aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79a760f270b741faa8363f5142561aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79a760f270b741faa8363f5142561aa0"}]}] Oct 12 13:22:20.243424 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-AggregatesAdminTestJSON-1047935697 Oct 12 13:22:20.243424 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 79a760f270b741faa8363f5142561aa0 Oct 12 13:22:20.243424 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1047935697 Oct 12 13:22:20.243424 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-AggregatesAdminTestJSON-1047935697-project Oct 12 13:22:20.243424 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:22:20.243424 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:22:20.243424 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: cbfb915900c442c0999a39440a8228fe Oct 12 13:22:20.243424 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-AggregatesAdminTestJSON-1047935697-project Oct 12 13:22:20.243424 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:22:20.243424 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance 9a10a32a-d01d-4530-a93e-66f425a5bd06 could not be found. Oct 12 13:22:20.243424 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '9a10a32a-d01d-4530-a93e-66f425a5bd06'} Oct 12 13:22:20.244078 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:20.244078 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:20.244078 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:22:20.244078 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:22:20.244078 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:22:20.244078 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:22:20.244078 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:22:20.244078 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:22:20.244078 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:22:20.244078 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:22:20.244078 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a10a32a-d01d-4530-a93e-66f425a5bd06 could not be found. Oct 12 13:22:20.244078 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.244078 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:20.244078 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.244078 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:20.244078 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:20.244078 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:20.244078 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:20.244078 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:20.244078 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:20.245167 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:20.245167 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:22:20.245167 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:22:20.245167 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:22:20.245167 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:22:20.245167 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:22:20.245167 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:22:20.245167 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a10a32a-d01d-4530-a93e-66f425a5bd06 could not be found. Oct 12 13:22:20.245167 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.245167 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:20.245167 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.245167 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:20.245167 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:20.245167 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:20.245167 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:22:20.245167 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:22:20.245167 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a10a32a-d01d-4530-a93e-66f425a5bd06 could not be found. Oct 12 13:22:20.245167 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.246213 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-92103239-4603-4b48-9ade-fba5000d99f8 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Returning 404 to user: Instance 9a10a32a-d01d-4530-a93e-66f425a5bd06 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:20.246213 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-92103239-4603-4b48-9ade-fba5000d99f8 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 404 len: 111 microversion: 2.1 time: 0.051804 Oct 12 13:22:20.246213 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 107/243] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:20 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:22:20.271831 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-8d713198-d74b-4c23-934a-d49678378d02 tempest-FlavorsV261TestJSON-223587045 tempest-FlavorsV261TestJSON-223587045-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.044144 Oct 12 13:22:20.272968 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 137/244] 10.222.0.52 () {60 vars in 1187 bytes} [Wed Oct 12 13:22:20 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:20.278704 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3b5a8493-3b7b-4bec-b4c4-566a6a6e8fca tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Calling method '.version_select at 0x7f8aa053fca0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:20.281549 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-3b5a8493-3b7b-4bec-b4c4-566a6a6e8fca tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] HTTP exception thrown: Hypervisor with ID '2d0c9f39-8ae3-44ef-9633-f5df68ff7b5e' could not be found. Oct 12 13:22:20.283710 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3b5a8493-3b7b-4bec-b4c4-566a6a6e8fca tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Request method failure captured: Oct 12 13:22:20.283710 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-hypervisors/2d0c9f39-8ae3-44ef-9633-f5df68ff7b5e HTTP/1.1 Oct 12 13:22:20.283710 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:20.283710 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:20.283710 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:20.283710 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:22:20.283710 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:20.283710 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:20.283710 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:20.283710 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:20.283710 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr-Lt4DCxlXSHSNtoTHP531sc4by3RB70Rz2vsefYVY3XsYM0CQYESdF0HkQxYz2L8EaSFG9w6YVUnXIpCrmnEBYfsy5nm4wczbyD5Gf7cJzKiEbTkwpFWQEatHd5vD3aZlwM_D_Vv3Sxovyo-yxB8apS1b-9jR4WfIbaeanUovxZVk Oct 12 13:22:20.283710 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:20.283710 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:20.283710 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:20.283710 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:20.283710 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:20.283710 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:20.283710 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: ea2d077f0e7c4c28a8e6b76cc5f4b58b Oct 12 13:22:20.283710 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-441278501 Oct 12 13:22:20.283710 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:22:20.283710 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:22:20.284817 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea2d077f0e7c4c28a8e6b76cc5f4b58b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea2d077f0e7c4c28a8e6b76cc5f4b58b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea2d077f0e7c4c28a8e6b76cc5f4b58b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea2d077f0e7c4c28a8e6b76cc5f4b58b"}]}] Oct 12 13:22:20.284817 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-441278501 Oct 12 13:22:20.284817 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: ea2d077f0e7c4c28a8e6b76cc5f4b58b Oct 12 13:22:20.284817 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-441278501 Oct 12 13:22:20.284817 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin Oct 12 13:22:20.284817 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:20.284817 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:20.284817 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 847f1ae79b1541769bf8e3c1f3ff37a5 Oct 12 13:22:20.284817 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin Oct 12 13:22:20.284817 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:22:20.284817 n-d-861076-2 devstack@n-api.service[120933]: exception: Hypervisor with ID '2d0c9f39-8ae3-44ef-9633-f5df68ff7b5e' could not be found. Oct 12 13:22:20.284817 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '2d0c9f39-8ae3-44ef-9633-f5df68ff7b5e'} Oct 12 13:22:20.285637 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:20.285637 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:20.285637 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 12 13:22:20.285637 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 12 13:22:20.285637 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '2d0c9f39-8ae3-44ef-9633-f5df68ff7b5e' Oct 12 13:22:20.285637 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.285637 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:20.285637 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.285637 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:20.285637 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 12 13:22:20.285637 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 12 13:22:20.285637 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 12 13:22:20.285637 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 12 13:22:20.285637 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 12 13:22:20.285637 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.285637 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:20.285637 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.285637 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:20.285637 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 12 13:22:20.285637 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 12 13:22:20.285637 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 12 13:22:20.285637 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 12 13:22:20.286740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 12 13:22:20.286740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.286740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:20.286740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.286740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:20.286740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:20.286740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:20.286740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:20.286740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:20.286740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:22:20.286740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:22:20.286740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:20.286740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:20.286740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 12 13:22:20.286740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 12 13:22:20.286740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 12 13:22:20.286740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 12 13:22:20.286740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 12 13:22:20.286740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 13:22:20.286740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '2d0c9f39-8ae3-44ef-9633-f5df68ff7b5e' could not be found. Oct 12 13:22:20.287761 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.287761 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:20.287761 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.287761 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:20.287761 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:20.287761 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:20.287761 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:22:20.287761 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:22:20.287761 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '2d0c9f39-8ae3-44ef-9633-f5df68ff7b5e' could not be found. Oct 12 13:22:20.287761 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:20.290367 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3b5a8493-3b7b-4bec-b4c4-566a6a6e8fca tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] Returning 404 to user: Hypervisor with ID '2d0c9f39-8ae3-44ef-9633-f5df68ff7b5e' could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:20.291369 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3b5a8493-3b7b-4bec-b4c4-566a6a6e8fca tempest-HypervisorAdminNegativeTestJSON-441278501 tempest-HypervisorAdminNegativeTestJSON-441278501-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/2d0c9f39-8ae3-44ef-9633-f5df68ff7b5e" status: 404 len: 123 microversion: 2.1 time: 0.017278 Oct 12 13:22:20.294330 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 138/245] 10.222.0.52 () {58 vars in 1257 bytes} [Wed Oct 12 13:22:20 2022] GET /compute/v2.1/os-hypervisors/2d0c9f39-8ae3-44ef-9633-f5df68ff7b5e => generated 123 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:22:20.300431 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-eb754d31-5c81-44b4-b3bb-94ea42009e01 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861076-2"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:20.318205 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-eb754d31-5c81-44b4-b3bb-94ea42009e01 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.318833 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-eb754d31-5c81-44b4-b3bb-94ea42009e01 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.319366 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-eb754d31-5c81-44b4-b3bb-94ea42009e01 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.418022 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:20.536047 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:RELEASE=9,nova_api:SAVEPOINT=8,nova_api:SELECT=79,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:20.537574 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-80708451-8fa9-4622-8369-7f23d4dead8d tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Calling method '.version_select at 0x7f8aa0512310>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:20.539182 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-80708451-8fa9-4622-8369-7f23d4dead8d tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.539692 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-80708451-8fa9-4622-8369-7f23d4dead8d tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.540129 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-80708451-8fa9-4622-8369-7f23d4dead8d tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.559846 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-80708451-8fa9-4622-8369-7f23d4dead8d tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.560545 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-80708451-8fa9-4622-8369-7f23d4dead8d tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.566128 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-80708451-8fa9-4622-8369-7f23d4dead8d tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.572735 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-80708451-8fa9-4622-8369-7f23d4dead8d tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.573327 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-80708451-8fa9-4622-8369-7f23d4dead8d tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.573830 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-80708451-8fa9-4622-8369-7f23d4dead8d tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.580200 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-80708451-8fa9-4622-8369-7f23d4dead8d tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.334459 Oct 12 13:22:20.580862 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 108/246] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:22:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:20.585873 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e34a1641-98e3-4f02-ad94-676bad344e64 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:20.586728 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e34a1641-98e3-4f02-ad94-676bad344e64 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:20.593855 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e34a1641-98e3-4f02-ad94-676bad344e64 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.594418 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e34a1641-98e3-4f02-ad94-676bad344e64 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.594924 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e34a1641-98e3-4f02-ad94-676bad344e64 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.595679 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e34a1641-98e3-4f02-ad94-676bad344e64 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.596357 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e34a1641-98e3-4f02-ad94-676bad344e64 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.596845 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e34a1641-98e3-4f02-ad94-676bad344e64 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.651229 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-eb754d31-5c81-44b4-b3bb-94ea42009e01 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 298 microversion: 2.1 time: 0.355625 Oct 12 13:22:20.658554 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 139/247] 10.222.0.52 () {60 vars in 1191 bytes} [Wed Oct 12 13:22:20 2022] POST /compute/v2.1/os-aggregates/4/action => generated 298 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:20.658554 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8fd1cf60-904c-4066-b3e4-9d037b3e286d tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Calling method '.version_select at 0x7f8aa04fd700>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:20.660453 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8fd1cf60-904c-4066-b3e4-9d037b3e286d tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.661036 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8fd1cf60-904c-4066-b3e4-9d037b3e286d tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.661537 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8fd1cf60-904c-4066-b3e4-9d037b3e286d tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.676147 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8fd1cf60-904c-4066-b3e4-9d037b3e286d tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.676318 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-e34a1641-98e3-4f02-ad94-676bad344e64 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:20.676778 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8fd1cf60-904c-4066-b3e4-9d037b3e286d tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.677398 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8fd1cf60-904c-4066-b3e4-9d037b3e286d tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.685941 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-e34a1641-98e3-4f02-ad94-676bad344e64 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:20.687965 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-e34a1641-98e3-4f02-ad94-676bad344e64 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:20.689040 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8fd1cf60-904c-4066-b3e4-9d037b3e286d tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.689519 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8fd1cf60-904c-4066-b3e4-9d037b3e286d tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.689949 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8fd1cf60-904c-4066-b3e4-9d037b3e286d tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.696250 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-8fd1cf60-904c-4066-b3e4-9d037b3e286d tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.043316 Oct 12 13:22:20.697178 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 140/248] 10.222.0.52 () {58 vars in 1167 bytes} [Wed Oct 12 13:22:20 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:22:20.697586 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e34a1641-98e3-4f02-ad94-676bad344e64 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1417 microversion: 2.75 time: 0.115079 Oct 12 13:22:20.698268 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 109/249] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:20 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1417 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:20.716587 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4fab50e2-7d10-4515-8ae8-fe3324364cb1 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Calling method '.version_select at 0x7f8aa02ee430>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:20.722118 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fab50e2-7d10-4515-8ae8-fe3324364cb1 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.722267 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-64dc17c0-eeb0-40c4-8726-2a75c55d99c3 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:20.722612 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fab50e2-7d10-4515-8ae8-fe3324364cb1 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.723405 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fab50e2-7d10-4515-8ae8-fe3324364cb1 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.739889 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fab50e2-7d10-4515-8ae8-fe3324364cb1 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.740631 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fab50e2-7d10-4515-8ae8-fe3324364cb1 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.741249 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fab50e2-7d10-4515-8ae8-fe3324364cb1 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.753143 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fab50e2-7d10-4515-8ae8-fe3324364cb1 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.756968 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fab50e2-7d10-4515-8ae8-fe3324364cb1 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.756968 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fab50e2-7d10-4515-8ae8-fe3324364cb1 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.760538 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4fab50e2-7d10-4515-8ae8-fe3324364cb1 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.049253 Oct 12 13:22:20.761503 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 110/250] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:22:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:20.772694 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4ea260ba-512a-4058-975b-695692721c11 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Calling method '.version_select at 0x7f8aa02ee160>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:20.774756 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4ea260ba-512a-4058-975b-695692721c11 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.775521 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4ea260ba-512a-4058-975b-695692721c11 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.775965 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4ea260ba-512a-4058-975b-695692721c11 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.791662 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4ea260ba-512a-4058-975b-695692721c11 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.792150 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4ea260ba-512a-4058-975b-695692721c11 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.792593 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4ea260ba-512a-4058-975b-695692721c11 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.798528 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4ea260ba-512a-4058-975b-695692721c11 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.029999 Oct 12 13:22:20.799248 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 111/251] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:22:20 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:20.815050 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-47aa08c7-23f3-4a43-9fa8-64d7e85eebfc tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Calling method '.version_select at 0x7f8aa04844c0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:20.816756 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-47aa08c7-23f3-4a43-9fa8-64d7e85eebfc tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.817263 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-47aa08c7-23f3-4a43-9fa8-64d7e85eebfc tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.817701 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-47aa08c7-23f3-4a43-9fa8-64d7e85eebfc tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.835059 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-47aa08c7-23f3-4a43-9fa8-64d7e85eebfc tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.024281 Oct 12 13:22:20.835823 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 112/252] 10.222.0.52 () {58 vars in 1179 bytes} [Wed Oct 12 13:22:20 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:22:20.847993 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ccba8445-6e71-4d90-867f-9accc7cba37a tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Calling method '.version_select at 0x7f8aa02eeca0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:20.849826 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccba8445-6e71-4d90-867f-9accc7cba37a tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.850327 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccba8445-6e71-4d90-867f-9accc7cba37a tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.850780 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccba8445-6e71-4d90-867f-9accc7cba37a tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.865352 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccba8445-6e71-4d90-867f-9accc7cba37a tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.865831 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccba8445-6e71-4d90-867f-9accc7cba37a tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.866262 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccba8445-6e71-4d90-867f-9accc7cba37a tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.869424 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-64dc17c0-eeb0-40c4-8726-2a75c55d99c3 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.171184 Oct 12 13:22:20.871479 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 141/253] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:22:20 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 13:22:20.877532 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccba8445-6e71-4d90-867f-9accc7cba37a tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.878013 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccba8445-6e71-4d90-867f-9accc7cba37a tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.878503 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccba8445-6e71-4d90-867f-9accc7cba37a tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.886025 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ccba8445-6e71-4d90-867f-9accc7cba37a tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.041689 Oct 12 13:22:20.886895 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 113/254] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:22:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:22:20.892280 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-27874a13-8105-43e4-ab2c-c75d156cd9da tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-435738474"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:20.896071 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.aggregate [None req-27874a13-8105-43e4-ab2c-c75d156cd9da tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Generated uuid 913e1061-3d66-46a4-9629-9ce08bc4584f for aggregate {{(pid=120933) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 13:22:20.897036 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c548816e-b763-4144-9aa5-b85bd7e24535 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Calling method '.version_select at 0x7f8aa02ee9d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:20.899613 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c548816e-b763-4144-9aa5-b85bd7e24535 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.900146 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c548816e-b763-4144-9aa5-b85bd7e24535 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.900599 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c548816e-b763-4144-9aa5-b85bd7e24535 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.919636 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c548816e-b763-4144-9aa5-b85bd7e24535 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.919636 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c548816e-b763-4144-9aa5-b85bd7e24535 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.919636 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c548816e-b763-4144-9aa5-b85bd7e24535 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.926542 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c548816e-b763-4144-9aa5-b85bd7e24535 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.033249 Oct 12 13:22:20.927223 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 114/255] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:22:20 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:20.942165 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-520569ef-5bc2-4c86-acf8-d1acaba64d7a tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Calling method '.version_select at 0x7f8aa02eeee0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:20.943956 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-520569ef-5bc2-4c86-acf8-d1acaba64d7a tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.948292 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-520569ef-5bc2-4c86-acf8-d1acaba64d7a tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.948292 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-520569ef-5bc2-4c86-acf8-d1acaba64d7a tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.957180 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-520569ef-5bc2-4c86-acf8-d1acaba64d7a tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.957658 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-520569ef-5bc2-4c86-acf8-d1acaba64d7a tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.958100 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-520569ef-5bc2-4c86-acf8-d1acaba64d7a tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.965328 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-520569ef-5bc2-4c86-acf8-d1acaba64d7a tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.026812 Oct 12 13:22:20.965938 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 115/256] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:22:20 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:22:20.980038 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ba85e8bc-c70d-432c-9a5d-812498f8de47 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Calling method '.version_select at 0x7f8aa02ee4c0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:20.981833 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba85e8bc-c70d-432c-9a5d-812498f8de47 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.982695 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba85e8bc-c70d-432c-9a5d-812498f8de47 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.982813 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba85e8bc-c70d-432c-9a5d-812498f8de47 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:20.996624 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba85e8bc-c70d-432c-9a5d-812498f8de47 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:20.997103 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba85e8bc-c70d-432c-9a5d-812498f8de47 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:20.997540 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba85e8bc-c70d-432c-9a5d-812498f8de47 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:21.008185 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba85e8bc-c70d-432c-9a5d-812498f8de47 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:21.008667 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba85e8bc-c70d-432c-9a5d-812498f8de47 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:21.009182 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba85e8bc-c70d-432c-9a5d-812498f8de47 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:21.033479 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ba85e8bc-c70d-432c-9a5d-812498f8de47 tempest-HypervisorAdminTestJSON-1696580922 tempest-HypervisorAdminTestJSON-1696580922-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.056778 Oct 12 13:22:21.034126 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 116/257] 10.222.0.52 () {58 vars in 1173 bytes} [Wed Oct 12 13:22:20 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:22:21.084873 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-27874a13-8105-43e4-ab2c-c75d156cd9da tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.197452 Oct 12 13:22:21.084873 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 142/258] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 12 13:22:20 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:22:21.093506 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-44b6b01e-13b0-4881-9b00-3eea1e3a62b0 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861076-2"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:21.106282 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-44b6b01e-13b0-4881-9b00-3eea1e3a62b0 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:21.106755 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-44b6b01e-13b0-4881-9b00-3eea1e3a62b0 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:21.107185 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-44b6b01e-13b0-4881-9b00-3eea1e3a62b0 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:21.136178 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-653b093d-a8a1-4405-9d93-16b5b18d552f tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-392018115", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "f8b19b17-bd23-4f27-bfe1-281ccaba4d85"}], "security_groups": [{"name": "tempest-securitygroup--450305418"}], "key_name": "tempest-keypair-1019596395", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:21.266411 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-653b093d-a8a1-4405-9d93-16b5b18d552f tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] validate_networks() for [('f8b19b17-bd23-4f27-bfe1-281ccaba4d85', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:22:21.441557 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-44b6b01e-13b0-4881-9b00-3eea1e3a62b0 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.352159 Oct 12 13:22:21.443934 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 117/259] 10.222.0.52 () {60 vars in 1191 bytes} [Wed Oct 12 13:22:21 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:21.456545 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b448a2d3-1a5b-4acc-a622-6753e1101317 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:21.468581 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b448a2d3-1a5b-4acc-a622-6753e1101317 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.017395 Oct 12 13:22:21.469441 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 118/260] 10.222.0.52 () {58 vars in 1149 bytes} [Wed Oct 12 13:22:21 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:22:21.481935 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a5b3a6ae-b703-4743-bcfa-c7fd071fbd7e tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861076-2"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:21.502719 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a5b3a6ae-b703-4743-bcfa-c7fd071fbd7e tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:21.503215 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a5b3a6ae-b703-4743-bcfa-c7fd071fbd7e tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:21.503674 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a5b3a6ae-b703-4743-bcfa-c7fd071fbd7e tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:21.568394 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-653b093d-a8a1-4405-9d93-16b5b18d552f tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dd3523f9-d20c-48db-946b-9995eb35d859) Oct 12 13:22:21.568394 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:21.568394 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:21.568394 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:21.568394 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:21.568394 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:21.568394 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:21.568394 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:21.568394 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:21.568394 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:21.568394 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:22:21.568394 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:22:21.568394 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:22:21.568394 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:22:21.568394 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:22:21.568394 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:22:21.569581 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:22:21.569581 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:22:21.569581 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:22:21.569581 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:22:21.569581 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:22:21.569581 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:22:21.569581 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:22:21.569581 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:22:21.569581 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:22:21.569581 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:22:21.569581 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:22:21.569581 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:21.569581 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:21.569581 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:22:21.569581 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:22:21.569581 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:21.569581 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:21.569581 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:22:21.570568 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:22:21.570568 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:21.570568 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:21.570568 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:22:21.570568 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:22:21.570568 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:21.570568 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:21.570568 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:22:21.570568 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:22:21.570568 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:22:21.570568 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:22:21.570568 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:22:21.570568 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:22:21.570568 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:22:21.570568 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:22:21.570568 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:22:21.570568 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:22:21.570568 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:22:21.571697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:22:21.571697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:22:21.571697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:22:21.571697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:22:21.571697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:22:21.571697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:22:21.571697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:22:21.571697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:22:21.571697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:22:21.571697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:22:21.571697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:22:21.571697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:22:21.571697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:22:21.571697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:22:21.571697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dd3523f9-d20c-48db-946b-9995eb35d859) Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-653b093d-a8a1-4405-9d93-16b5b18d552f tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-653b093d-a8a1-4405-9d93-16b5b18d552f tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] Request method failure captured: Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 469 Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr94e9Lovd_6wKxNl_JdjNknQjnVEEV0iEB1Wv4X1GnAYah2d6SLZ1cdu5yb_P2VD3YueOK5el--I7xgrTV1Ivko28VuoL8DV3x4iyalWBU8ProRzP7gH_7Rd_edn-YZLsXIHxcHBsLHvinvny9pvZo6yqBaLRm_O6GdA_XZgCu9sR8 Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: X-Openstack-Nova-Api-Version: 2.25 Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: b6be2b28cd33472bbdb04d6db1526921 Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-579442985 Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:22:21.572469 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:22:21.582937 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b6be2b28cd33472bbdb04d6db1526921"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b6be2b28cd33472bbdb04d6db1526921"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b6be2b28cd33472bbdb04d6db1526921"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b6be2b28cd33472bbdb04d6db1526921"}]}] Oct 12 13:22:21.582937 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-579442985 Oct 12 13:22:21.582937 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: b6be2b28cd33472bbdb04d6db1526921 Oct 12 13:22:21.582937 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-579442985 Oct 12 13:22:21.582937 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-LiveAutoBlockMigrationV225Test-579442985-project Oct 12 13:22:21.582937 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:21.582937 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:21.582937 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: fd24f238584e443cbb549e4799eb5c4f Oct 12 13:22:21.582937 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-579442985-project Oct 12 13:22:21.582937 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:22:21.583567 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-392018115", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "f8b19b17-bd23-4f27-bfe1-281ccaba4d85"}], "security_groups": [{"name": "tempest-securitygroup--450305418"}], "key_name": "tempest-keypair-1019596395", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 12 13:22:21.583567 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:22:21.583567 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:22:21.583567 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:22:21.583567 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-LiveAutoBlockMigrationV225Test-server-392018115', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': 'f8b19b17-bd23-4f27-bfe1-281ccaba4d85'}], 'security_groups': [{'name': 'tempest-securitygroup--450305418'}], 'key_name': 'tempest-keypair-1019596395', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 12 13:22:21.583567 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:21.583567 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:21.583567 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:21.583567 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:21.583567 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:21.583567 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:21.583567 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:21.583567 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:21.584303 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:21.584303 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:21.584303 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:22:21.584303 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:22:21.584303 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:22:21.584303 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:22:21.584303 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:22:21.584303 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:22:21.584303 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:22:21.584303 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:22:21.584303 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:22:21.584303 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:22:21.584303 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:22:21.584303 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:22:21.584303 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:22:21.584303 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:22:21.584303 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:22:21.584303 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:22:21.585291 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:22:21.585291 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:21.585291 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:21.585291 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:22:21.585291 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:22:21.585291 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:21.585291 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:21.585291 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:22:21.585291 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:22:21.585291 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:21.585291 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:21.585291 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:22:21.585291 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:22:21.585291 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:21.585291 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:21.585291 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:22:21.585291 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:22:21.585291 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:22:21.586299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:22:21.586299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:22:21.586299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:22:21.586299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:22:21.586299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:22:21.586299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:22:21.586299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:22:21.586299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:22:21.586299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:22:21.586299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:22:21.586299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:22:21.586299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:22:21.586299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:22:21.586299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:22:21.586299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:22:21.586299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:22:21.586299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:22:21.587183 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:22:21.587183 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:22:21.587183 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:22:21.587183 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:22:21.587183 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:22:21.587183 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:22:21.587183 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dd3523f9-d20c-48db-946b-9995eb35d859) Oct 12 13:22:21.587183 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:21.587183 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:21.587183 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:21.587183 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:21.587183 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:21.587183 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:21.587183 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:21.587183 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:21.587183 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:22:21.587183 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:22:21.588150 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:22:21.588150 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:21.588150 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:21.588150 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:21.588150 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:21.588150 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:21.588150 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:21.588150 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:21.588150 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:22:21.588150 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:22:21.588150 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:22:21.588150 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:21.588150 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:21.588150 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-653b093d-a8a1-4405-9d93-16b5b18d552f tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:22:21.588150 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:21.590248 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-653b093d-a8a1-4405-9d93-16b5b18d552f tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.25 time: 0.446497 Oct 12 13:22:21.590248 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 143/261] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 12 13:22:21 2022] POST /compute/v2.1/servers => generated 214 bytes in 448 msecs (HTTP/1.1 500) 9 headers in 393 bytes (2 switches on core 0) Oct 12 13:22:21.731801 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e482013e-73bf-4943-9691-92c3ecd7dac3 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:21.732412 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-e482013e-73bf-4943-9691-92c3ecd7dac3 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:21.739229 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e482013e-73bf-4943-9691-92c3ecd7dac3 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:21.740260 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e482013e-73bf-4943-9691-92c3ecd7dac3 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:21.740980 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e482013e-73bf-4943-9691-92c3ecd7dac3 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:21.742464 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e482013e-73bf-4943-9691-92c3ecd7dac3 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:21.743029 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e482013e-73bf-4943-9691-92c3ecd7dac3 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:21.743673 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e482013e-73bf-4943-9691-92c3ecd7dac3 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:21.862127 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a5b3a6ae-b703-4743-bcfa-c7fd071fbd7e tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.381361 Oct 12 13:22:21.862767 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 119/262] 10.222.0.52 () {60 vars in 1191 bytes} [Wed Oct 12 13:22:21 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:21.882615 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1c688128-1702-426c-ae52-6da936bcacfa tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:21.887831 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e482013e-73bf-4943-9691-92c3ecd7dac3 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:21.901504 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e482013e-73bf-4943-9691-92c3ecd7dac3 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:21.903054 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e482013e-73bf-4943-9691-92c3ecd7dac3 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:21.910118 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e482013e-73bf-4943-9691-92c3ecd7dac3 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1417 microversion: 2.75 time: 0.182112 Oct 12 13:22:21.910699 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 144/263] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:21 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1417 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:21.999820 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1c688128-1702-426c-ae52-6da936bcacfa tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.120925 Oct 12 13:22:22.001688 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 120/264] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:22:21 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 13:22:22.015682 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b9c112b9-6d7f-480d-a1c8-f7b87fc0c42f tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1152285308"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:22.021434 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.aggregate [None req-b9c112b9-6d7f-480d-a1c8-f7b87fc0c42f tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Generated uuid f212da8c-336b-408d-900d-68a7f0ed5e1a for aggregate {{(pid=120933) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 13:22:22.135361 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b9c112b9-6d7f-480d-a1c8-f7b87fc0c42f tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.126374 Oct 12 13:22:22.135978 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 145/265] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 12 13:22:22 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:22:22.150537 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-167770d2-792a-4a1c-a1c7-5865010cb82f tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861076-2"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:22.167231 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-167770d2-792a-4a1c-a1c7-5865010cb82f tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:22.168034 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-167770d2-792a-4a1c-a1c7-5865010cb82f tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:22.168550 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-167770d2-792a-4a1c-a1c7-5865010cb82f tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:22.223573 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e0b2b0a1-8b3e-48aa-a9af-cc1bd38af5f8 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Calling method '.version_select at 0x7f8aa02ee550>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:22.228021 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0b2b0a1-8b3e-48aa-a9af-cc1bd38af5f8 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:22.228511 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0b2b0a1-8b3e-48aa-a9af-cc1bd38af5f8 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:22.228977 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0b2b0a1-8b3e-48aa-a9af-cc1bd38af5f8 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:22.245844 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0b2b0a1-8b3e-48aa-a9af-cc1bd38af5f8 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:22.246442 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0b2b0a1-8b3e-48aa-a9af-cc1bd38af5f8 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:22.246885 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0b2b0a1-8b3e-48aa-a9af-cc1bd38af5f8 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:22.273268 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0b2b0a1-8b3e-48aa-a9af-cc1bd38af5f8 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:22.275481 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0b2b0a1-8b3e-48aa-a9af-cc1bd38af5f8 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:22.276310 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0b2b0a1-8b3e-48aa-a9af-cc1bd38af5f8 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:22.307926 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0b2b0a1-8b3e-48aa-a9af-cc1bd38af5f8 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:22.308410 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0b2b0a1-8b3e-48aa-a9af-cc1bd38af5f8 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:22.308839 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0b2b0a1-8b3e-48aa-a9af-cc1bd38af5f8 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:22.333841 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0b2b0a1-8b3e-48aa-a9af-cc1bd38af5f8 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:22.334336 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0b2b0a1-8b3e-48aa-a9af-cc1bd38af5f8 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:22.334975 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0b2b0a1-8b3e-48aa-a9af-cc1bd38af5f8 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:22.342296 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e0b2b0a1-8b3e-48aa-a9af-cc1bd38af5f8 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1664 microversion: 2.53 time: 0.315421 Oct 12 13:22:22.343573 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 121/266] 10.222.0.52 () {60 vars in 1243 bytes} [Wed Oct 12 13:22:22 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1664 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:22.360736 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f820073f-5b4f-4440-a2c3-29d9ea336d52 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Calling method '.version_select at 0x7f8aa02fb3a0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:22.365492 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f820073f-5b4f-4440-a2c3-29d9ea336d52 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:22.365981 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f820073f-5b4f-4440-a2c3-29d9ea336d52 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:22.366627 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f820073f-5b4f-4440-a2c3-29d9ea336d52 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:22.383186 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f820073f-5b4f-4440-a2c3-29d9ea336d52 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:22.383678 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f820073f-5b4f-4440-a2c3-29d9ea336d52 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:22.384118 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f820073f-5b4f-4440-a2c3-29d9ea336d52 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:22.397702 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f820073f-5b4f-4440-a2c3-29d9ea336d52 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:22.402136 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f820073f-5b4f-4440-a2c3-29d9ea336d52 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:22.402136 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f820073f-5b4f-4440-a2c3-29d9ea336d52 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:22.409154 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f820073f-5b4f-4440-a2c3-29d9ea336d52 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:22.409645 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f820073f-5b4f-4440-a2c3-29d9ea336d52 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:22.410080 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f820073f-5b4f-4440-a2c3-29d9ea336d52 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:22.429984 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f820073f-5b4f-4440-a2c3-29d9ea336d52 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:22.430470 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f820073f-5b4f-4440-a2c3-29d9ea336d52 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:22.430907 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f820073f-5b4f-4440-a2c3-29d9ea336d52 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:22.437640 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f820073f-5b4f-4440-a2c3-29d9ea336d52 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 357 microversion: 2.53 time: 0.081224 Oct 12 13:22:22.438211 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 122/267] 10.222.0.52 () {60 vars in 1222 bytes} [Wed Oct 12 13:22:22 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 357 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 13:22:22.449786 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-80dee1ca-bf9b-4cf2-b40c-e3a3a58afd53 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Calling method '.version_select at 0x7f8aa029ef70>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:22.461644 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-80dee1ca-bf9b-4cf2-b40c-e3a3a58afd53 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:22.461644 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-80dee1ca-bf9b-4cf2-b40c-e3a3a58afd53 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:22.461644 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-80dee1ca-bf9b-4cf2-b40c-e3a3a58afd53 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:22.482417 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-80dee1ca-bf9b-4cf2-b40c-e3a3a58afd53 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:22.483520 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-80dee1ca-bf9b-4cf2-b40c-e3a3a58afd53 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:22.484249 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-80dee1ca-bf9b-4cf2-b40c-e3a3a58afd53 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:22.495757 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-80dee1ca-bf9b-4cf2-b40c-e3a3a58afd53 tempest-HypervisorAdminV253TestBase-1979077285 tempest-HypervisorAdminV253TestBase-1979077285-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/493cff44-bb5a-4e48-b097-cc3b44671d98" status: 200 len: 791 microversion: 2.53 time: 0.049272 Oct 12 13:22:22.496660 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 123/268] 10.222.0.52 () {60 vars in 1298 bytes} [Wed Oct 12 13:22:22 2022] GET /compute/v2.1/os-hypervisors/493cff44-bb5a-4e48-b097-cc3b44671d98 => generated 791 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 13:22:22.523670 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-167770d2-792a-4a1c-a1c7-5865010cb82f tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.379915 Oct 12 13:22:22.527099 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 146/269] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 12 13:22:22 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:22.537369 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-de1c8881-0c4b-42af-a90d-6a312f932ed4 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:22.544784 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-de1c8881-0c4b-42af-a90d-6a312f932ed4 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.011107 Oct 12 13:22:22.549260 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 124/270] 10.222.0.52 () {58 vars in 1143 bytes} [Wed Oct 12 13:22:22 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:22.557118 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1c16daf6-307d-4300-87b0-e72d037e8ea2 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861076-2"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:22.569144 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1c16daf6-307d-4300-87b0-e72d037e8ea2 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:22.569637 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1c16daf6-307d-4300-87b0-e72d037e8ea2 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:22.570077 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1c16daf6-307d-4300-87b0-e72d037e8ea2 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:22.941502 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6923204a-4490-443b-b733-a1a7ccd412b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:22.942473 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6923204a-4490-443b-b733-a1a7ccd412b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:22.955042 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1c16daf6-307d-4300-87b0-e72d037e8ea2 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.401658 Oct 12 13:22:22.955649 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 147/271] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 12 13:22:22 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:22.956507 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6923204a-4490-443b-b733-a1a7ccd412b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:22.957166 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6923204a-4490-443b-b733-a1a7ccd412b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:22.957602 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6923204a-4490-443b-b733-a1a7ccd412b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:22.958479 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6923204a-4490-443b-b733-a1a7ccd412b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:22.958935 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6923204a-4490-443b-b733-a1a7ccd412b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:22.959995 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6923204a-4490-443b-b733-a1a7ccd412b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:22.969862 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-92103e76-fa38-40e3-a2fa-74da3c1ec5ab tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:23.045088 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-6923204a-4490-443b-b733-a1a7ccd412b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:23.059044 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-6923204a-4490-443b-b733-a1a7ccd412b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:23.059044 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-6923204a-4490-443b-b733-a1a7ccd412b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:23.062831 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6923204a-4490-443b-b733-a1a7ccd412b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1417 microversion: 2.75 time: 0.126289 Oct 12 13:22:23.063426 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 125/272] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:22 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1417 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:23.237115 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-92103e76-fa38-40e3-a2fa-74da3c1ec5ab tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.273512 Oct 12 13:22:23.238483 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 148/273] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 12 13:22:22 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 13:22:23.253025 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-05e4a8e4-d61a-4cad-84e2-fa9d1368d1e9 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-900131874"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:23.257107 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.aggregate [None req-05e4a8e4-d61a-4cad-84e2-fa9d1368d1e9 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Generated uuid 4c0eeded-8ffc-411c-8839-1798a0f26f6f for aggregate {{(pid=120932) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 13:22:23.375216 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-05e4a8e4-d61a-4cad-84e2-fa9d1368d1e9 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.126775 Oct 12 13:22:23.381454 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 126/274] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 12 13:22:23 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:23.388751 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e0bbddc4-5a81-4394-ab7e-f294dd406bba tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861076-2"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:23.412641 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e0bbddc4-5a81-4394-ab7e-f294dd406bba tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:23.413712 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e0bbddc4-5a81-4394-ab7e-f294dd406bba tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:23.414171 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e0bbddc4-5a81-4394-ab7e-f294dd406bba tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:23.793330 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e0bbddc4-5a81-4394-ab7e-f294dd406bba tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.409280 Oct 12 13:22:23.802728 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 149/275] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 12 13:22:23 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:23.807659 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b83acd8e-d0c8-4d04-87b1-7788b8a7b355 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861076-2"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:23.822905 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b83acd8e-d0c8-4d04-87b1-7788b8a7b355 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:23.823812 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b83acd8e-d0c8-4d04-87b1-7788b8a7b355 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:23.824547 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b83acd8e-d0c8-4d04-87b1-7788b8a7b355 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:23.829431 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=100 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:24.091580 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4c3ff571-3716-4977-ae0c-d13ebfd280c8 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:24.092629 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-4c3ff571-3716-4977-ae0c-d13ebfd280c8 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:24.100795 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4c3ff571-3716-4977-ae0c-d13ebfd280c8 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:24.101580 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4c3ff571-3716-4977-ae0c-d13ebfd280c8 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:24.101965 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4c3ff571-3716-4977-ae0c-d13ebfd280c8 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:24.102752 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4c3ff571-3716-4977-ae0c-d13ebfd280c8 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:24.103202 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4c3ff571-3716-4977-ae0c-d13ebfd280c8 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:24.103922 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4c3ff571-3716-4977-ae0c-d13ebfd280c8 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:24.191606 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b83acd8e-d0c8-4d04-87b1-7788b8a7b355 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.389006 Oct 12 13:22:24.193022 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 127/276] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 12 13:22:23 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:24.199686 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-4c3ff571-3716-4977-ae0c-d13ebfd280c8 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:24.206119 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-31d83e45-8c7a-4a7d-a008-081e23ab5797 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:24.206298 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-4c3ff571-3716-4977-ae0c-d13ebfd280c8 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:24.207849 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-4c3ff571-3716-4977-ae0c-d13ebfd280c8 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:24.227182 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4c3ff571-3716-4977-ae0c-d13ebfd280c8 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1417 microversion: 2.75 time: 0.126199 Oct 12 13:22:24.228155 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 150/277] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:24 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1417 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:24.361484 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-31d83e45-8c7a-4a7d-a008-081e23ab5797 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.159068 Oct 12 13:22:24.369469 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 128/278] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 12 13:22:24 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 13:22:24.373603 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-90f69650-95ca-401b-987b-4f4c82c11d29 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-664815650"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:24.377308 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.aggregate [None req-90f69650-95ca-401b-987b-4f4c82c11d29 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Generated uuid 5fafd83b-eaf5-46a3-b8e7-489134195852 for aggregate {{(pid=120933) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 13:22:24.408838 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-54acffa3-6d49-4b87-b9e4-f389e1e46143 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-587412782"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:24.412981 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.aggregate [None req-54acffa3-6d49-4b87-b9e4-f389e1e46143 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Generated uuid 4575de92-d838-4dcd-a451-72251ca9abd5 for aggregate {{(pid=120932) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 13:22:24.527705 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-90f69650-95ca-401b-987b-4f4c82c11d29 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.158536 Oct 12 13:22:24.528711 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 151/279] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 12 13:22:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:24.529934 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-54acffa3-6d49-4b87-b9e4-f389e1e46143 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.126754 Oct 12 13:22:24.530562 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 129/280] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 12 13:22:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:22:24.541157 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cfed4df0-80b5-43d0-9ee7-c71348dde0b2 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:24.541601 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bfc5e87a-4faa-4813-ab72-39f44ccafae7 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861076-2"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:24.561298 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bfc5e87a-4faa-4813-ab72-39f44ccafae7 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:24.561992 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bfc5e87a-4faa-4813-ab72-39f44ccafae7 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:24.562585 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bfc5e87a-4faa-4813-ab72-39f44ccafae7 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:24.691062 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-cfed4df0-80b5-43d0-9ee7-c71348dde0b2 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.153210 Oct 12 13:22:24.691930 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 152/281] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 12 13:22:24 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 13:22:24.700431 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-45de7efc-50d1-4e15-b056-f1208f92e532 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:24.708814 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-45de7efc-50d1-4e15-b056-f1208f92e532 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 12 13:22:24.710511 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-45de7efc-50d1-4e15-b056-f1208f92e532 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Request method failure captured: Oct 12 13:22:24.710511 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 12 13:22:24.710511 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:24.710511 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:24.710511 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:24.710511 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:22:24.710511 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:24.710511 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:24.710511 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:24.710511 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:24.710511 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9hefw9J0TWypmXyMZpZ2tBpW8SWC7eShk69dzN4tbwlh74BZN4LojceP8F4nmuRlfCqUYrVVeuV-ED8nqY1aI6a0yoWw2YIiJPyo9YkGnbv-sMrgTiQOk45jOKTfaxevfGU-WRI5WhLFwEYJkv1TXG9_nB6pInRsRYD8sUJ3pSAe4 Oct 12 13:22:24.710511 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:24.710511 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:24.710511 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:24.710511 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:24.710511 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:24.710511 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:24.710511 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: a7200cb22658498ca625ee8f00237c84 Oct 12 13:22:24.710511 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AggregatesAdminTestJSON-1627661408 Oct 12 13:22:24.710511 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:22:24.710511 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:22:24.711830 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a7200cb22658498ca625ee8f00237c84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a7200cb22658498ca625ee8f00237c84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a7200cb22658498ca625ee8f00237c84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a7200cb22658498ca625ee8f00237c84"}]}] Oct 12 13:22:24.711830 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AggregatesAdminTestJSON-1627661408 Oct 12 13:22:24.711830 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: a7200cb22658498ca625ee8f00237c84 Oct 12 13:22:24.711830 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1627661408 Oct 12 13:22:24.711830 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AggregatesAdminTestJSON-1627661408-project-admin Oct 12 13:22:24.711830 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:24.711830 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:24.711830 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 4e0b6f9416434fcbadbc0748eb6f1ecc Oct 12 13:22:24.711830 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AggregatesAdminTestJSON-1627661408-project-admin Oct 12 13:22:24.711830 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:22:24.711830 n-d-861076-2 devstack@n-api.service[120933]: exception: Aggregate 12 could not be found. Oct 12 13:22:24.711830 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '12'} Oct 12 13:22:24.711830 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:24.712538 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:24.712538 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 12 13:22:24.712538 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 12 13:22:24.712538 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 12 13:22:24.712538 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 13:22:24.712538 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:22:24.712538 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:22:24.712538 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 13:22:24.712538 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 13:22:24.712538 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:22:24.712538 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:22:24.712538 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 13:22:24.712538 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 13:22:24.712538 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 12 13:22:24.712538 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:24.712538 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:24.712538 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:24.712538 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:24.712538 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:24.713593 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:24.713593 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:24.713593 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:24.713593 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:24.713593 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:24.713593 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 12 13:22:24.713593 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:22:24.713593 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 12 13:22:24.713593 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:24.713593 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:24.713593 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:24.713593 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:24.713593 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:24.713593 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:24.713593 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:22:24.713593 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:22:24.713593 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 12 13:22:24.713593 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:24.716415 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-45de7efc-50d1-4e15-b056-f1208f92e532 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:24.717418 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-45de7efc-50d1-4e15-b056-f1208f92e532 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.021342 Oct 12 13:22:24.718337 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 153/282] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:22:24 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 12 13:22:24.728932 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f7acf82b-9b1a-4608-b1e2-3c12b5458f28 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:24.742018 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-f7acf82b-9b1a-4608-b1e2-3c12b5458f28 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 12 13:22:24.743899 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f7acf82b-9b1a-4608-b1e2-3c12b5458f28 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Request method failure captured: Oct 12 13:22:24.743899 n-d-861076-2 devstack@n-api.service[120933]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 12 13:22:24.743899 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:24.743899 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:24.743899 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:24.743899 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:22:24.743899 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:24.743899 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:24.743899 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:24.743899 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:24.743899 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9hefw9J0TWypmXyMZpZ2tBpW8SWC7eShk69dzN4tbwlh74BZN4LojceP8F4nmuRlfCqUYrVVeuV-ED8nqY1aI6a0yoWw2YIiJPyo9YkGnbv-sMrgTiQOk45jOKTfaxevfGU-WRI5WhLFwEYJkv1TXG9_nB6pInRsRYD8sUJ3pSAe4 Oct 12 13:22:24.743899 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:24.743899 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:24.743899 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:24.743899 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:24.743899 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:24.743899 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:24.743899 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: a7200cb22658498ca625ee8f00237c84 Oct 12 13:22:24.743899 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AggregatesAdminTestJSON-1627661408 Oct 12 13:22:24.743899 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:22:24.743899 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:22:24.745146 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a7200cb22658498ca625ee8f00237c84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a7200cb22658498ca625ee8f00237c84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a7200cb22658498ca625ee8f00237c84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a7200cb22658498ca625ee8f00237c84"}]}] Oct 12 13:22:24.745146 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AggregatesAdminTestJSON-1627661408 Oct 12 13:22:24.745146 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: a7200cb22658498ca625ee8f00237c84 Oct 12 13:22:24.745146 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1627661408 Oct 12 13:22:24.745146 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AggregatesAdminTestJSON-1627661408-project-admin Oct 12 13:22:24.745146 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:24.745146 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:24.745146 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 4e0b6f9416434fcbadbc0748eb6f1ecc Oct 12 13:22:24.745146 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AggregatesAdminTestJSON-1627661408-project-admin Oct 12 13:22:24.745146 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:22:24.745146 n-d-861076-2 devstack@n-api.service[120933]: exception: Aggregate 12 could not be found. Oct 12 13:22:24.745146 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '12'} Oct 12 13:22:24.745146 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:24.745836 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:24.745836 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 12 13:22:24.745836 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 12 13:22:24.745836 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 13:22:24.745836 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 13:22:24.745836 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:22:24.745836 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:22:24.745836 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:22:24.745836 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:22:24.745836 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 13:22:24.745836 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 13:22:24.745836 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 12 13:22:24.745836 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 13:22:24.745836 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:22:24.745836 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:22:24.745836 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 13:22:24.745836 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 13:22:24.745836 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:22:24.745836 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:22:24.746864 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 13:22:24.746864 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 13:22:24.746864 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 12 13:22:24.746864 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:24.746864 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:24.746864 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:24.746864 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:24.746864 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:24.746864 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:24.746864 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:24.746864 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:24.746864 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:24.746864 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:24.746864 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 12 13:22:24.746864 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:22:24.746864 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 12 13:22:24.746864 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:24.746864 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:24.746864 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:24.746864 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:24.746864 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:24.747934 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:24.747934 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:22:24.747934 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:22:24.747934 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 12 13:22:24.747934 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:24.749931 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f7acf82b-9b1a-4608-b1e2-3c12b5458f28 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:24.750973 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f7acf82b-9b1a-4608-b1e2-3c12b5458f28 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.026960 Oct 12 13:22:24.751959 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 154/283] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 12 13:22:24 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:22:24.766898 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1fc387bb-c4c5-4fdd-ab64-988d159bd21c tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1331165505", "name": "tempest-test_aggregate-649631312"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:24.796172 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.aggregate [None req-1fc387bb-c4c5-4fdd-ab64-988d159bd21c tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Generated uuid 824579d6-0f86-4cb8-ba35-e7c39c0cee50 for aggregate {{(pid=120933) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 13:22:25.005407 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1fc387bb-c4c5-4fdd-ab64-988d159bd21c tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.247945 Oct 12 13:22:25.008636 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 155/284] 10.222.0.52 () {60 vars in 1165 bytes} [Wed Oct 12 13:22:24 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:25.030337 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b63b876d-cc5d-4633-8bda-886fde839e99 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:25.113286 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bfc5e87a-4faa-4813-ab72-39f44ccafae7 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 242 microversion: 2.1 time: 0.565812 Oct 12 13:22:25.113286 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 130/285] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 12 13:22:24 2022] POST /compute/v2.1/os-aggregates/13/action => generated 242 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:25.116030 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c0302f7b-f661-44da-9274-8d1784fb561a tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861076-2"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:25.119286 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c0302f7b-f661-44da-9274-8d1784fb561a tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'c463e23684544c34b872e2b6329c7180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9aebbf88bb47cab5110557308711bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:25.126341 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c0302f7b-f661-44da-9274-8d1784fb561a tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Request method failure captured: Oct 12 13:22:25.126341 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 12 13:22:25.126341 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:22:25.126341 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:22:25.126341 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:22:25.126341 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 42 Oct 12 13:22:25.126341 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:22:25.126341 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:22:25.126341 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:22:25.126341 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:25.126341 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr9eSx-TU6YutT1a6IF-xOmb3Q2osrlfpIVekEWjievjumBvUdovXijZwSBNsjrGwXFqjhHTWER0nDN6Pke1K23rskmyvPO5WrpQpvSgj_OcptSQhER5EPIjN8DxH6HF8pYzlrH_CQ1FGJnP_fDIXwOZntPedU07e4xcMOPYOb118qQ Oct 12 13:22:25.126341 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:22:25.126341 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:22:25.126341 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:22:25.126341 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:22:25.126341 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:22:25.126341 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:22:25.126341 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 6e9aebbf88bb47cab5110557308711bf Oct 12 13:22:25.126341 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-774722693 Oct 12 13:22:25.126341 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:22:25.126341 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:22:25.128034 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6e9aebbf88bb47cab5110557308711bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6e9aebbf88bb47cab5110557308711bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6e9aebbf88bb47cab5110557308711bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6e9aebbf88bb47cab5110557308711bf"}]}] Oct 12 13:22:25.128034 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-774722693 Oct 12 13:22:25.128034 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 6e9aebbf88bb47cab5110557308711bf Oct 12 13:22:25.128034 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-774722693 Oct 12 13:22:25.128034 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-AggregatesAdminNegativeTestJSON-774722693-project Oct 12 13:22:25.128034 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:22:25.128034 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:22:25.128034 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: c463e23684544c34b872e2b6329c7180 Oct 12 13:22:25.128034 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-774722693-project Oct 12 13:22:25.128034 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:22:25.128034 n-d-861076-2 devstack@n-api.service[120932]: {"remove_host": {"host": "n-h1-861076-2"}} Oct 12 13:22:25.128034 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:22:25.128034 n-d-861076-2 devstack@n-api.service[120932]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 12 13:22:25.128948 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h1-861076-2'}}} Oct 12 13:22:25.128948 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:25.128948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:25.128948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:25.128948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:25.128948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:25.128948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:25.128948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:25.128948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:25.128948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:25.128948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:25.128948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 12 13:22:25.128948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 12 13:22:25.128948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:22:25.128948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:22:25.128948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:22:25.128948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:22:25.128948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:22:25.128948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:22:25.130198 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:22:25.130198 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:22:25.130198 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:22:25.130198 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:22:25.130198 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:22:25.130198 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:22:25.130198 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:22:25.130198 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:22:25.130198 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 12 13:22:25.130198 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:25.130198 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:25.130198 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:25.130198 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:25.130198 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:25.130198 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:25.130198 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:22:25.130198 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:22:25.130198 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 12 13:22:25.130198 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:25.132345 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c0302f7b-f661-44da-9274-8d1784fb561a tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:25.133630 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c0302f7b-f661-44da-9274-8d1784fb561a tempest-AggregatesAdminNegativeTestJSON-774722693 tempest-AggregatesAdminNegativeTestJSON-774722693-project] 10.222.0.52 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.021861 Oct 12 13:22:25.134664 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 131/286] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 12 13:22:25 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 12 13:22:25.143805 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-62fcbcd4-9f10-4c34-97f7-92f936b5e6b7 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861076-2"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:25.171165 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62fcbcd4-9f10-4c34-97f7-92f936b5e6b7 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:25.171923 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62fcbcd4-9f10-4c34-97f7-92f936b5e6b7 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:25.172358 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62fcbcd4-9f10-4c34-97f7-92f936b5e6b7 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:25.216617 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b63b876d-cc5d-4633-8bda-886fde839e99 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.200433 Oct 12 13:22:25.219145 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 156/287] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 12 13:22:25 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 12 13:22:25.229423 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9c58036c-6736-4cf3-9b7e-288b426e56c9 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:25.241344 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-9c58036c-6736-4cf3-9b7e-288b426e56c9 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 12 13:22:25.244469 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9c58036c-6736-4cf3-9b7e-288b426e56c9 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Request method failure captured: Oct 12 13:22:25.244469 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 12 13:22:25.244469 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:25.244469 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:25.244469 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:25.244469 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:22:25.244469 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:25.244469 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:25.244469 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:25.244469 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:25.244469 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9hefw9J0TWypmXyMZpZ2tBpW8SWC7eShk69dzN4tbwlh74BZN4LojceP8F4nmuRlfCqUYrVVeuV-ED8nqY1aI6a0yoWw2YIiJPyo9YkGnbv-sMrgTiQOk45jOKTfaxevfGU-WRI5WhLFwEYJkv1TXG9_nB6pInRsRYD8sUJ3pSAe4 Oct 12 13:22:25.244469 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:25.244469 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:25.244469 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:25.244469 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:25.244469 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:25.244469 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:25.244469 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: a7200cb22658498ca625ee8f00237c84 Oct 12 13:22:25.244469 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AggregatesAdminTestJSON-1627661408 Oct 12 13:22:25.244469 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:22:25.244469 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:22:25.245827 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a7200cb22658498ca625ee8f00237c84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a7200cb22658498ca625ee8f00237c84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a7200cb22658498ca625ee8f00237c84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a7200cb22658498ca625ee8f00237c84"}]}] Oct 12 13:22:25.245827 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AggregatesAdminTestJSON-1627661408 Oct 12 13:22:25.245827 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: a7200cb22658498ca625ee8f00237c84 Oct 12 13:22:25.245827 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1627661408 Oct 12 13:22:25.245827 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AggregatesAdminTestJSON-1627661408-project-admin Oct 12 13:22:25.245827 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:25.245827 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:25.245827 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 4e0b6f9416434fcbadbc0748eb6f1ecc Oct 12 13:22:25.245827 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AggregatesAdminTestJSON-1627661408-project-admin Oct 12 13:22:25.245827 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:22:25.245827 n-d-861076-2 devstack@n-api.service[120933]: exception: Aggregate 14 could not be found. Oct 12 13:22:25.245827 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '14'} Oct 12 13:22:25.245827 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:25.246527 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:25.246527 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 12 13:22:25.246527 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 12 13:22:25.246527 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 12 13:22:25.246527 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 13:22:25.246527 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:22:25.246527 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:22:25.246527 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 13:22:25.246527 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 13:22:25.246527 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:22:25.246527 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:22:25.246527 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 13:22:25.246527 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 13:22:25.246527 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 12 13:22:25.246527 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:25.246527 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:25.246527 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:25.246527 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:25.246527 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:25.247565 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:25.247565 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:25.247565 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:25.247565 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:25.247565 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:25.247565 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 12 13:22:25.247565 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:22:25.247565 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 12 13:22:25.247565 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:25.247565 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:25.247565 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:25.247565 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:25.247565 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:25.247565 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:25.247565 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:22:25.247565 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:22:25.247565 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 12 13:22:25.247565 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:25.250653 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9c58036c-6736-4cf3-9b7e-288b426e56c9 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:25.252869 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:DELETE=8,nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:25.253843 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9c58036c-6736-4cf3-9b7e-288b426e56c9 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.028703 Oct 12 13:22:25.255319 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 157/288] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:22:25 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:22:25.265836 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9f7344f5-fd12-43f0-98d2-26a7403a99ee tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:25.265836 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-9f7344f5-fd12-43f0-98d2-26a7403a99ee tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:25.271829 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9f7344f5-fd12-43f0-98d2-26a7403a99ee tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:25.272327 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9f7344f5-fd12-43f0-98d2-26a7403a99ee tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:25.273099 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9f7344f5-fd12-43f0-98d2-26a7403a99ee tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:25.274944 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9f7344f5-fd12-43f0-98d2-26a7403a99ee tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:25.275593 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9f7344f5-fd12-43f0-98d2-26a7403a99ee tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:25.276288 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9f7344f5-fd12-43f0-98d2-26a7403a99ee tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:25.408867 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9f7344f5-fd12-43f0-98d2-26a7403a99ee tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:25.422890 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9f7344f5-fd12-43f0-98d2-26a7403a99ee tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:25.424365 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9f7344f5-fd12-43f0-98d2-26a7403a99ee tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:25.430969 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9f7344f5-fd12-43f0-98d2-26a7403a99ee tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1417 microversion: 2.75 time: 0.173994 Oct 12 13:22:25.432037 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 158/289] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:25 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1417 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:25.444250 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f87aea12-bf73-4a55-9980-fd31641611af tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:25.469175 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-f87aea12-bf73-4a55-9980-fd31641611af tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 12 13:22:25.470925 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f87aea12-bf73-4a55-9980-fd31641611af tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Request method failure captured: Oct 12 13:22:25.470925 n-d-861076-2 devstack@n-api.service[120933]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 12 13:22:25.470925 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:25.470925 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:25.470925 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:25.470925 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:22:25.470925 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:25.470925 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:25.470925 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:25.470925 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:25.470925 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9hefw9J0TWypmXyMZpZ2tBpW8SWC7eShk69dzN4tbwlh74BZN4LojceP8F4nmuRlfCqUYrVVeuV-ED8nqY1aI6a0yoWw2YIiJPyo9YkGnbv-sMrgTiQOk45jOKTfaxevfGU-WRI5WhLFwEYJkv1TXG9_nB6pInRsRYD8sUJ3pSAe4 Oct 12 13:22:25.470925 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:25.470925 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:25.470925 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:25.470925 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:25.470925 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:25.470925 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:25.470925 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: a7200cb22658498ca625ee8f00237c84 Oct 12 13:22:25.470925 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AggregatesAdminTestJSON-1627661408 Oct 12 13:22:25.470925 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:22:25.470925 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:22:25.472058 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a7200cb22658498ca625ee8f00237c84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a7200cb22658498ca625ee8f00237c84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a7200cb22658498ca625ee8f00237c84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a7200cb22658498ca625ee8f00237c84"}]}] Oct 12 13:22:25.472058 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AggregatesAdminTestJSON-1627661408 Oct 12 13:22:25.472058 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: a7200cb22658498ca625ee8f00237c84 Oct 12 13:22:25.472058 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1627661408 Oct 12 13:22:25.472058 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AggregatesAdminTestJSON-1627661408-project-admin Oct 12 13:22:25.472058 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:25.472058 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:25.472058 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 4e0b6f9416434fcbadbc0748eb6f1ecc Oct 12 13:22:25.472058 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AggregatesAdminTestJSON-1627661408-project-admin Oct 12 13:22:25.472058 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:22:25.472058 n-d-861076-2 devstack@n-api.service[120933]: exception: Aggregate 14 could not be found. Oct 12 13:22:25.472058 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '14'} Oct 12 13:22:25.472058 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:25.472748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:25.472748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 12 13:22:25.472748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 12 13:22:25.472748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 13:22:25.472748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 13:22:25.472748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:22:25.472748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:22:25.472748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:22:25.472748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:22:25.472748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 13:22:25.472748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 13:22:25.472748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 12 13:22:25.472748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 13:22:25.472748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:22:25.472748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:22:25.472748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 13:22:25.472748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 13:22:25.472748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:22:25.472748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:22:25.473766 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 13:22:25.473766 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 13:22:25.473766 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 12 13:22:25.473766 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:25.473766 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:25.473766 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:25.473766 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:25.473766 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:25.473766 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:25.473766 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:25.473766 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:25.473766 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:25.473766 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:25.473766 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 12 13:22:25.473766 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:22:25.473766 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 12 13:22:25.473766 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:25.473766 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:25.473766 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:25.473766 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:25.473766 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:25.474935 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:25.474935 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:22:25.474935 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:22:25.474935 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 12 13:22:25.474935 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:25.474935 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f87aea12-bf73-4a55-9980-fd31641611af tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:25.474935 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f87aea12-bf73-4a55-9980-fd31641611af tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.038857 Oct 12 13:22:25.474935 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 159/290] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 12 13:22:25 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:22:25.492636 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e1602f66-0314-4092-b94a-931d88a2282a tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1601229294"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:25.498993 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.aggregate [None req-e1602f66-0314-4092-b94a-931d88a2282a tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Generated uuid 419feed7-7a77-4a99-8b36-dc5049bc1129 for aggregate {{(pid=120933) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 13:22:25.537881 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-62fcbcd4-9f10-4c34-97f7-92f936b5e6b7 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.399056 Oct 12 13:22:25.538595 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 132/291] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 12 13:22:25 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:22:25.551311 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3c0f3a9d-6a9c-4989-adfd-0a3674fb9763 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:25.597865 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:DELETE=10,nova_api:SELECT=82,nova_api:INSERT=8 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:25.613466 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e1602f66-0314-4092-b94a-931d88a2282a tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.126700 Oct 12 13:22:25.613466 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 160/292] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 12 13:22:25 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:25.620440 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b5328f9f-9dd2-4ce7-8286-856d1811bc48 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:25.630185 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b5328f9f-9dd2-4ce7-8286-856d1811bc48 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 228 microversion: 2.1 time: 0.013711 Oct 12 13:22:25.630748 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 161/293] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:22:25 2022] GET /compute/v2.1/os-aggregates/15 => generated 228 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:22:25.640993 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3c0f3a9d-6a9c-4989-adfd-0a3674fb9763 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.093796 Oct 12 13:22:25.641864 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 133/294] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 12 13:22:25 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 13:22:25.647177 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-75a226b0-18b5-457d-9338-173f8734d02e tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:25.657565 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bfc0fcc5-4ef1-4fd9-be21-2bccc8b4173c tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1022888928"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:25.662804 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.aggregate [None req-bfc0fcc5-4ef1-4fd9-be21-2bccc8b4173c tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Generated uuid 3acc99ad-d378-425b-86b0-3b158946b9a7 for aggregate {{(pid=120932) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 13:22:25.780097 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-75a226b0-18b5-457d-9338-173f8734d02e tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 266 microversion: 2.1 time: 0.138001 Oct 12 13:22:25.787439 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bfc0fcc5-4ef1-4fd9-be21-2bccc8b4173c tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.136563 Oct 12 13:22:25.788823 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 134/295] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 12 13:22:25 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:25.789253 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 162/296] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 12 13:22:25 2022] POST /compute/v2.1/os-aggregates/15/action => generated 266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:22:25.793584 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b9dbef3f-bd22-440b-840d-a0c71b5e4038 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:25.803231 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b907e66a-7f52-4011-88a7-b36e8e5fab40 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:25.803443 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b9dbef3f-bd22-440b-840d-a0c71b5e4038 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 242 microversion: 2.1 time: 0.013262 Oct 12 13:22:25.806581 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 135/297] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:22:25 2022] GET /compute/v2.1/os-aggregates/15 => generated 242 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:25.818541 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9c704084-8fe4-40fb-be86-4f26e22bb953 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:25.822478 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b907e66a-7f52-4011-88a7-b36e8e5fab40 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:25.823071 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b907e66a-7f52-4011-88a7-b36e8e5fab40 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:25.823600 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b907e66a-7f52-4011-88a7-b36e8e5fab40 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:25.830200 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b907e66a-7f52-4011-88a7-b36e8e5fab40 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:25.830932 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b907e66a-7f52-4011-88a7-b36e8e5fab40 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:25.831530 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b907e66a-7f52-4011-88a7-b36e8e5fab40 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:25.838999 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.compute.aggregates [None req-b907e66a-7f52-4011-88a7-b36e8e5fab40 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 12 13:22:25.839704 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-b907e66a-7f52-4011-88a7-b36e8e5fab40 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Oct 12 13:22:25.841794 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b907e66a-7f52-4011-88a7-b36e8e5fab40 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Request method failure captured: Oct 12 13:22:25.841794 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Oct 12 13:22:25.841794 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:25.841794 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:25.841794 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:25.841794 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 42 Oct 12 13:22:25.841794 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:25.841794 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:25.841794 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:25.841794 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:25.841794 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9gY2zHBQTV6Bc74geZqbSLE204Cvy0Kcd7D18N4HZm9Dlkt_4MS-4rS79SJ4WfECmTtVtTl-U3awXx7Z4-AHHpeYlq_I1hh4qjaUJdemPNUoLjNt5mHcjiunV5QEJUiJd4YLBAe9gjBz0ojxSDq2_6yRbadCl1xCP7Q1Oy6dj5F2c Oct 12 13:22:25.841794 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:25.841794 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:25.841794 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:25.841794 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:25.841794 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:25.841794 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:25.841794 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 1e3b0370297f4b7aaad100cb0a0e443e Oct 12 13:22:25.841794 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:22:25.841794 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:22:25.841794 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:22:25.842999 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1e3b0370297f4b7aaad100cb0a0e443e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1e3b0370297f4b7aaad100cb0a0e443e"}]}] Oct 12 13:22:25.842999 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:22:25.842999 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 1e3b0370297f4b7aaad100cb0a0e443e Oct 12 13:22:25.842999 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022 Oct 12 13:22:25.842999 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin Oct 12 13:22:25.842999 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:25.842999 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:25.842999 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 0bc3956115334bdda915ed371f80cd04 Oct 12 13:22:25.842999 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin Oct 12 13:22:25.842999 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:22:25.842999 n-d-861076-2 devstack@n-api.service[120933]: {"remove_host": {"host": "nonexist_host"}} Oct 12 13:22:25.842999 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:22:25.842999 n-d-861076-2 devstack@n-api.service[120933]: exception: Cannot remove host nonexist_host in aggregate 16 Oct 12 13:22:25.843691 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 12 13:22:25.843691 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:25.843691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:25.843691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 12 13:22:25.843691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 12 13:22:25.843691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:22:25.843691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:22:25.843691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 13:22:25.843691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 13:22:25.843691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:22:25.843691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:22:25.843691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 13:22:25.843691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 13:22:25.843691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 12 13:22:25.843691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:25.843691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:25.843691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:25.843691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:25.843691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 12 13:22:25.843691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 12 13:22:25.844772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 12 13:22:25.844772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 12 13:22:25.844772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 12 13:22:25.844772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:25.844772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:25.844772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:25.844772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:25.844772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 12 13:22:25.844772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 12 13:22:25.844772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 13:22:25.844772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 13:22:25.844772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:22:25.844772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:22:25.844772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:22:25.844772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:22:25.844772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 13:22:25.844772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 13:22:25.844772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 12 13:22:25.844772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 12 13:22:25.844772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 12 13:22:25.846002 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 12 13:22:25.846002 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 12 13:22:25.846002 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:25.846002 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:25.846002 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:25.846002 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:25.846002 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:25.846002 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:25.846002 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:25.846002 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:25.846002 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:25.846002 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:25.846002 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:25.846002 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:25.846002 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 12 13:22:25.846002 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 13:22:25.846002 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 16 Oct 12 13:22:25.846002 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:25.846002 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:25.846002 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:25.846002 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:25.847180 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:25.847180 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:25.847180 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:22:25.847180 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:22:25.847180 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 16 Oct 12 13:22:25.847180 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:25.847180 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b907e66a-7f52-4011-88a7-b36e8e5fab40 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:25.847180 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b907e66a-7f52-4011-88a7-b36e8e5fab40 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.046667 Oct 12 13:22:25.847180 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 163/298] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 12 13:22:25 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:22:25.853867 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-aee3f02c-2cba-4a74-a473-b0f3f11ac294 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:25.924193 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9c704084-8fe4-40fb-be86-4f26e22bb953 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.110197 Oct 12 13:22:25.924786 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 136/299] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 12 13:22:25 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 13:22:25.936397 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b6a965bb-c3a1-4665-a812-5aa57aaed1f7 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2073733521", "availability_zone": "tempest-test_az-1494510957"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:25.940941 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.aggregate [None req-b6a965bb-c3a1-4665-a812-5aa57aaed1f7 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Generated uuid 195eff9b-5e15-493f-97af-3c54a4359b94 for aggregate {{(pid=120932) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 13:22:25.980480 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-aee3f02c-2cba-4a74-a473-b0f3f11ac294 tempest-AggregatesAdminNegativeTestJSON-1032608022 tempest-AggregatesAdminNegativeTestJSON-1032608022-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.131917 Oct 12 13:22:25.981361 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 164/300] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 12 13:22:25 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 12 13:22:26.088277 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b6a965bb-c3a1-4665-a812-5aa57aaed1f7 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.155530 Oct 12 13:22:26.089486 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 137/301] 10.222.0.52 () {60 vars in 1165 bytes} [Wed Oct 12 13:22:25 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:22:26.105448 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c1e43b5d-ff91-4613-ba01-854302e7467b tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2073733521_new", "availability_zone": "tempest-test_az-1494510957_new"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:26.271686 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c1e43b5d-ff91-4613-ba01-854302e7467b tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:26.271686 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c1e43b5d-ff91-4613-ba01-854302e7467b tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:26.271686 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c1e43b5d-ff91-4613-ba01-854302e7467b tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:26.271686 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=100 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:26.593246 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-574390c2-f864-4347-82a0-341455682cfa tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:26.593246 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-574390c2-f864-4347-82a0-341455682cfa tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:26.593246 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-574390c2-f864-4347-82a0-341455682cfa tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:26.593246 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-574390c2-f864-4347-82a0-341455682cfa tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:26.594884 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-574390c2-f864-4347-82a0-341455682cfa tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:26.594884 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-574390c2-f864-4347-82a0-341455682cfa tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:26.594884 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-574390c2-f864-4347-82a0-341455682cfa tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:26.594884 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-574390c2-f864-4347-82a0-341455682cfa tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:26.595176 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-574390c2-f864-4347-82a0-341455682cfa tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:26.595176 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-574390c2-f864-4347-82a0-341455682cfa tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:26.595367 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-574390c2-f864-4347-82a0-341455682cfa tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:26.595367 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-574390c2-f864-4347-82a0-341455682cfa tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1417 microversion: 2.75 time: 0.095380 Oct 12 13:22:26.595367 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 138/302] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:26 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1417 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:22:27.134581 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c1e43b5d-ff91-4613-ba01-854302e7467b tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 337 microversion: 2.1 time: 1.036490 Oct 12 13:22:27.136415 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 165/303] 10.222.0.52 () {60 vars in 1173 bytes} [Wed Oct 12 13:22:26 2022] PUT /compute/v2.1/os-aggregates/17 => generated 337 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:27.153065 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ef8fcdf9-893a-41ca-ba5f-24b929084ccd tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:27.162270 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ef8fcdf9-893a-41ca-ba5f-24b929084ccd tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.017518 Oct 12 13:22:27.163566 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 139/304] 10.222.0.52 () {58 vars in 1143 bytes} [Wed Oct 12 13:22:27 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:27.177346 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c03db112-19f3-4eab-8e35-ddfeb780845d tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:27.261512 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c03db112-19f3-4eab-8e35-ddfeb780845d tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.089752 Oct 12 13:22:27.266598 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 166/305] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 12 13:22:27 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 13:22:27.268796 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:27.274855 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-857e7dca-95f3-4fa1-ba0d-954b545eba33 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1063067961"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:27.278881 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.aggregate [None req-857e7dca-95f3-4fa1-ba0d-954b545eba33 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Generated uuid 7d892716-6cc9-4645-bf25-24aae9892ac3 for aggregate {{(pid=120932) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 13:22:27.378102 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-857e7dca-95f3-4fa1-ba0d-954b545eba33 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.110127 Oct 12 13:22:27.383134 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 140/306] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 12 13:22:27 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:27.394806 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-11029542-59ba-4274-826c-3902b3247e50 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:27.423620 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-11029542-59ba-4274-826c-3902b3247e50 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.033443 Oct 12 13:22:27.425781 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 167/307] 10.222.0.52 () {58 vars in 1143 bytes} [Wed Oct 12 13:22:27 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:27.442441 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-59055930-e3fd-4fab-9d21-e160f29961a8 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:27.582333 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-59055930-e3fd-4fab-9d21-e160f29961a8 tempest-AggregatesAdminTestJSON-1627661408 tempest-AggregatesAdminTestJSON-1627661408-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.146229 Oct 12 13:22:27.594844 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 141/308] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 12 13:22:27 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 13:22:27.613469 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6f07614f-a673-4bed-9630-71d1581752a0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:27.614100 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6f07614f-a673-4bed-9630-71d1581752a0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:27.618473 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f4fb88c4-8e20-40cc-80f3-0c07db2702c2 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:27.619037 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f4fb88c4-8e20-40cc-80f3-0c07db2702c2 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:27.636027 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4fb88c4-8e20-40cc-80f3-0c07db2702c2 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:27.636527 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4fb88c4-8e20-40cc-80f3-0c07db2702c2 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:27.639328 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f07614f-a673-4bed-9630-71d1581752a0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:27.640091 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f07614f-a673-4bed-9630-71d1581752a0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:27.640536 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f07614f-a673-4bed-9630-71d1581752a0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:27.641016 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4fb88c4-8e20-40cc-80f3-0c07db2702c2 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:27.643049 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f07614f-a673-4bed-9630-71d1581752a0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:27.643255 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4fb88c4-8e20-40cc-80f3-0c07db2702c2 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:27.643870 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4fb88c4-8e20-40cc-80f3-0c07db2702c2 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:27.644504 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f07614f-a673-4bed-9630-71d1581752a0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:27.645122 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4fb88c4-8e20-40cc-80f3-0c07db2702c2 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:27.645713 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f07614f-a673-4bed-9630-71d1581752a0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:27.687052 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-f4fb88c4-8e20-40cc-80f3-0c07db2702c2 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] HTTP exception thrown: Instance 9a10a32a-d01d-4530-a93e-66f425a5bd06 could not be found. Oct 12 13:22:27.693410 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f4fb88c4-8e20-40cc-80f3-0c07db2702c2 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Request method failure captured: Oct 12 13:22:27.693410 n-d-861076-2 devstack@n-api.service[120933]: request: DELETE /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 HTTP/1.1 Oct 12 13:22:27.693410 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:27.693410 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:27.693410 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:27.693410 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:22:27.693410 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:27.693410 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:27.693410 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:27.693410 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:27.693410 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9edkwQLGY3NFpzE5RABKU3xe-HFcgvmXhfwBzGpQvbC-54Ccceq0u4yCUHKA39rkViQCKLOfpgJLvHR5bC9nD37ieWTSelhZelTTb8SMJS8RqOu21MVEW77xKVONhdfpmlNf8VvC4dWOx7FN6kCE8wiA-Rg90oln-1MtIh8wZGzpc Oct 12 13:22:27.693410 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:27.693410 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:27.693410 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:27.693410 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:27.693410 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:27.693410 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:27.693410 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 79a760f270b741faa8363f5142561aa0 Oct 12 13:22:27.693410 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AggregatesAdminTestJSON-1047935697 Oct 12 13:22:27.693410 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:22:27.693410 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:22:27.694922 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/79a760f270b741faa8363f5142561aa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_79a760f270b741faa8363f5142561aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79a760f270b741faa8363f5142561aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79a760f270b741faa8363f5142561aa0"}]}] Oct 12 13:22:27.694922 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AggregatesAdminTestJSON-1047935697 Oct 12 13:22:27.694922 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 79a760f270b741faa8363f5142561aa0 Oct 12 13:22:27.694922 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1047935697 Oct 12 13:22:27.694922 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AggregatesAdminTestJSON-1047935697-project Oct 12 13:22:27.694922 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:27.694922 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:27.694922 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: cbfb915900c442c0999a39440a8228fe Oct 12 13:22:27.694922 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AggregatesAdminTestJSON-1047935697-project Oct 12 13:22:27.694922 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:22:27.694922 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance 9a10a32a-d01d-4530-a93e-66f425a5bd06 could not be found. Oct 12 13:22:27.694922 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '9a10a32a-d01d-4530-a93e-66f425a5bd06'} Oct 12 13:22:27.695589 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:27.695589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:27.695589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:22:27.695589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:22:27.695589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:22:27.695589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:22:27.695589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:22:27.695589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:22:27.695589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:22:27.695589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:22:27.695589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a10a32a-d01d-4530-a93e-66f425a5bd06 could not be found. Oct 12 13:22:27.695589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:27.695589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:27.695589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:27.695589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:27.695589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:27.695589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:27.695589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:27.695589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:27.695589 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:27.696697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:27.696697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 13:22:27.696697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 13:22:27.696697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 13:22:27.696697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 13:22:27.696697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:22:27.696697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:22:27.696697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:22:27.696697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:22:27.696697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a10a32a-d01d-4530-a93e-66f425a5bd06 could not be found. Oct 12 13:22:27.696697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:27.696697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:27.696697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:27.696697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:27.696697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:27.696697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:27.696697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:22:27.696697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:22:27.696697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a10a32a-d01d-4530-a93e-66f425a5bd06 could not be found. Oct 12 13:22:27.696697 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:27.699283 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f4fb88c4-8e20-40cc-80f3-0c07db2702c2 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Returning 404 to user: Instance 9a10a32a-d01d-4530-a93e-66f425a5bd06 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:27.700500 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f4fb88c4-8e20-40cc-80f3-0c07db2702c2 tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 404 len: 111 microversion: 2.1 time: 0.101593 Oct 12 13:22:27.702857 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 168/309] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:22:27 2022] DELETE /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:22:27.710376 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-43e9f561-1fd7-4169-b056-ec9ea95006ec tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:27.715504 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-43e9f561-1fd7-4169-b056-ec9ea95006ec tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] [instance: 9a10a32a-d01d-4530-a93e-66f425a5bd06] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:27.718431 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-43e9f561-1fd7-4169-b056-ec9ea95006ec tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:27.719791 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-43e9f561-1fd7-4169-b056-ec9ea95006ec tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:27.720619 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-43e9f561-1fd7-4169-b056-ec9ea95006ec tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:27.721753 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-43e9f561-1fd7-4169-b056-ec9ea95006ec tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:27.722562 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-43e9f561-1fd7-4169-b056-ec9ea95006ec tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:27.723267 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-43e9f561-1fd7-4169-b056-ec9ea95006ec tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:27.740181 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-43e9f561-1fd7-4169-b056-ec9ea95006ec tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] HTTP exception thrown: Instance 9a10a32a-d01d-4530-a93e-66f425a5bd06 could not be found. Oct 12 13:22:27.746386 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-43e9f561-1fd7-4169-b056-ec9ea95006ec tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Request method failure captured: Oct 12 13:22:27.746386 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 HTTP/1.1 Oct 12 13:22:27.746386 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:27.746386 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:27.746386 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:27.746386 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:22:27.746386 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:27.746386 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:27.746386 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:27.746386 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:27.746386 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr9edkwQLGY3NFpzE5RABKU3xe-HFcgvmXhfwBzGpQvbC-54Ccceq0u4yCUHKA39rkViQCKLOfpgJLvHR5bC9nD37ieWTSelhZelTTb8SMJS8RqOu21MVEW77xKVONhdfpmlNf8VvC4dWOx7FN6kCE8wiA-Rg90oln-1MtIh8wZGzpc Oct 12 13:22:27.746386 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:27.746386 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:27.746386 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:27.746386 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:27.746386 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:27.746386 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:27.746386 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 79a760f270b741faa8363f5142561aa0 Oct 12 13:22:27.746386 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AggregatesAdminTestJSON-1047935697 Oct 12 13:22:27.746386 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:22:27.746386 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:22:27.747564 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/79a760f270b741faa8363f5142561aa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_79a760f270b741faa8363f5142561aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79a760f270b741faa8363f5142561aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/79a760f270b741faa8363f5142561aa0"}]}] Oct 12 13:22:27.747564 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AggregatesAdminTestJSON-1047935697 Oct 12 13:22:27.747564 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 79a760f270b741faa8363f5142561aa0 Oct 12 13:22:27.747564 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1047935697 Oct 12 13:22:27.747564 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AggregatesAdminTestJSON-1047935697-project Oct 12 13:22:27.747564 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:27.747564 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:27.747564 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: cbfb915900c442c0999a39440a8228fe Oct 12 13:22:27.747564 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AggregatesAdminTestJSON-1047935697-project Oct 12 13:22:27.747564 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:22:27.747564 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance 9a10a32a-d01d-4530-a93e-66f425a5bd06 could not be found. Oct 12 13:22:27.747564 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '9a10a32a-d01d-4530-a93e-66f425a5bd06'} Oct 12 13:22:27.748826 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:27.748826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:27.748826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:22:27.748826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:22:27.748826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:22:27.748826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:22:27.748826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:22:27.748826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:22:27.748826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:22:27.748826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:22:27.748826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a10a32a-d01d-4530-a93e-66f425a5bd06 could not be found. Oct 12 13:22:27.748826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:27.748826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:27.748826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:27.748826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:27.748826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:27.748826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:27.748826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:27.748826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:27.748826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:27.749923 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:27.749923 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:22:27.749923 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:22:27.749923 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:22:27.749923 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:22:27.749923 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:22:27.749923 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:22:27.749923 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a10a32a-d01d-4530-a93e-66f425a5bd06 could not be found. Oct 12 13:22:27.749923 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:27.749923 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:27.749923 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:27.749923 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:27.749923 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:27.749923 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:27.749923 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:22:27.749923 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:22:27.749923 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a10a32a-d01d-4530-a93e-66f425a5bd06 could not be found. Oct 12 13:22:27.749923 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:27.753433 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-43e9f561-1fd7-4169-b056-ec9ea95006ec tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] Returning 404 to user: Instance 9a10a32a-d01d-4530-a93e-66f425a5bd06 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:27.754717 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-43e9f561-1fd7-4169-b056-ec9ea95006ec tempest-AggregatesAdminTestJSON-1047935697 tempest-AggregatesAdminTestJSON-1047935697-project] 10.222.0.52 "GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06" status: 404 len: 111 microversion: 2.1 time: 0.047975 Oct 12 13:22:27.755695 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 169/310] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:27 2022] GET /compute/v2.1/servers/9a10a32a-d01d-4530-a93e-66f425a5bd06 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:22:27.831510 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-6f07614f-a673-4bed-9630-71d1581752a0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:27.848468 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-6f07614f-a673-4bed-9630-71d1581752a0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:27.848468 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-6f07614f-a673-4bed-9630-71d1581752a0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:27.849660 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6f07614f-a673-4bed-9630-71d1581752a0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1438 microversion: 2.75 time: 0.249397 Oct 12 13:22:27.865634 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 142/311] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:27 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1438 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:27.882505 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:27.885183 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:27.902624 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:27.903128 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:27.903791 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:27.904794 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:27.905286 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:27.909658 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:28.010767 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:22:28.011358 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:22:28.011936 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:22:28.012424 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:22:28.012981 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:22:28.344857 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:28.354790 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:28.362440 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:28.363023 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:28.363931 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:28.364458 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:28.364994 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:28.454486 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:28.465350 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:28.473805 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:28.491399 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f4ad43af-7a9d-449d-af2c-8a9ad45ddeb2 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "POST /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0/action" status: 202 len: 1495 microversion: 2.75 time: 0.607478 Oct 12 13:22:28.493009 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 170/312] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Oct 12 13:22:27 2022] POST /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0/action => generated 1495 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 12 13:22:28.524927 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-07d7e3e6-0163-4b93-a658-db7c87819b3d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:28.525624 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-07d7e3e6-0163-4b93-a658-db7c87819b3d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:28.534291 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-07d7e3e6-0163-4b93-a658-db7c87819b3d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:28.535085 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-07d7e3e6-0163-4b93-a658-db7c87819b3d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:28.535991 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-07d7e3e6-0163-4b93-a658-db7c87819b3d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:28.537191 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-07d7e3e6-0163-4b93-a658-db7c87819b3d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:28.538076 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-07d7e3e6-0163-4b93-a658-db7c87819b3d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:28.538967 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-07d7e3e6-0163-4b93-a658-db7c87819b3d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:28.613611 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-07d7e3e6-0163-4b93-a658-db7c87819b3d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:28.623031 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-07d7e3e6-0163-4b93-a658-db7c87819b3d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:28.624461 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-07d7e3e6-0163-4b93-a658-db7c87819b3d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:28.630048 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-07d7e3e6-0163-4b93-a658-db7c87819b3d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1447 microversion: 2.75 time: 0.113665 Oct 12 13:22:28.639351 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 143/313] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:28 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1447 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:29.658667 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-44c75bed-8718-46da-b054-2b7a42265466 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:29.659301 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-44c75bed-8718-46da-b054-2b7a42265466 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:29.666031 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-44c75bed-8718-46da-b054-2b7a42265466 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:29.666486 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-44c75bed-8718-46da-b054-2b7a42265466 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:29.666932 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-44c75bed-8718-46da-b054-2b7a42265466 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:29.667644 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-44c75bed-8718-46da-b054-2b7a42265466 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:29.668069 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-44c75bed-8718-46da-b054-2b7a42265466 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:29.668496 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-44c75bed-8718-46da-b054-2b7a42265466 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:29.739257 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-44c75bed-8718-46da-b054-2b7a42265466 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:29.747786 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-44c75bed-8718-46da-b054-2b7a42265466 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:29.751401 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-44c75bed-8718-46da-b054-2b7a42265466 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:29.763996 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-44c75bed-8718-46da-b054-2b7a42265466 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1447 microversion: 2.75 time: 0.109101 Oct 12 13:22:29.764774 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 171/314] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:29 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1447 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:30.796358 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-51781212-175e-403b-826a-95e40be55b04 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:30.797063 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-51781212-175e-403b-826a-95e40be55b04 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:30.804049 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-51781212-175e-403b-826a-95e40be55b04 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:30.804791 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-51781212-175e-403b-826a-95e40be55b04 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:30.805315 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-51781212-175e-403b-826a-95e40be55b04 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:30.806057 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-51781212-175e-403b-826a-95e40be55b04 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:30.806742 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-51781212-175e-403b-826a-95e40be55b04 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:30.807173 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-51781212-175e-403b-826a-95e40be55b04 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:30.907771 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-51781212-175e-403b-826a-95e40be55b04 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:30.920284 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-51781212-175e-403b-826a-95e40be55b04 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:30.923500 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-51781212-175e-403b-826a-95e40be55b04 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:30.931237 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-51781212-175e-403b-826a-95e40be55b04 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1447 microversion: 2.75 time: 0.139321 Oct 12 13:22:30.949154 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 144/315] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:30 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1447 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:31.723883 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-dab243ed-40c3-4f6a-a21f-e8acf4f2a88d tempest-InstanceUsageAuditLogNegativeTestJSON-192832879 tempest-InstanceUsageAuditLogNegativeTestJSON-192832879-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:31.727779 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-dab243ed-40c3-4f6a-a21f-e8acf4f2a88d tempest-InstanceUsageAuditLogNegativeTestJSON-192832879 tempest-InstanceUsageAuditLogNegativeTestJSON-192832879-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 12 13:22:31.734930 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-dab243ed-40c3-4f6a-a21f-e8acf4f2a88d tempest-InstanceUsageAuditLogNegativeTestJSON-192832879 tempest-InstanceUsageAuditLogNegativeTestJSON-192832879-project-admin] Request method failure captured: Oct 12 13:22:31.734930 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 12 13:22:31.734930 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:31.734930 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:31.734930 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:31.734930 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:22:31.734930 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:31.734930 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:31.734930 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:31.734930 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:31.734930 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr-XrAerF_hSbuonDzNhfrW5I_QMVnxWG5T0bZNizgvdnJhu9Xtuv08Iupla7hDgLhFhlsehfgbTy6lVbH9-wRsryXKfwKilOwBclAm4u4wqNMKQQrIUB5YYdfDJ4vbOJIbMdi8HKqm0Am8q2cwHa-SR_mb9_Q4XXD5Ay1zITCAz8JU Oct 12 13:22:31.734930 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:31.734930 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:31.734930 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:31.734930 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:31.734930 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:31.734930 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:31.734930 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 284575aefb754f3f8b9a756fac07b601 Oct 12 13:22:31.734930 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-192832879 Oct 12 13:22:31.734930 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:22:31.734930 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:22:31.736396 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/284575aefb754f3f8b9a756fac07b601"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_284575aefb754f3f8b9a756fac07b601"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/284575aefb754f3f8b9a756fac07b601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/284575aefb754f3f8b9a756fac07b601"}]}] Oct 12 13:22:31.736396 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-192832879 Oct 12 13:22:31.736396 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 284575aefb754f3f8b9a756fac07b601 Oct 12 13:22:31.736396 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-192832879 Oct 12 13:22:31.736396 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-192832879-project-admin Oct 12 13:22:31.736396 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:31.736396 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:31.736396 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 7e0e43d24fe84c208500ead873d04cbb Oct 12 13:22:31.736396 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-192832879-project-admin Oct 12 13:22:31.736396 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:22:31.736396 n-d-861076-2 devstack@n-api.service[120933]: exception: Invalid timestamp for date invalid_time Oct 12 13:22:31.737206 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'invalid_time'} Oct 12 13:22:31.737206 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:31.737206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:31.737206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 12 13:22:31.737206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 12 13:22:31.737206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 12 13:22:31.737206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 12 13:22:31.737206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 12 13:22:31.737206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 12 13:22:31.737206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 12 13:22:31.737206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:31.737206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:31.737206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:31.737206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:31.737206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:31.737206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:31.737206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:31.737206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:31.737206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:31.737206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:31.738407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 12 13:22:31.738407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 12 13:22:31.738407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 12 13:22:31.738407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:31.738407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:31.738407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:31.738407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:31.738407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:31.738407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:31.738407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:22:31.738407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:22:31.738407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 12 13:22:31.738407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:31.738407 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-dab243ed-40c3-4f6a-a21f-e8acf4f2a88d tempest-InstanceUsageAuditLogNegativeTestJSON-192832879 tempest-InstanceUsageAuditLogNegativeTestJSON-192832879-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:31.738407 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-dab243ed-40c3-4f6a-a21f-e8acf4f2a88d tempest-InstanceUsageAuditLogNegativeTestJSON-192832879 tempest-InstanceUsageAuditLogNegativeTestJSON-192832879-project-admin] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.383449 Oct 12 13:22:31.739236 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 172/316] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Oct 12 13:22:31 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 385 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 13:22:32.125116 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e77ac71a-fd50-44a2-b2cf-aa60f495c919 tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920 tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:32.127974 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-e77ac71a-fd50-44a2-b2cf-aa60f495c919 tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920 tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'c74f275a20fc46d89482a52eaf3344f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ff209a96034b3696872db8221d2640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:32.129847 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e77ac71a-fd50-44a2-b2cf-aa60f495c919 tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920 tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920-project] Request method failure captured: Oct 12 13:22:32.129847 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 12 13:22:32.129847 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:22:32.129847 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:22:32.129847 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:22:32.129847 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:22:32.129847 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:22:32.129847 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:22:32.129847 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:22:32.129847 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:32.129847 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr-TDtQhM_sKQx_2JT8IDFFYWBEoNi9XhjYn9t3BO3ne1Xm3xnnK9BL9saYoY672ygYxyPeHpRu8m0g4D0xF96PkY6oiNeEAcX7FXwzIRCFCRO9H_WkrHNSPNctp0vkkx8NvwFn_5T1krMHiZD1wMqAV3ZjOPfwjBvBCaTgOk6r1bC8 Oct 12 13:22:32.129847 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:22:32.129847 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:22:32.129847 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:22:32.129847 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:22:32.129847 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:22:32.129847 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:22:32.129847 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 33ff209a96034b3696872db8221d2640 Oct 12 13:22:32.129847 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920 Oct 12 13:22:32.129847 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:22:32.129847 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:22:32.131025 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/33ff209a96034b3696872db8221d2640"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_33ff209a96034b3696872db8221d2640"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/33ff209a96034b3696872db8221d2640"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/33ff209a96034b3696872db8221d2640"}]}] Oct 12 13:22:32.131025 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920 Oct 12 13:22:32.131025 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 33ff209a96034b3696872db8221d2640 Oct 12 13:22:32.131025 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920 Oct 12 13:22:32.131025 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920-project Oct 12 13:22:32.131025 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:22:32.131025 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:22:32.131025 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: c74f275a20fc46d89482a52eaf3344f6 Oct 12 13:22:32.131025 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920-project Oct 12 13:22:32.131025 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:22:32.131691 n-d-861076-2 devstack@n-api.service[120932]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 12 13:22:32.131691 n-d-861076-2 devstack@n-api.service[120932]: action_args: {} Oct 12 13:22:32.131691 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:32.131691 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:32.131691 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:32.131691 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:32.131691 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:32.131691 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:32.131691 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:32.131691 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:32.131691 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 12 13:22:32.131691 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 12 13:22:32.131691 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:22:32.131691 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:22:32.131691 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:22:32.131691 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:22:32.131691 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:22:32.131691 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:22:32.131691 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:22:32.131691 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:22:32.132865 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:22:32.132865 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:22:32.132865 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:22:32.132865 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:22:32.132865 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:22:32.132865 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:22:32.132865 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 12 13:22:32.132865 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:32.132865 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:32.132865 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:32.132865 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:32.132865 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:32.132865 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:32.132865 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:22:32.132865 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:22:32.132865 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 12 13:22:32.132865 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:32.133873 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e77ac71a-fd50-44a2-b2cf-aa60f495c919 tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920 tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:32.133873 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e77ac71a-fd50-44a2-b2cf-aa60f495c919 tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920 tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920-project] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.389519 Oct 12 13:22:32.133873 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 145/317] 10.222.0.52 () {58 vars in 1185 bytes} [Wed Oct 12 13:22:31 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 391 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:22:32.141491 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c72b8ede-620d-4a46-ad54-8c81598a65bc tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:32.144441 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c72b8ede-620d-4a46-ad54-8c81598a65bc tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:32.159100 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c72b8ede-620d-4a46-ad54-8c81598a65bc tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:32.159602 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c72b8ede-620d-4a46-ad54-8c81598a65bc tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:32.160037 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c72b8ede-620d-4a46-ad54-8c81598a65bc tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:32.160815 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c72b8ede-620d-4a46-ad54-8c81598a65bc tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:32.161310 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c72b8ede-620d-4a46-ad54-8c81598a65bc tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:32.161741 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c72b8ede-620d-4a46-ad54-8c81598a65bc tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:32.247255 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c72b8ede-620d-4a46-ad54-8c81598a65bc tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:32.261930 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c72b8ede-620d-4a46-ad54-8c81598a65bc tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:32.261930 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c72b8ede-620d-4a46-ad54-8c81598a65bc tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:32.272173 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c72b8ede-620d-4a46-ad54-8c81598a65bc tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1447 microversion: 2.75 time: 0.137239 Oct 12 13:22:32.273519 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 146/318] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:32 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1447 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:32.279846 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-653a5fb7-5570-42a8-bb21-69af4aed7def tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920 tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:32.281829 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-653a5fb7-5570-42a8-bb21-69af4aed7def tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920 tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'c74f275a20fc46d89482a52eaf3344f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ff209a96034b3696872db8221d2640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:32.283608 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-653a5fb7-5570-42a8-bb21-69af4aed7def tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920 tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920-project] Request method failure captured: Oct 12 13:22:32.283608 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-12%2013:22:32 HTTP/1.1 Oct 12 13:22:32.283608 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:22:32.283608 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:22:32.283608 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:22:32.283608 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:22:32.283608 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:22:32.283608 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:22:32.283608 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:22:32.283608 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:32.283608 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr-TDtQhM_sKQx_2JT8IDFFYWBEoNi9XhjYn9t3BO3ne1Xm3xnnK9BL9saYoY672ygYxyPeHpRu8m0g4D0xF96PkY6oiNeEAcX7FXwzIRCFCRO9H_WkrHNSPNctp0vkkx8NvwFn_5T1krMHiZD1wMqAV3ZjOPfwjBvBCaTgOk6r1bC8 Oct 12 13:22:32.283608 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:22:32.283608 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:22:32.283608 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:22:32.283608 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:22:32.283608 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:22:32.283608 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:22:32.283608 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 33ff209a96034b3696872db8221d2640 Oct 12 13:22:32.283608 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920 Oct 12 13:22:32.283608 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:22:32.283608 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:22:32.284968 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/33ff209a96034b3696872db8221d2640"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_33ff209a96034b3696872db8221d2640"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/33ff209a96034b3696872db8221d2640"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/33ff209a96034b3696872db8221d2640"}]}] Oct 12 13:22:32.284968 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920 Oct 12 13:22:32.284968 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 33ff209a96034b3696872db8221d2640 Oct 12 13:22:32.284968 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920 Oct 12 13:22:32.284968 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920-project Oct 12 13:22:32.284968 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:22:32.284968 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:22:32.284968 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: c74f275a20fc46d89482a52eaf3344f6 Oct 12 13:22:32.284968 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920-project Oct 12 13:22:32.284968 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:22:32.285563 n-d-861076-2 devstack@n-api.service[120932]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 12 13:22:32.285563 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '2022-10-12 13:22:32'} Oct 12 13:22:32.285563 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:32.285563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:32.285563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:32.285563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:32.285563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:32.285563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:32.285563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:32.285563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:32.285563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 12 13:22:32.285563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 12 13:22:32.285563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:22:32.285563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:22:32.285563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:22:32.285563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:22:32.285563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:22:32.285563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:22:32.285563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:22:32.285563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:22:32.299911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:22:32.299911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:22:32.299911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:22:32.299911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:22:32.299911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:22:32.299911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:22:32.299911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 12 13:22:32.299911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:32.299911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:32.299911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:32.299911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:32.299911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:32.299911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:32.299911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:22:32.299911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:22:32.299911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 12 13:22:32.299911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:32.301068 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-653a5fb7-5570-42a8-bb21-69af4aed7def tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920 tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:32.301068 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-653a5fb7-5570-42a8-bb21-69af4aed7def tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920 tempest-InstanceUsageAuditLogNegativeTestJSON-1744054920-project] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-12 13:22:32" status: 403 len: 128 microversion: 2.1 time: 0.009858 Oct 12 13:22:32.301068 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 147/319] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 12 13:22:32 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-12%2013%3A22%3A32 => generated 128 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:22:32.481377 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a7bb7c9d-fb86-425c-b339-85061ebe0da0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1288518529", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:32.549220 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-a7bb7c9d-fb86-425c-b339-85061ebe0da0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] validate_networks() for None {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:22:32.757883 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-a7bb7c9d-fb86-425c-b339-85061ebe0da0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:22:32.758459 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-a7bb7c9d-fb86-425c-b339-85061ebe0da0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:22:32.758772 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-a7bb7c9d-fb86-425c-b339-85061ebe0da0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:22:32.759183 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-a7bb7c9d-fb86-425c-b339-85061ebe0da0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:22:32.767406 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-a7bb7c9d-fb86-425c-b339-85061ebe0da0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:22:32.771740 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a7bb7c9d-fb86-425c-b339-85061ebe0da0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:32.771870 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a7bb7c9d-fb86-425c-b339-85061ebe0da0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:32.772370 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a7bb7c9d-fb86-425c-b339-85061ebe0da0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:32.773336 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a7bb7c9d-fb86-425c-b339-85061ebe0da0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:32.773964 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a7bb7c9d-fb86-425c-b339-85061ebe0da0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:32.774425 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a7bb7c9d-fb86-425c-b339-85061ebe0da0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:32.796447 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-a7bb7c9d-fb86-425c-b339-85061ebe0da0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Getting quotas for project b92cdc745c654b538146a4a64f5f4b6f. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:22:32.800373 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-a7bb7c9d-fb86-425c-b339-85061ebe0da0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Getting quotas for user 0df255f194e54dfb8781b982c2c60a98 and project b92cdc745c654b538146a4a64f5f4b6f. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:22:32.812950 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a7bb7c9d-fb86-425c-b339-85061ebe0da0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Going to run 1 instances... {{(pid=120933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:22:32.815755 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a7bb7c9d-fb86-425c-b339-85061ebe0da0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 085c7252-d302-4b81-a7f1-15311733615f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:22:32.962047 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a7bb7c9d-fb86-425c-b339-85061ebe0da0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.019279 Oct 12 13:22:32.969282 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 173/320] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:22:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 13:22:32.977668 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f0027657-7d66-4a3f-8378-716fa1611e2c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:32.978717 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f0027657-7d66-4a3f-8378-716fa1611e2c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:33.095355 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f0027657-7d66-4a3f-8378-716fa1611e2c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:33.103543 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f0027657-7d66-4a3f-8378-716fa1611e2c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f" status: 200 len: 1213 microversion: 2.1 time: 0.133255 Oct 12 13:22:33.106279 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 148/321] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:32 2022] GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f => generated 1213 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:22:33.305584 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2e18b63c-18f2-47c2-9adc-97d927875bbf tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:33.306195 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-2e18b63c-18f2-47c2-9adc-97d927875bbf tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:33.312863 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2e18b63c-18f2-47c2-9adc-97d927875bbf tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:33.313483 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2e18b63c-18f2-47c2-9adc-97d927875bbf tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:33.313930 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2e18b63c-18f2-47c2-9adc-97d927875bbf tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:33.314649 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2e18b63c-18f2-47c2-9adc-97d927875bbf tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:33.315297 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2e18b63c-18f2-47c2-9adc-97d927875bbf tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:33.315952 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2e18b63c-18f2-47c2-9adc-97d927875bbf tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:33.388121 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-2e18b63c-18f2-47c2-9adc-97d927875bbf tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:33.397183 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-2e18b63c-18f2-47c2-9adc-97d927875bbf tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:33.401816 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-2e18b63c-18f2-47c2-9adc-97d927875bbf tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:33.407984 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2e18b63c-18f2-47c2-9adc-97d927875bbf tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1447 microversion: 2.75 time: 0.106213 Oct 12 13:22:33.408550 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 174/322] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:33 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1447 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:34.105694 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-76a668ef-7a45-44b2-acb0-9b1ca607f049 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Action: 'update', calling method: .version_select at 0x7f8aa026f040>, body: {"quota_set": {"ram": "5120"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:34.132977 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-950eec8f-8440-41e9-87eb-5b2fa71e5db9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:34.133641 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-950eec8f-8440-41e9-87eb-5b2fa71e5db9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:34.195727 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-950eec8f-8440-41e9-87eb-5b2fa71e5db9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:34.203117 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-950eec8f-8440-41e9-87eb-5b2fa71e5db9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f" status: 200 len: 1213 microversion: 2.1 time: 0.077102 Oct 12 13:22:34.205232 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 175/323] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:34 2022] GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:22:34.436966 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a12437f1-fc44-4b23-b1c0-f56953be908c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:34.437871 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a12437f1-fc44-4b23-b1c0-f56953be908c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:34.444047 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a12437f1-fc44-4b23-b1c0-f56953be908c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:34.446155 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a12437f1-fc44-4b23-b1c0-f56953be908c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:34.446155 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a12437f1-fc44-4b23-b1c0-f56953be908c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:34.446155 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a12437f1-fc44-4b23-b1c0-f56953be908c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:34.446155 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a12437f1-fc44-4b23-b1c0-f56953be908c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:34.446567 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a12437f1-fc44-4b23-b1c0-f56953be908c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:34.517143 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a12437f1-fc44-4b23-b1c0-f56953be908c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:34.529792 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a12437f1-fc44-4b23-b1c0-f56953be908c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:34.531291 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a12437f1-fc44-4b23-b1c0-f56953be908c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:34.539942 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a12437f1-fc44-4b23-b1c0-f56953be908c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1447 microversion: 2.75 time: 0.107041 Oct 12 13:22:34.543283 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 176/324] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:34 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1447 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:34.882541 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-76a668ef-7a45-44b2-acb0-9b1ca607f049 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:34.882958 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-76a668ef-7a45-44b2-acb0-9b1ca607f049 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:34.883490 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-76a668ef-7a45-44b2-acb0-9b1ca607f049 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:34.884285 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-76a668ef-7a45-44b2-acb0-9b1ca607f049 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:34.884966 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-76a668ef-7a45-44b2-acb0-9b1ca607f049 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:34.885587 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-76a668ef-7a45-44b2-acb0-9b1ca607f049 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:34.991826 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0cdc0d68-f3bf-4600-b932-8a8892515934 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Calling method '.version_select at 0x7f8aa03f34c0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:34.993837 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0cdc0d68-f3bf-4600-b932-8a8892515934 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:34.997466 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0cdc0d68-f3bf-4600-b932-8a8892515934 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:34.997466 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0cdc0d68-f3bf-4600-b932-8a8892515934 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:35.013233 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0cdc0d68-f3bf-4600-b932-8a8892515934 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:35.013903 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0cdc0d68-f3bf-4600-b932-8a8892515934 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:35.014339 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0cdc0d68-f3bf-4600-b932-8a8892515934 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:35.025554 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0cdc0d68-f3bf-4600-b932-8a8892515934 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:35.026073 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0cdc0d68-f3bf-4600-b932-8a8892515934 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:35.026781 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0cdc0d68-f3bf-4600-b932-8a8892515934 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:35.036284 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0cdc0d68-f3bf-4600-b932-8a8892515934 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.288100 Oct 12 13:22:35.037249 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 177/325] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:22:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:35.059982 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-76a668ef-7a45-44b2-acb0-9b1ca607f049 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/06afe95ee8b7439cb5ca36900c6562fd" status: 200 len: 240 microversion: 2.36 time: 1.317330 Oct 12 13:22:35.067344 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 149/326] 10.222.0.52 () {62 vars in 1303 bytes} [Wed Oct 12 13:22:33 2022] PUT /compute/v2.1/os-quota-sets/06afe95ee8b7439cb5ca36900c6562fd => generated 240 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:22:35.072049 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-036df7c2-b0ad-4046-a6a8-c25ee98a0135 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Calling method '.version_select at 0x7f8aa026f0d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:35.320962 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ce5ed223-d4b3-4df6-8ffb-752840bb4087 tempest-HypervisorAdminNegativeUnderV252Test-769581933 tempest-HypervisorAdminNegativeUnderV252Test-769581933-project] Calling method '.version_select at 0x7f8aa03f3e50>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:35.323114 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-ce5ed223-d4b3-4df6-8ffb-752840bb4087 tempest-HypervisorAdminNegativeUnderV252Test-769581933 tempest-HypervisorAdminNegativeUnderV252Test-769581933-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'd57e7e735e9f4cfca4a4b0dab146c1cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed5e55d38884e4d9dc225df55581d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:35.326130 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ce5ed223-d4b3-4df6-8ffb-752840bb4087 tempest-HypervisorAdminNegativeUnderV252Test-769581933 tempest-HypervisorAdminNegativeUnderV252Test-769581933-project] Request method failure captured: Oct 12 13:22:35.326130 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-hypervisors/n-h1-861076-2/search HTTP/1.1 Oct 12 13:22:35.326130 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:35.326130 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:35.326130 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:35.326130 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:22:35.326130 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:35.326130 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:35.326130 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:35.326130 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:35.326130 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr-Y6mT4BWCIAS3SdWHBiebiDQq5CzsvS3yXNsmi_7GP1kMGKOEhnstpPkcg4KognOwq4FErKW4D0-HhnWrwnqQejVsBoXkUE-btctZIzcXrqmNCplm5yHCm6UTPyOEwPQBOjm3PCkc58sbYLabd5yus3S08qZri7r8MG393MZW3RF8 Oct 12 13:22:35.326130 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:35.326130 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:35.326130 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:35.326130 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:35.326130 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:35.326130 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:35.326130 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 8ed5e55d38884e4d9dc225df55581d64 Oct 12 13:22:35.326130 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-769581933 Oct 12 13:22:35.326130 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:22:35.326130 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:22:35.327380 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8ed5e55d38884e4d9dc225df55581d64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8ed5e55d38884e4d9dc225df55581d64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ed5e55d38884e4d9dc225df55581d64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ed5e55d38884e4d9dc225df55581d64"}]}] Oct 12 13:22:35.327380 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-769581933 Oct 12 13:22:35.327380 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 8ed5e55d38884e4d9dc225df55581d64 Oct 12 13:22:35.327380 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-769581933 Oct 12 13:22:35.327380 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-769581933-project Oct 12 13:22:35.327380 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:35.327380 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:35.327380 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: d57e7e735e9f4cfca4a4b0dab146c1cc Oct 12 13:22:35.327380 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-769581933-project Oct 12 13:22:35.327380 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:22:35.327380 n-d-861076-2 devstack@n-api.service[120933]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 12 13:22:35.327380 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'n-h1-861076-2'} Oct 12 13:22:35.328080 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:35.328080 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:35.328080 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:35.328080 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:35.328080 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:35.328080 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:35.328080 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:22:35.328080 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:22:35.328080 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:35.328080 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:35.328080 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 12 13:22:35.328080 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 12 13:22:35.328080 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:22:35.328080 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:22:35.328080 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:22:35.328080 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:22:35.328080 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:22:35.328080 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:22:35.328080 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:22:35.329155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:22:35.329155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:22:35.329155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:22:35.329155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:22:35.329155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:22:35.329155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:22:35.329155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:22:35.329155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 12 13:22:35.329155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:35.329155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:35.329155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:35.329155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:35.329155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:35.329155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:35.329155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:22:35.329155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:22:35.329155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 12 13:22:35.329155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:35.332710 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ce5ed223-d4b3-4df6-8ffb-752840bb4087 tempest-HypervisorAdminNegativeUnderV252Test-769581933 tempest-HypervisorAdminNegativeUnderV252Test-769581933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:35.335676 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ce5ed223-d4b3-4df6-8ffb-752840bb4087 tempest-HypervisorAdminNegativeUnderV252Test-769581933 tempest-HypervisorAdminNegativeUnderV252Test-769581933-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/n-h1-861076-2/search" status: 403 len: 117 microversion: 2.1 time: 0.291557 Oct 12 13:22:35.337896 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 178/327] 10.222.0.52 () {58 vars in 1209 bytes} [Wed Oct 12 13:22:35 2022] GET /compute/v2.1/os-hypervisors/n-h1-861076-2/search => generated 117 bytes in 294 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 12 13:22:35.356501 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8002c8e6-a750-4448-b353-7b049da6131b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:35.357160 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-8002c8e6-a750-4448-b353-7b049da6131b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:35.393805 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8002c8e6-a750-4448-b353-7b049da6131b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:35.393805 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8002c8e6-a750-4448-b353-7b049da6131b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:35.393805 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8002c8e6-a750-4448-b353-7b049da6131b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:35.393805 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8002c8e6-a750-4448-b353-7b049da6131b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:35.405250 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8002c8e6-a750-4448-b353-7b049da6131b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:35.406613 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8002c8e6-a750-4448-b353-7b049da6131b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:35.515144 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-8002c8e6-a750-4448-b353-7b049da6131b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:35.526973 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-8002c8e6-a750-4448-b353-7b049da6131b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f" status: 200 len: 1265 microversion: 2.1 time: 0.187234 Oct 12 13:22:35.531779 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 179/328] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:35 2022] GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:22:35.542739 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-38b23fd4-b913-434b-b86c-6dfdabf60a09 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Calling method '.version_select at 0x7f8aa03f35e0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:35.545933 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-38b23fd4-b913-434b-b86c-6dfdabf60a09 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:35.546422 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-38b23fd4-b913-434b-b86c-6dfdabf60a09 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:35.546863 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-38b23fd4-b913-434b-b86c-6dfdabf60a09 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:35.570551 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-38b23fd4-b913-434b-b86c-6dfdabf60a09 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 12 13:22:35.572177 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-38b23fd4-b913-434b-b86c-6dfdabf60a09 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Request method failure captured: Oct 12 13:22:35.572177 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 12 13:22:35.572177 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:22:35.572177 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:22:35.572177 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:22:35.572177 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:22:35.572177 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:22:35.572177 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:22:35.572177 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:22:35.572177 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:35.572177 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr-a49SJQQPSRRgCnUHl81296KrDd8hyzGdnmYgP-BDGRKH493FIWPchWMfuS3ZKxD0w65cllkJzZjbFYqz7ysKu4vT-qZvIJ2WMmS5uG6Uvin_g_dtMEy2Di49HmtQsuNLxgFdvPdaFZq1p7bEtH6Q58mLk7U7Ij8IxjJ654OhATAw Oct 12 13:22:35.572177 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:22:35.572177 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:22:35.572177 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:22:35.572177 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:22:35.572177 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:22:35.572177 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:22:35.572177 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: eb3f3c836ecf46e3af8de8b981e1383e Oct 12 13:22:35.572177 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1797456849 Oct 12 13:22:35.572177 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:22:35.572177 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:22:35.573532 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb3f3c836ecf46e3af8de8b981e1383e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb3f3c836ecf46e3af8de8b981e1383e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb3f3c836ecf46e3af8de8b981e1383e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb3f3c836ecf46e3af8de8b981e1383e"}]}] Oct 12 13:22:35.573532 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1797456849 Oct 12 13:22:35.573532 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: eb3f3c836ecf46e3af8de8b981e1383e Oct 12 13:22:35.573532 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1797456849 Oct 12 13:22:35.573532 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin Oct 12 13:22:35.573532 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:22:35.573532 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:22:35.573532 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 27905c76fef84432b849648b91a06963 Oct 12 13:22:35.573532 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin Oct 12 13:22:35.573532 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:22:35.573532 n-d-861076-2 devstack@n-api.service[120933]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 12 13:22:35.573532 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 12 13:22:35.574217 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:35.574217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:35.574217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:35.574217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:35.574217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:35.574217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:35.574217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:22:35.574217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:22:35.574217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:35.574217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:35.574217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 12 13:22:35.574217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 12 13:22:35.574217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 12 13:22:35.574217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 13:22:35.574217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 12 13:22:35.574217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:35.574217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:35.574217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:35.574217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:35.574217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:35.575327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:35.575327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:22:35.575327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:22:35.575327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 12 13:22:35.575327 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:22:35.577151 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-38b23fd4-b913-434b-b86c-6dfdabf60a09 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:35.578453 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-38b23fd4-b913-434b-b86c-6dfdabf60a09 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.048049 Oct 12 13:22:35.579201 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 180/329] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 12 13:22:35 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:22:35.584603 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-49e468ea-c63e-414c-bb4a-5d45baeb3957 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:35.589337 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-49e468ea-c63e-414c-bb4a-5d45baeb3957 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:35.594358 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-49e468ea-c63e-414c-bb4a-5d45baeb3957 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:35.595133 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-49e468ea-c63e-414c-bb4a-5d45baeb3957 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:35.595774 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-49e468ea-c63e-414c-bb4a-5d45baeb3957 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:35.615266 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-49e468ea-c63e-414c-bb4a-5d45baeb3957 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:35.615266 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-49e468ea-c63e-414c-bb4a-5d45baeb3957 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:35.615266 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-49e468ea-c63e-414c-bb4a-5d45baeb3957 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:35.628464 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-036df7c2-b0ad-4046-a6a8-c25ee98a0135 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:35.630341 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-036df7c2-b0ad-4046-a6a8-c25ee98a0135 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:35.631276 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-036df7c2-b0ad-4046-a6a8-c25ee98a0135 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:35.632328 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-036df7c2-b0ad-4046-a6a8-c25ee98a0135 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:35.633236 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-036df7c2-b0ad-4046-a6a8-c25ee98a0135 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:35.635249 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-036df7c2-b0ad-4046-a6a8-c25ee98a0135 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:35.662019 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-036df7c2-b0ad-4046-a6a8-c25ee98a0135 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/06afe95ee8b7439cb5ca36900c6562fd/detail" status: 200 len: 672 microversion: 2.36 time: 0.593138 Oct 12 13:22:35.663347 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 150/330] 10.222.0.52 () {60 vars in 1304 bytes} [Wed Oct 12 13:22:35 2022] GET /compute/v2.1/os-quota-sets/06afe95ee8b7439cb5ca36900c6562fd/detail => generated 672 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 13:22:35.680534 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b79246d3-e55f-46a9-9b5b-381c2e01e5e9 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Calling method '.version_select at 0x7f8aa040fdc0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:35.685525 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b79246d3-e55f-46a9-9b5b-381c2e01e5e9 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:35.686286 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b79246d3-e55f-46a9-9b5b-381c2e01e5e9 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:35.687920 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b79246d3-e55f-46a9-9b5b-381c2e01e5e9 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:35.726727 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b79246d3-e55f-46a9-9b5b-381c2e01e5e9 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:35.727318 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b79246d3-e55f-46a9-9b5b-381c2e01e5e9 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:35.731882 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b79246d3-e55f-46a9-9b5b-381c2e01e5e9 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:35.750590 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b79246d3-e55f-46a9-9b5b-381c2e01e5e9 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:35.756124 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b79246d3-e55f-46a9-9b5b-381c2e01e5e9 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:35.757138 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b79246d3-e55f-46a9-9b5b-381c2e01e5e9 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:35.772689 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b79246d3-e55f-46a9-9b5b-381c2e01e5e9 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.108016 Oct 12 13:22:35.775141 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 151/331] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:22:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:35.796317 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8ed66592-c034-4876-be04-ee54a3a0e3c7 tempest-HypervisorAdminNegativeUnderV252Test-769581933 tempest-HypervisorAdminNegativeUnderV252Test-769581933-project] Calling method '.version_select at 0x7f8aa02fb040>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:35.799158 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8ed66592-c034-4876-be04-ee54a3a0e3c7 tempest-HypervisorAdminNegativeUnderV252Test-769581933 tempest-HypervisorAdminNegativeUnderV252Test-769581933-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'd57e7e735e9f4cfca4a4b0dab146c1cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed5e55d38884e4d9dc225df55581d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:35.804156 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8ed66592-c034-4876-be04-ee54a3a0e3c7 tempest-HypervisorAdminNegativeUnderV252Test-769581933 tempest-HypervisorAdminNegativeUnderV252Test-769581933-project] Request method failure captured: Oct 12 13:22:35.804156 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 12 13:22:35.804156 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:22:35.804156 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:22:35.804156 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:22:35.804156 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:22:35.804156 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:22:35.804156 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:22:35.804156 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:22:35.804156 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:35.804156 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr-Y6mT4BWCIAS3SdWHBiebiDQq5CzsvS3yXNsmi_7GP1kMGKOEhnstpPkcg4KognOwq4FErKW4D0-HhnWrwnqQejVsBoXkUE-btctZIzcXrqmNCplm5yHCm6UTPyOEwPQBOjm3PCkc58sbYLabd5yus3S08qZri7r8MG393MZW3RF8 Oct 12 13:22:35.804156 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:22:35.804156 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:22:35.804156 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:22:35.804156 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:22:35.804156 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:22:35.804156 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:22:35.804156 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 8ed5e55d38884e4d9dc225df55581d64 Oct 12 13:22:35.804156 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-769581933 Oct 12 13:22:35.804156 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:22:35.804156 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:22:35.805679 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8ed5e55d38884e4d9dc225df55581d64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8ed5e55d38884e4d9dc225df55581d64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ed5e55d38884e4d9dc225df55581d64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ed5e55d38884e4d9dc225df55581d64"}]}] Oct 12 13:22:35.805679 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-769581933 Oct 12 13:22:35.805679 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 8ed5e55d38884e4d9dc225df55581d64 Oct 12 13:22:35.805679 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-769581933 Oct 12 13:22:35.805679 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-769581933-project Oct 12 13:22:35.805679 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:22:35.805679 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:22:35.805679 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: d57e7e735e9f4cfca4a4b0dab146c1cc Oct 12 13:22:35.805679 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-769581933-project Oct 12 13:22:35.805679 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:22:35.805679 n-d-861076-2 devstack@n-api.service[120932]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 12 13:22:35.805679 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '1'} Oct 12 13:22:35.806504 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:35.806504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:35.806504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:35.806504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:35.806504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:35.806504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:35.806504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:22:35.806504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:22:35.806504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:35.806504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:35.806504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 12 13:22:35.806504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 12 13:22:35.806504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:22:35.806504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:22:35.806504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:22:35.806504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:22:35.806504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:22:35.806504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:22:35.806504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:22:35.807706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:22:35.807706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:22:35.807706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:22:35.807706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:22:35.807706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:22:35.807706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:22:35.807706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:22:35.807706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 12 13:22:35.807706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:35.807706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:35.807706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:35.807706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:35.807706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:35.807706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:35.807706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:22:35.807706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:22:35.807706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 12 13:22:35.807706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:35.811661 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8ed66592-c034-4876-be04-ee54a3a0e3c7 tempest-HypervisorAdminNegativeUnderV252Test-769581933 tempest-HypervisorAdminNegativeUnderV252Test-769581933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:35.816726 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8ed66592-c034-4876-be04-ee54a3a0e3c7 tempest-HypervisorAdminNegativeUnderV252Test-769581933 tempest-HypervisorAdminNegativeUnderV252Test-769581933-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.030887 Oct 12 13:22:35.817937 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 152/332] 10.222.0.52 () {58 vars in 1176 bytes} [Wed Oct 12 13:22:35 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:22:35.830682 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-62caa6b3-4650-446d-b849-fbf6df5e66b7 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Calling method '.version_select at 0x7f8aa01ef700>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:35.832437 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62caa6b3-4650-446d-b849-fbf6df5e66b7 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:35.835116 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62caa6b3-4650-446d-b849-fbf6df5e66b7 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:35.835661 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62caa6b3-4650-446d-b849-fbf6df5e66b7 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:35.853849 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-62caa6b3-4650-446d-b849-fbf6df5e66b7 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] HTTP exception thrown: No hypervisor matching 'e483e663-e24c-451d-aa91-cb62f240a128' could be found. Oct 12 13:22:35.855290 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-62caa6b3-4650-446d-b849-fbf6df5e66b7 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Request method failure captured: Oct 12 13:22:35.855290 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/os-hypervisors/e483e663-e24c-451d-aa91-cb62f240a128/servers HTTP/1.1 Oct 12 13:22:35.855290 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:22:35.855290 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:22:35.855290 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:22:35.855290 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:22:35.855290 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:22:35.855290 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:22:35.855290 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:22:35.855290 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:35.855290 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr-a49SJQQPSRRgCnUHl81296KrDd8hyzGdnmYgP-BDGRKH493FIWPchWMfuS3ZKxD0w65cllkJzZjbFYqz7ysKu4vT-qZvIJ2WMmS5uG6Uvin_g_dtMEy2Di49HmtQsuNLxgFdvPdaFZq1p7bEtH6Q58mLk7U7Ij8IxjJ654OhATAw Oct 12 13:22:35.855290 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:22:35.855290 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:22:35.855290 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:22:35.855290 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:22:35.855290 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:22:35.855290 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:22:35.855290 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: eb3f3c836ecf46e3af8de8b981e1383e Oct 12 13:22:35.855290 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1797456849 Oct 12 13:22:35.855290 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,admin,reader Oct 12 13:22:35.855290 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,admin,reader Oct 12 13:22:35.856675 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb3f3c836ecf46e3af8de8b981e1383e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb3f3c836ecf46e3af8de8b981e1383e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb3f3c836ecf46e3af8de8b981e1383e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb3f3c836ecf46e3af8de8b981e1383e"}]}] Oct 12 13:22:35.856675 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1797456849 Oct 12 13:22:35.856675 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: eb3f3c836ecf46e3af8de8b981e1383e Oct 12 13:22:35.856675 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1797456849 Oct 12 13:22:35.856675 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin Oct 12 13:22:35.856675 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:22:35.856675 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:22:35.856675 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 27905c76fef84432b849648b91a06963 Oct 12 13:22:35.856675 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin Oct 12 13:22:35.856675 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:22:35.856675 n-d-861076-2 devstack@n-api.service[120932]: exception: No hypervisor matching 'e483e663-e24c-451d-aa91-cb62f240a128' could be found. Oct 12 13:22:35.856675 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'e483e663-e24c-451d-aa91-cb62f240a128'} Oct 12 13:22:35.857388 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:35.857388 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:35.857388 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:35.857388 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:35.857388 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:35.857388 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:35.857388 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:22:35.857388 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:22:35.857388 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:35.857388 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:35.857388 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 12 13:22:35.857388 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 12 13:22:35.857388 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 12 13:22:35.857388 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 13:22:35.857388 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'e483e663-e24c-451d-aa91-cb62f240a128' could be found. Oct 12 13:22:35.857388 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:35.857388 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:35.857388 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:35.857388 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:35.858435 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:35.858435 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:35.858435 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:22:35.858435 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:22:35.858435 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'e483e663-e24c-451d-aa91-cb62f240a128' could be found. Oct 12 13:22:35.858435 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:35.858435 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-62caa6b3-4650-446d-b849-fbf6df5e66b7 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] Returning 404 to user: No hypervisor matching 'e483e663-e24c-451d-aa91-cb62f240a128' could be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:35.859543 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-62caa6b3-4650-446d-b849-fbf6df5e66b7 tempest-HypervisorAdminNegativeUnderV252Test-1797456849 tempest-HypervisorAdminNegativeUnderV252Test-1797456849-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/e483e663-e24c-451d-aa91-cb62f240a128/servers" status: 404 len: 123 microversion: 2.1 time: 0.032896 Oct 12 13:22:35.862029 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 153/333] 10.222.0.52 () {58 vars in 1281 bytes} [Wed Oct 12 13:22:35 2022] GET /compute/v2.1/os-hypervisors/e483e663-e24c-451d-aa91-cb62f240a128/servers => generated 123 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:22:35.889163 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-49e468ea-c63e-414c-bb4a-5d45baeb3957 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:35.900164 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-49e468ea-c63e-414c-bb4a-5d45baeb3957 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:35.902388 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-49e468ea-c63e-414c-bb4a-5d45baeb3957 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:35.919370 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-49e468ea-c63e-414c-bb4a-5d45baeb3957 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1447 microversion: 2.75 time: 0.334869 Oct 12 13:22:35.924255 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 181/334] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:35 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1447 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:36.111154 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-70f4a8b7-7709-49fb-987f-0b1023be9511 tempest-KeyPairsV210TestJSON-717807472 tempest-KeyPairsV210TestJSON-717807472-project-admin] Action: 'create', calling method: .version_select at 0x7f8aa0247160>, body: {"keypair": {"name": "tempest-keypair-83275881", "type": "ssh", "user_id": "ff473d6bbdc34d7f9b0f60af3064fed3", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzsBiAbGiVop2tTk8nQiD847h61fLAr7BCJpaPDDlOmuIB2zeOoVYijOt7Lr+JA9wc5hGSc/nzCCaynF3PqNNc3SEqBzTgK5twlCI54lmKy6eoGw/Kr7pS6JwoBi29r2w=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:36.119457 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:DELETE=7 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:36.141867 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-70f4a8b7-7709-49fb-987f-0b1023be9511 tempest-KeyPairsV210TestJSON-717807472 tempest-KeyPairsV210TestJSON-717807472-project-admin] Getting quotas for project 732f70c08d2749a2bc747fd88f14c7b3. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:22:36.149491 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-70f4a8b7-7709-49fb-987f-0b1023be9511 tempest-KeyPairsV210TestJSON-717807472 tempest-KeyPairsV210TestJSON-717807472-project-admin] Getting quotas for user e5abac585f1f44449254dd37da5287f0 and project 732f70c08d2749a2bc747fd88f14c7b3. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:22:36.285230 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-70f4a8b7-7709-49fb-987f-0b1023be9511 tempest-KeyPairsV210TestJSON-717807472 tempest-KeyPairsV210TestJSON-717807472-project-admin] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.10 time: 0.421060 Oct 12 13:22:36.285956 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 154/335] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Oct 12 13:22:35 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 423 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 13:22:36.304538 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-80d6dd5d-f41c-4bc2-aab9-4bb53975022f tempest-KeyPairsV210TestJSON-717807472 tempest-KeyPairsV210TestJSON-717807472-project-admin] Action: 'create', calling method: .version_select at 0x7f8aa03b6dc0>, body: {"keypair": {"name": "tempest-keypair-1392463033", "type": "ssh", "user_id": "ff473d6bbdc34d7f9b0f60af3064fed3", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8n1mKLVaywDU1QlX3he9eOCVg89yucdRDDN/9WjjfwQt1RAEi3EGPbgl1ONq7gLu6Rcp/jDBJVb4hDdbnZThIzW8AUv1dG/HhdOKk5gs2CHhvPEDG+mpk62SXpKp72Og=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:36.327692 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-80d6dd5d-f41c-4bc2-aab9-4bb53975022f tempest-KeyPairsV210TestJSON-717807472 tempest-KeyPairsV210TestJSON-717807472-project-admin] Getting quotas for project 732f70c08d2749a2bc747fd88f14c7b3. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:22:36.332140 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-80d6dd5d-f41c-4bc2-aab9-4bb53975022f tempest-KeyPairsV210TestJSON-717807472 tempest-KeyPairsV210TestJSON-717807472-project-admin] Getting quotas for user e5abac585f1f44449254dd37da5287f0 and project 732f70c08d2749a2bc747fd88f14c7b3. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:22:36.427031 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-80d6dd5d-f41c-4bc2-aab9-4bb53975022f tempest-KeyPairsV210TestJSON-717807472 tempest-KeyPairsV210TestJSON-717807472-project-admin] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.127264 Oct 12 13:22:36.428029 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 182/336] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Oct 12 13:22:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 129 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 13:22:36.439489 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-61bb3d5a-2556-4cb4-be8a-1724bf4bf94f tempest-KeyPairsV210TestJSON-717807472 tempest-KeyPairsV210TestJSON-717807472-project-admin] Calling method '.version_select at 0x7f8aa01f4310>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:36.459311 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-61bb3d5a-2556-4cb4-be8a-1724bf4bf94f tempest-KeyPairsV210TestJSON-717807472 tempest-KeyPairsV210TestJSON-717807472-project-admin] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-83275881?user_id=ff473d6bbdc34d7f9b0f60af3064fed3" status: 200 len: 510 microversion: 2.10 time: 0.021605 Oct 12 13:22:36.459311 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 155/337] 10.222.0.52 () {60 vars in 1334 bytes} [Wed Oct 12 13:22:36 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-83275881?user_id=ff473d6bbdc34d7f9b0f60af3064fed3 => generated 510 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:22:36.476306 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-aa3eb04a-c1c4-4278-ada4-fa940def9210 tempest-KeyPairsV210TestJSON-717807472 tempest-KeyPairsV210TestJSON-717807472-project-admin] Action: 'create', calling method: .version_select at 0x7f8aa049a3a0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1268632625", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNLZckYkvkkNyjeaUgYAC3tWyb4AkBmuNCRRwMTc/Jt3qjE5yw6qM4abSppBvAPQo8BRkRp/66XwESDAoRlSJClGSDyxG9qPYr9vg7QdEoXWXsmghfsCBTsV5fV8w/IMQ=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:36.489568 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:36.511339 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-aa3eb04a-c1c4-4278-ada4-fa940def9210 tempest-KeyPairsV210TestJSON-717807472 tempest-KeyPairsV210TestJSON-717807472-project-admin] Getting quotas for project 732f70c08d2749a2bc747fd88f14c7b3. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:22:36.517576 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-aa3eb04a-c1c4-4278-ada4-fa940def9210 tempest-KeyPairsV210TestJSON-717807472 tempest-KeyPairsV210TestJSON-717807472-project-admin] Getting quotas for user e5abac585f1f44449254dd37da5287f0 and project 732f70c08d2749a2bc747fd88f14c7b3. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:22:36.552919 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a1e003d0-409c-4c3c-8875-9f383d471545 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:36.553575 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a1e003d0-409c-4c3c-8875-9f383d471545 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:36.560665 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a1e003d0-409c-4c3c-8875-9f383d471545 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:36.561299 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a1e003d0-409c-4c3c-8875-9f383d471545 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:36.561887 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a1e003d0-409c-4c3c-8875-9f383d471545 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:36.562860 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a1e003d0-409c-4c3c-8875-9f383d471545 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:36.563310 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a1e003d0-409c-4c3c-8875-9f383d471545 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:36.563914 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a1e003d0-409c-4c3c-8875-9f383d471545 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:36.644296 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-aa3eb04a-c1c4-4278-ada4-fa940def9210 tempest-KeyPairsV210TestJSON-717807472 tempest-KeyPairsV210TestJSON-717807472-project-admin] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.173853 Oct 12 13:22:36.645684 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 183/338] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Oct 12 13:22:36 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 176 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 12 13:22:36.650717 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1d5ae8bc-a18c-45ad-817c-d0a460d230c3 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Action: 'update', calling method: .version_select at 0x7f8aa03b6820>, body: {"quota_set": {"ram": "2048"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:36.665970 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-a1e003d0-409c-4c3c-8875-9f383d471545 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:36.682298 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a1e003d0-409c-4c3c-8875-9f383d471545 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f" status: 200 len: 1271 microversion: 2.1 time: 0.133327 Oct 12 13:22:36.683201 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 156/339] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:36 2022] GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f => generated 1271 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:22:36.701162 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-13b4246c-eb89-48b2-bc88-58cf5372ab9c tempest-KeyPairsV210TestJSON-717807472 tempest-KeyPairsV210TestJSON-717807472-project-admin] Calling method '.version_select at 0x7f8aa01efaf0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:36.706873 n-d-861076-2 devstack@n-api.service[120932]: WARNING oslo_db.sqlalchemy.utils [None req-13b4246c-eb89-48b2-bc88-58cf5372ab9c tempest-KeyPairsV210TestJSON-717807472 tempest-KeyPairsV210TestJSON-717807472-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 13:22:36.723095 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-13b4246c-eb89-48b2-bc88-58cf5372ab9c tempest-KeyPairsV210TestJSON-717807472 tempest-KeyPairsV210TestJSON-717807472-project-admin] 10.222.0.52 "GET /compute/v2.1/os-keypairs?user_id=ff473d6bbdc34d7f9b0f60af3064fed3" status: 200 len: 724 microversion: 2.10 time: 0.038604 Oct 12 13:22:36.731769 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 157/340] 10.222.0.52 () {60 vars in 1259 bytes} [Wed Oct 12 13:22:36 2022] GET /compute/v2.1/os-keypairs?user_id=ff473d6bbdc34d7f9b0f60af3064fed3 => generated 724 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:22:36.739017 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-953938a6-6108-4ce8-b7b7-3cec8fcf0a58 tempest-KeyPairsV210TestJSON-717807472 tempest-KeyPairsV210TestJSON-717807472-project-admin] Calling method '.version_select at 0x7f8aa01f4790>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:36.880189 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-953938a6-6108-4ce8-b7b7-3cec8fcf0a58 tempest-KeyPairsV210TestJSON-717807472 tempest-KeyPairsV210TestJSON-717807472-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1268632625" status: 204 len: 0 microversion: 2.10 time: 0.144468 Oct 12 13:22:36.882606 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 158/341] 10.222.0.52 () {60 vars in 1325 bytes} [Wed Oct 12 13:22:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1268632625 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 13:22:36.897084 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ced636f5-7186-4f21-82e2-5af51196407d tempest-KeyPairsV210TestJSON-717807472 tempest-KeyPairsV210TestJSON-717807472-project-admin] Calling method '.version_select at 0x7f8aa01ff820>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:36.978370 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d5ae8bc-a18c-45ad-817c-d0a460d230c3 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:36.978870 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d5ae8bc-a18c-45ad-817c-d0a460d230c3 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:36.981326 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d5ae8bc-a18c-45ad-817c-d0a460d230c3 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:36.983327 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d5ae8bc-a18c-45ad-817c-d0a460d230c3 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:36.983746 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d5ae8bc-a18c-45ad-817c-d0a460d230c3 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:36.984187 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d5ae8bc-a18c-45ad-817c-d0a460d230c3 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:37.066255 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ced636f5-7186-4f21-82e2-5af51196407d tempest-KeyPairsV210TestJSON-717807472 tempest-KeyPairsV210TestJSON-717807472-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392463033?user_id=ff473d6bbdc34d7f9b0f60af3064fed3" status: 204 len: 0 microversion: 2.10 time: 0.177757 Oct 12 13:22:37.067257 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 159/342] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Oct 12 13:22:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392463033?user_id=ff473d6bbdc34d7f9b0f60af3064fed3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 13:22:37.072171 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-52eacc1e-89ff-4e35-b2c1-c5767e8d488b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:37.072884 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-52eacc1e-89ff-4e35-b2c1-c5767e8d488b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:37.092518 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d5ae8bc-a18c-45ad-817c-d0a460d230c3 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:37.094165 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d5ae8bc-a18c-45ad-817c-d0a460d230c3 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:37.096064 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d5ae8bc-a18c-45ad-817c-d0a460d230c3 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:37.097990 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d5ae8bc-a18c-45ad-817c-d0a460d230c3 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:37.098657 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d5ae8bc-a18c-45ad-817c-d0a460d230c3 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:37.099249 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d5ae8bc-a18c-45ad-817c-d0a460d230c3 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:37.101312 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-52eacc1e-89ff-4e35-b2c1-c5767e8d488b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:37.102949 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-52eacc1e-89ff-4e35-b2c1-c5767e8d488b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:37.105907 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-52eacc1e-89ff-4e35-b2c1-c5767e8d488b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:37.108407 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-52eacc1e-89ff-4e35-b2c1-c5767e8d488b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:37.109714 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-52eacc1e-89ff-4e35-b2c1-c5767e8d488b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:37.112374 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-52eacc1e-89ff-4e35-b2c1-c5767e8d488b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:37.245751 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1d5ae8bc-a18c-45ad-817c-d0a460d230c3 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/06afe95ee8b7439cb5ca36900c6562fd?user_id=6a5401de9a8d4ad98981e0601d52cadd" status: 200 len: 240 microversion: 2.36 time: 0.598059 Oct 12 13:22:37.247584 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 184/343] 10.222.0.52 () {62 vars in 1384 bytes} [Wed Oct 12 13:22:36 2022] PUT /compute/v2.1/os-quota-sets/06afe95ee8b7439cb5ca36900c6562fd?user_id=6a5401de9a8d4ad98981e0601d52cadd => generated 240 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:22:37.252756 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c58242e5-c61b-41d2-866b-fc842fc7e8d1 tempest-KeyPairsV210TestJSON-717807472 tempest-KeyPairsV210TestJSON-717807472-project-admin] Calling method '.version_select at 0x7f8aa03b60d0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:37.326793 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-52eacc1e-89ff-4e35-b2c1-c5767e8d488b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:37.342353 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-52eacc1e-89ff-4e35-b2c1-c5767e8d488b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:37.346504 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-52eacc1e-89ff-4e35-b2c1-c5767e8d488b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:37.346711 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c58242e5-c61b-41d2-866b-fc842fc7e8d1 tempest-KeyPairsV210TestJSON-717807472 tempest-KeyPairsV210TestJSON-717807472-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-83275881?user_id=ff473d6bbdc34d7f9b0f60af3064fed3" status: 204 len: 0 microversion: 2.10 time: 0.097828 Oct 12 13:22:37.347616 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 185/344] 10.222.0.52 () {60 vars in 1337 bytes} [Wed Oct 12 13:22:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-83275881?user_id=ff473d6bbdc34d7f9b0f60af3064fed3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 13:22:37.352292 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1edf87b2-2a42-47f9-82c0-5b45f2e22577 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] Calling method '.version_select at 0x7f8aa0364670>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:37.362608 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-52eacc1e-89ff-4e35-b2c1-c5767e8d488b tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1447 microversion: 2.75 time: 0.294284 Oct 12 13:22:37.366039 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 160/345] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:37 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1447 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:37.717640 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f0ae02e9-c965-4b2d-b5b5-e9898a0c5837 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:37.719322 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f0ae02e9-c965-4b2d-b5b5-e9898a0c5837 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:37.726480 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0ae02e9-c965-4b2d-b5b5-e9898a0c5837 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:37.727104 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0ae02e9-c965-4b2d-b5b5-e9898a0c5837 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:37.727603 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0ae02e9-c965-4b2d-b5b5-e9898a0c5837 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:37.728379 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0ae02e9-c965-4b2d-b5b5-e9898a0c5837 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:37.728962 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0ae02e9-c965-4b2d-b5b5-e9898a0c5837 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:37.729512 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0ae02e9-c965-4b2d-b5b5-e9898a0c5837 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:37.850449 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f0ae02e9-c965-4b2d-b5b5-e9898a0c5837 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:37.865136 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f0ae02e9-c965-4b2d-b5b5-e9898a0c5837 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f" status: 200 len: 1271 microversion: 2.1 time: 0.153422 Oct 12 13:22:37.866751 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 161/346] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:37 2022] GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:22:38.400876 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f377213c-f19b-4fd2-bfac-d4b58c3b39b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:38.403903 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f377213c-f19b-4fd2-bfac-d4b58c3b39b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:38.413471 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f377213c-f19b-4fd2-bfac-d4b58c3b39b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:38.414148 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f377213c-f19b-4fd2-bfac-d4b58c3b39b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:38.414887 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f377213c-f19b-4fd2-bfac-d4b58c3b39b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:38.415762 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f377213c-f19b-4fd2-bfac-d4b58c3b39b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:38.416219 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f377213c-f19b-4fd2-bfac-d4b58c3b39b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:38.419987 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f377213c-f19b-4fd2-bfac-d4b58c3b39b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:38.519204 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1edf87b2-2a42-47f9-82c0-5b45f2e22577 tempest-QuotasAdminTestV236-2141695072 tempest-QuotasAdminTestV236-2141695072-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/06afe95ee8b7439cb5ca36900c6562fd?user_id=6a5401de9a8d4ad98981e0601d52cadd" status: 200 len: 282 microversion: 2.36 time: 1.170221 Oct 12 13:22:38.520775 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 186/347] 10.222.0.52 () {60 vars in 1364 bytes} [Wed Oct 12 13:22:37 2022] GET /compute/v2.1/os-quota-sets/06afe95ee8b7439cb5ca36900c6562fd?user_id=6a5401de9a8d4ad98981e0601d52cadd => generated 282 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:22:38.658560 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f377213c-f19b-4fd2-bfac-d4b58c3b39b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:38.670090 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f377213c-f19b-4fd2-bfac-d4b58c3b39b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:38.673056 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f377213c-f19b-4fd2-bfac-d4b58c3b39b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:38.687291 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f377213c-f19b-4fd2-bfac-d4b58c3b39b0 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1447 microversion: 2.75 time: 0.290790 Oct 12 13:22:38.687888 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 162/348] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:38 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1447 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:38.889625 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1f98a12e-b20c-4493-b02a-15855d3c2c09 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:38.890259 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-1f98a12e-b20c-4493-b02a-15855d3c2c09 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:38.911077 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1f98a12e-b20c-4493-b02a-15855d3c2c09 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:38.912223 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1f98a12e-b20c-4493-b02a-15855d3c2c09 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:38.913651 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1f98a12e-b20c-4493-b02a-15855d3c2c09 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:38.918402 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1f98a12e-b20c-4493-b02a-15855d3c2c09 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:38.919220 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1f98a12e-b20c-4493-b02a-15855d3c2c09 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:38.919957 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1f98a12e-b20c-4493-b02a-15855d3c2c09 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:39.193138 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-1f98a12e-b20c-4493-b02a-15855d3c2c09 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:39.208576 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1f98a12e-b20c-4493-b02a-15855d3c2c09 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f" status: 200 len: 1313 microversion: 2.1 time: 0.316308 Oct 12 13:22:39.209265 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 187/349] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:38 2022] GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:22:39.544270 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-82c62f8e-7e8a-47de-8317-01b6772ae560 req-c1906cf8-0b0e-43b7-aa6f-7cf34c6c7795 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "085c7252-d302-4b81-a7f1-15311733615f", "tag": "209cb5fd-6431-4f81-a541-b318f2cee471"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:39.574159 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-82c62f8e-7e8a-47de-8317-01b6772ae560 req-c1906cf8-0b0e-43b7-aa6f-7cf34c6c7795 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:39.574655 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-82c62f8e-7e8a-47de-8317-01b6772ae560 req-c1906cf8-0b0e-43b7-aa6f-7cf34c6c7795 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:39.575091 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-82c62f8e-7e8a-47de-8317-01b6772ae560 req-c1906cf8-0b0e-43b7-aa6f-7cf34c6c7795 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:39.589964 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-82c62f8e-7e8a-47de-8317-01b6772ae560 req-c1906cf8-0b0e-43b7-aa6f-7cf34c6c7795 service nova] Creating event network-changed:209cb5fd-6431-4f81-a541-b318f2cee471 for instance 085c7252-d302-4b81-a7f1-15311733615f on n-h1-861076-2 Oct 12 13:22:39.605117 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-82c62f8e-7e8a-47de-8317-01b6772ae560 req-c1906cf8-0b0e-43b7-aa6f-7cf34c6c7795 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065947 Oct 12 13:22:39.616152 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 163/350] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:39.717901 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7f67f603-92a1-4ed2-abb5-66c41b57b277 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:39.718618 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7f67f603-92a1-4ed2-abb5-66c41b57b277 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:39.729649 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7f67f603-92a1-4ed2-abb5-66c41b57b277 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:39.737620 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7f67f603-92a1-4ed2-abb5-66c41b57b277 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:39.738220 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7f67f603-92a1-4ed2-abb5-66c41b57b277 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:39.739079 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7f67f603-92a1-4ed2-abb5-66c41b57b277 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:39.739646 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7f67f603-92a1-4ed2-abb5-66c41b57b277 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:39.740172 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7f67f603-92a1-4ed2-abb5-66c41b57b277 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:40.117734 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-7f67f603-92a1-4ed2-abb5-66c41b57b277 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:40.131426 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-7f67f603-92a1-4ed2-abb5-66c41b57b277 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:40.138339 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-7f67f603-92a1-4ed2-abb5-66c41b57b277 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:40.148874 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-7f67f603-92a1-4ed2-abb5-66c41b57b277 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1447 microversion: 2.75 time: 0.435539 Oct 12 13:22:40.182250 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 188/351] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:39 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1447 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:40.238068 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d319526c-8919-401b-b034-eef4670c4625 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:40.239016 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d319526c-8919-401b-b034-eef4670c4625 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:40.269721 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d319526c-8919-401b-b034-eef4670c4625 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:40.271551 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d319526c-8919-401b-b034-eef4670c4625 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:40.274191 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d319526c-8919-401b-b034-eef4670c4625 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:40.278184 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d319526c-8919-401b-b034-eef4670c4625 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:40.278669 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d319526c-8919-401b-b034-eef4670c4625 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:40.279110 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d319526c-8919-401b-b034-eef4670c4625 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:40.696130 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d319526c-8919-401b-b034-eef4670c4625 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:40.703864 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d319526c-8919-401b-b034-eef4670c4625 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f" status: 200 len: 1313 microversion: 2.1 time: 0.473238 Oct 12 13:22:40.704424 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 164/352] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:40 2022] GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:22:41.179299 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6ecafa14-f386-47c0-817f-3b986eb8a8b9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:41.179977 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-6ecafa14-f386-47c0-817f-3b986eb8a8b9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:41.187924 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6ecafa14-f386-47c0-817f-3b986eb8a8b9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:41.188849 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6ecafa14-f386-47c0-817f-3b986eb8a8b9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:41.189576 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6ecafa14-f386-47c0-817f-3b986eb8a8b9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:41.190505 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6ecafa14-f386-47c0-817f-3b986eb8a8b9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:41.191161 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6ecafa14-f386-47c0-817f-3b986eb8a8b9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:41.191770 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6ecafa14-f386-47c0-817f-3b986eb8a8b9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:41.270366 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-6ecafa14-f386-47c0-817f-3b986eb8a8b9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:41.280641 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-6ecafa14-f386-47c0-817f-3b986eb8a8b9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:41.282431 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-6ecafa14-f386-47c0-817f-3b986eb8a8b9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:41.288838 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6ecafa14-f386-47c0-817f-3b986eb8a8b9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1447 microversion: 2.75 time: 0.114245 Oct 12 13:22:41.290121 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 189/353] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:41 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1447 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:41.728198 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-734630fc-4dcb-49b6-9ff6-f572a170c1f4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:41.728886 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-734630fc-4dcb-49b6-9ff6-f572a170c1f4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:41.739691 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-734630fc-4dcb-49b6-9ff6-f572a170c1f4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:41.740186 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-734630fc-4dcb-49b6-9ff6-f572a170c1f4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:41.740625 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-734630fc-4dcb-49b6-9ff6-f572a170c1f4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:41.746032 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-734630fc-4dcb-49b6-9ff6-f572a170c1f4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:41.746556 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-734630fc-4dcb-49b6-9ff6-f572a170c1f4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:41.746998 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-734630fc-4dcb-49b6-9ff6-f572a170c1f4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:42.221447 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-734630fc-4dcb-49b6-9ff6-f572a170c1f4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:42.236734 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-734630fc-4dcb-49b6-9ff6-f572a170c1f4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f" status: 200 len: 1313 microversion: 2.1 time: 0.511053 Oct 12 13:22:42.239679 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 165/354] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:41 2022] GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:22:42.321427 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4100dae1-9dfb-4077-b469-b48c6e8b8bcd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:42.327624 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-4100dae1-9dfb-4077-b469-b48c6e8b8bcd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:42.349497 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4100dae1-9dfb-4077-b469-b48c6e8b8bcd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:42.352133 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4100dae1-9dfb-4077-b469-b48c6e8b8bcd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:42.352790 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4100dae1-9dfb-4077-b469-b48c6e8b8bcd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:42.353750 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4100dae1-9dfb-4077-b469-b48c6e8b8bcd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:42.355300 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4100dae1-9dfb-4077-b469-b48c6e8b8bcd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:42.358710 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4100dae1-9dfb-4077-b469-b48c6e8b8bcd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:42.570452 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-4100dae1-9dfb-4077-b469-b48c6e8b8bcd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:42.580342 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-4100dae1-9dfb-4077-b469-b48c6e8b8bcd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:42.582116 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-4100dae1-9dfb-4077-b469-b48c6e8b8bcd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:42.588359 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4100dae1-9dfb-4077-b469-b48c6e8b8bcd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1447 microversion: 2.75 time: 0.274531 Oct 12 13:22:42.589559 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 190/355] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:42 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1447 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:43.272518 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b0e42902-e0ba-4fb8-9490-bb8453d8877e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:43.273157 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b0e42902-e0ba-4fb8-9490-bb8453d8877e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:43.288384 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b0e42902-e0ba-4fb8-9490-bb8453d8877e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:43.289309 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b0e42902-e0ba-4fb8-9490-bb8453d8877e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:43.291591 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b0e42902-e0ba-4fb8-9490-bb8453d8877e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:43.291591 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b0e42902-e0ba-4fb8-9490-bb8453d8877e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:43.291591 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b0e42902-e0ba-4fb8-9490-bb8453d8877e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:43.291591 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b0e42902-e0ba-4fb8-9490-bb8453d8877e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:43.616417 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9569bddd-52e3-4c3e-ad41-514a537ea661 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:43.620927 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-9569bddd-52e3-4c3e-ad41-514a537ea661 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:43.633570 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9569bddd-52e3-4c3e-ad41-514a537ea661 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:43.634180 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9569bddd-52e3-4c3e-ad41-514a537ea661 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:43.636681 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9569bddd-52e3-4c3e-ad41-514a537ea661 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:43.637561 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9569bddd-52e3-4c3e-ad41-514a537ea661 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:43.639500 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9569bddd-52e3-4c3e-ad41-514a537ea661 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:43.643223 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9569bddd-52e3-4c3e-ad41-514a537ea661 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:43.916617 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9569bddd-52e3-4c3e-ad41-514a537ea661 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:43.926233 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:43.938257 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9569bddd-52e3-4c3e-ad41-514a537ea661 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:43.940852 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9569bddd-52e3-4c3e-ad41-514a537ea661 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:43.950647 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9569bddd-52e3-4c3e-ad41-514a537ea661 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1447 microversion: 2.75 time: 0.338030 Oct 12 13:22:43.957305 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 191/356] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:43 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1447 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:22:44.047730 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-b0e42902-e0ba-4fb8-9490-bb8453d8877e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:44.052380 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b0e42902-e0ba-4fb8-9490-bb8453d8877e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f" status: 200 len: 1313 microversion: 2.1 time: 0.783524 Oct 12 13:22:44.053476 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 166/357] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:43 2022] GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f => generated 1313 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:22:44.982130 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6c762439-2bbd-408f-99ab-7ea72a8d1c1d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:44.982742 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-6c762439-2bbd-408f-99ab-7ea72a8d1c1d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:45.012017 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6c762439-2bbd-408f-99ab-7ea72a8d1c1d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:45.017608 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6c762439-2bbd-408f-99ab-7ea72a8d1c1d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:45.018283 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6c762439-2bbd-408f-99ab-7ea72a8d1c1d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:45.027287 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6c762439-2bbd-408f-99ab-7ea72a8d1c1d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:45.031006 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6c762439-2bbd-408f-99ab-7ea72a8d1c1d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:45.031943 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6c762439-2bbd-408f-99ab-7ea72a8d1c1d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:45.079291 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-beb49cdf-3f3a-4fe4-9942-0a12e0cff24d tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:45.079291 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-beb49cdf-3f3a-4fe4-9942-0a12e0cff24d tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:45.091340 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-beb49cdf-3f3a-4fe4-9942-0a12e0cff24d tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:45.092091 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-beb49cdf-3f3a-4fe4-9942-0a12e0cff24d tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:45.092810 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-beb49cdf-3f3a-4fe4-9942-0a12e0cff24d tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:45.094640 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-beb49cdf-3f3a-4fe4-9942-0a12e0cff24d tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:45.095296 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-beb49cdf-3f3a-4fe4-9942-0a12e0cff24d tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:45.098656 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-beb49cdf-3f3a-4fe4-9942-0a12e0cff24d tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:45.228635 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=100 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:45.394557 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-6c762439-2bbd-408f-99ab-7ea72a8d1c1d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:45.408766 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-6c762439-2bbd-408f-99ab-7ea72a8d1c1d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:45.415096 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-6c762439-2bbd-408f-99ab-7ea72a8d1c1d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:45.430503 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6c762439-2bbd-408f-99ab-7ea72a8d1c1d tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1447 microversion: 2.75 time: 0.455920 Oct 12 13:22:45.435507 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 192/358] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:44 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1447 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:45.645165 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:45.711930 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-beb49cdf-3f3a-4fe4-9942-0a12e0cff24d tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:45.756234 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-beb49cdf-3f3a-4fe4-9942-0a12e0cff24d tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f" status: 200 len: 1313 microversion: 2.1 time: 0.647665 Oct 12 13:22:45.756234 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 167/359] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:45 2022] GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f => generated 1313 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:22:46.132098 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-735b5a1f-3912-469f-ade7-cf26e1761c50 tempest-QuotaClassesAdmin257Test-1211423839 tempest-QuotaClassesAdmin257Test-1211423839-project-admin] Calling method '.version_select at 0x7f8aa03b6dc0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:46.157823 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-735b5a1f-3912-469f-ade7-cf26e1761c50 tempest-QuotaClassesAdmin257Test-1211423839 tempest-QuotaClassesAdmin257Test-1211423839-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.281132 Oct 12 13:22:46.165304 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 193/360] 10.222.0.52 () {60 vars in 1226 bytes} [Wed Oct 12 13:22:45 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:22:46.170997 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f8864b5c-4521-48de-88fa-769e9ed2d018 tempest-QuotaClassesAdmin257Test-1211423839 tempest-QuotaClassesAdmin257Test-1211423839-project-admin] Action: 'update', calling method: .version_select at 0x7f8aa030b5e0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:46.196199 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=16 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:46.475319 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2cc25301-7381-47c9-a763-1aadf87bde29 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:46.475960 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-2cc25301-7381-47c9-a763-1aadf87bde29 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:46.497994 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2cc25301-7381-47c9-a763-1aadf87bde29 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:46.497994 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2cc25301-7381-47c9-a763-1aadf87bde29 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:46.497994 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2cc25301-7381-47c9-a763-1aadf87bde29 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:46.497994 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2cc25301-7381-47c9-a763-1aadf87bde29 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:46.498380 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2cc25301-7381-47c9-a763-1aadf87bde29 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:46.499442 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2cc25301-7381-47c9-a763-1aadf87bde29 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:47.010735 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-2cc25301-7381-47c9-a763-1aadf87bde29 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:47.022245 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-2cc25301-7381-47c9-a763-1aadf87bde29 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:47.024438 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-2cc25301-7381-47c9-a763-1aadf87bde29 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:47.032428 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2cc25301-7381-47c9-a763-1aadf87bde29 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1447 microversion: 2.75 time: 0.569430 Oct 12 13:22:47.033681 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 194/361] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:46 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1447 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:47.046411 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6ea0d638-8794-479d-8740-08376c29b744 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:47.049624 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-6ea0d638-8794-479d-8740-08376c29b744 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:47.059374 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6ea0d638-8794-479d-8740-08376c29b744 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:47.060084 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6ea0d638-8794-479d-8740-08376c29b744 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:47.061008 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6ea0d638-8794-479d-8740-08376c29b744 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:47.062023 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6ea0d638-8794-479d-8740-08376c29b744 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:47.062635 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6ea0d638-8794-479d-8740-08376c29b744 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:47.063240 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6ea0d638-8794-479d-8740-08376c29b744 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:47.121100 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=9 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:47.182654 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f8864b5c-4521-48de-88fa-769e9ed2d018 tempest-QuotaClassesAdmin257Test-1211423839 tempest-QuotaClassesAdmin257Test-1211423839-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 1.011343 Oct 12 13:22:47.183316 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 168/362] 10.222.0.52 () {62 vars in 1247 bytes} [Wed Oct 12 13:22:46 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:22:47.199080 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a2bc25c9-2840-4048-9d91-cc90856dedf9 tempest-QuotaClassesAdmin257Test-1211423839 tempest-QuotaClassesAdmin257Test-1211423839-project-admin] Calling method '.version_select at 0x7f8aa030b0d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:47.221101 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a2bc25c9-2840-4048-9d91-cc90856dedf9 tempest-QuotaClassesAdmin257Test-1211423839 tempest-QuotaClassesAdmin257Test-1211423839-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.027947 Oct 12 13:22:47.221886 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 169/363] 10.222.0.52 () {60 vars in 1226 bytes} [Wed Oct 12 13:22:47 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:22:47.239466 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-73e9fdda-1321-4f33-9538-0983f8cdd053 tempest-QuotaClassesAdmin257Test-1211423839 tempest-QuotaClassesAdmin257Test-1211423839-project-admin] Action: 'update', calling method: .version_select at 0x7f8aa01ef4c0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:47.473107 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-6ea0d638-8794-479d-8740-08376c29b744 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:47.484173 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6ea0d638-8794-479d-8740-08376c29b744 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f" status: 200 len: 1313 microversion: 2.1 time: 0.445887 Oct 12 13:22:47.498283 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 195/364] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:47 2022] GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f => generated 1313 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:22:47.649001 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-96ae435f-994b-48dd-9759-05942e085415 req-bef91244-64c0-4686-976f-3287bec1c311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "085c7252-d302-4b81-a7f1-15311733615f", "name": "network-vif-plugged", "status": "completed", "tag": "209cb5fd-6431-4f81-a541-b318f2cee471"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:47.668212 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-96ae435f-994b-48dd-9759-05942e085415 req-bef91244-64c0-4686-976f-3287bec1c311 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:47.668935 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-96ae435f-994b-48dd-9759-05942e085415 req-bef91244-64c0-4686-976f-3287bec1c311 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:47.669620 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-96ae435f-994b-48dd-9759-05942e085415 req-bef91244-64c0-4686-976f-3287bec1c311 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:47.686590 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-96ae435f-994b-48dd-9759-05942e085415 req-bef91244-64c0-4686-976f-3287bec1c311 service nova] Creating event network-vif-plugged:209cb5fd-6431-4f81-a541-b318f2cee471 for instance 085c7252-d302-4b81-a7f1-15311733615f on n-h1-861076-2 Oct 12 13:22:47.693726 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-96ae435f-994b-48dd-9759-05942e085415 req-bef91244-64c0-4686-976f-3287bec1c311 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051549 Oct 12 13:22:47.696481 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 196/365] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:48.004238 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-73e9fdda-1321-4f33-9538-0983f8cdd053 tempest-QuotaClassesAdmin257Test-1211423839 tempest-QuotaClassesAdmin257Test-1211423839-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.768811 Oct 12 13:22:48.013378 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 170/366] 10.222.0.52 () {62 vars in 1247 bytes} [Wed Oct 12 13:22:47 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:22:48.068889 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b66129e2-3f33-4e09-a9cf-83dd924c1c98 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:48.069631 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-b66129e2-3f33-4e09-a9cf-83dd924c1c98 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:48.080432 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b66129e2-3f33-4e09-a9cf-83dd924c1c98 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:48.080946 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b66129e2-3f33-4e09-a9cf-83dd924c1c98 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:48.081393 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b66129e2-3f33-4e09-a9cf-83dd924c1c98 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:48.082113 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b66129e2-3f33-4e09-a9cf-83dd924c1c98 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:48.082607 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b66129e2-3f33-4e09-a9cf-83dd924c1c98 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:48.088070 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b66129e2-3f33-4e09-a9cf-83dd924c1c98 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:48.211757 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b66129e2-3f33-4e09-a9cf-83dd924c1c98 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:48.225246 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b66129e2-3f33-4e09-a9cf-83dd924c1c98 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:48.229192 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b66129e2-3f33-4e09-a9cf-83dd924c1c98 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:48.243847 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b66129e2-3f33-4e09-a9cf-83dd924c1c98 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1447 microversion: 2.75 time: 0.178712 Oct 12 13:22:48.256990 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 197/367] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:48 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1447 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:48.511869 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1c5e5a1c-7bb7-4122-8cd7-6ad2c67731b8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:48.512501 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1c5e5a1c-7bb7-4122-8cd7-6ad2c67731b8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:48.515250 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=8,nova_api:DELETE=2,nova_api:UPDATE=14 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:22:48.524722 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c5e5a1c-7bb7-4122-8cd7-6ad2c67731b8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:48.525285 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c5e5a1c-7bb7-4122-8cd7-6ad2c67731b8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:48.525727 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c5e5a1c-7bb7-4122-8cd7-6ad2c67731b8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:48.526438 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c5e5a1c-7bb7-4122-8cd7-6ad2c67731b8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:48.526894 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c5e5a1c-7bb7-4122-8cd7-6ad2c67731b8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:48.527313 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c5e5a1c-7bb7-4122-8cd7-6ad2c67731b8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:49.208536 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-1c5e5a1c-7bb7-4122-8cd7-6ad2c67731b8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:49.220528 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1c5e5a1c-7bb7-4122-8cd7-6ad2c67731b8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f" status: 200 len: 1313 microversion: 2.1 time: 0.713041 Oct 12 13:22:49.222303 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 171/368] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:48 2022] GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f => generated 1313 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:22:49.283066 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-07243c5b-b58a-4f60-8edc-f9809d77993c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:49.283066 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-07243c5b-b58a-4f60-8edc-f9809d77993c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:49.289499 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-07243c5b-b58a-4f60-8edc-f9809d77993c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:49.292412 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-07243c5b-b58a-4f60-8edc-f9809d77993c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:49.293133 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-07243c5b-b58a-4f60-8edc-f9809d77993c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:49.295285 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-07243c5b-b58a-4f60-8edc-f9809d77993c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:49.297205 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-07243c5b-b58a-4f60-8edc-f9809d77993c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:49.299121 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-07243c5b-b58a-4f60-8edc-f9809d77993c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:49.493886 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c04362d5-0b69-4654-80f5-a1c45c97a0fc tempest-NetworksTest-2140848201 tempest-NetworksTest-2140848201-project-admin] Calling method '.version_select at 0x7f8aa038cca0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:49.536258 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-07243c5b-b58a-4f60-8edc-f9809d77993c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:49.546922 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-07243c5b-b58a-4f60-8edc-f9809d77993c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:49.548942 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-07243c5b-b58a-4f60-8edc-f9809d77993c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:49.555093 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-07243c5b-b58a-4f60-8edc-f9809d77993c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1447 microversion: 2.75 time: 0.282894 Oct 12 13:22:49.556925 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 172/369] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:49 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1447 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:22:50.014011 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c04362d5-0b69-4654-80f5-a1c45c97a0fc tempest-NetworksTest-2140848201 tempest-NetworksTest-2140848201-project-admin] 10.222.0.52 "GET /compute/v2.1/os-networks" status: 200 len: 5395 microversion: 2.1 time: 0.838932 Oct 12 13:22:50.014949 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 198/370] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:22:49 2022] GET /compute/v2.1/os-networks => generated 5395 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:22:50.028312 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-90f707dd-947e-4b6b-aaff-d25462305fa3 tempest-NetworksTest-2140848201 tempest-NetworksTest-2140848201-project-admin] Calling method '.version_select at 0x7f8aa01d1790>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:50.203986 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-90f707dd-947e-4b6b-aaff-d25462305fa3 tempest-NetworksTest-2140848201 tempest-NetworksTest-2140848201-project-admin] 10.222.0.52 "GET /compute/v2.1/os-networks/9fb04cb9-bc64-4763-ad48-e24392a2a610" status: 200 len: 652 microversion: 2.1 time: 0.183964 Oct 12 13:22:50.204764 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 173/371] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 12 13:22:50 2022] GET /compute/v2.1/os-networks/9fb04cb9-bc64-4763-ad48-e24392a2a610 => generated 652 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:50.215374 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a69beafa-a185-449b-9398-197d2d3a5326 tempest-NetworksTest-2140848201 tempest-NetworksTest-2140848201-project-admin] Calling method '.version_select at 0x7f8aa0364160>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:50.249728 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7f2d7e2d-9623-4c2b-a21b-39fd76a4abe2 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:50.250341 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7f2d7e2d-9623-4c2b-a21b-39fd76a4abe2 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:50.265288 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f2d7e2d-9623-4c2b-a21b-39fd76a4abe2 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:50.265794 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f2d7e2d-9623-4c2b-a21b-39fd76a4abe2 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:50.266235 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f2d7e2d-9623-4c2b-a21b-39fd76a4abe2 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:50.267129 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f2d7e2d-9623-4c2b-a21b-39fd76a4abe2 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:50.267728 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f2d7e2d-9623-4c2b-a21b-39fd76a4abe2 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:50.268314 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f2d7e2d-9623-4c2b-a21b-39fd76a4abe2 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:50.846085 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a69beafa-a185-449b-9398-197d2d3a5326 tempest-NetworksTest-2140848201 tempest-NetworksTest-2140848201-project-admin] 10.222.0.52 "GET /compute/v2.1/os-networks" status: 200 len: 5395 microversion: 2.1 time: 0.635609 Oct 12 13:22:50.851590 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 199/372] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:22:50 2022] GET /compute/v2.1/os-networks => generated 5395 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:22:50.858680 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cb208822-da10-4a0e-9a83-96f30cc6abdd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:50.859502 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-cb208822-da10-4a0e-9a83-96f30cc6abdd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:50.863942 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-7f2d7e2d-9623-4c2b-a21b-39fd76a4abe2 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:50.875564 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cb208822-da10-4a0e-9a83-96f30cc6abdd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:50.875564 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cb208822-da10-4a0e-9a83-96f30cc6abdd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:50.875564 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cb208822-da10-4a0e-9a83-96f30cc6abdd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:50.876115 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cb208822-da10-4a0e-9a83-96f30cc6abdd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:50.876587 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cb208822-da10-4a0e-9a83-96f30cc6abdd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:50.877081 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cb208822-da10-4a0e-9a83-96f30cc6abdd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:50.877745 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7f2d7e2d-9623-4c2b-a21b-39fd76a4abe2 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f" status: 200 len: 1463 microversion: 2.1 time: 0.631987 Oct 12 13:22:50.878345 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 174/373] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:50 2022] GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f => generated 1463 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:22:51.003179 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-cb208822-da10-4a0e-9a83-96f30cc6abdd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:51.030190 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-cb208822-da10-4a0e-9a83-96f30cc6abdd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:51.038754 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-cb208822-da10-4a0e-9a83-96f30cc6abdd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:51.057771 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-cb208822-da10-4a0e-9a83-96f30cc6abdd tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1447 microversion: 2.75 time: 0.209718 Oct 12 13:22:51.059457 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 200/374] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:50 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1447 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:51.596225 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-22320d38-a1a7-415c-adcb-51fd59ef3f2d tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:51.596922 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-22320d38-a1a7-415c-adcb-51fd59ef3f2d tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:51.614379 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22320d38-a1a7-415c-adcb-51fd59ef3f2d tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:51.614379 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22320d38-a1a7-415c-adcb-51fd59ef3f2d tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:51.614379 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22320d38-a1a7-415c-adcb-51fd59ef3f2d tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:51.614379 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22320d38-a1a7-415c-adcb-51fd59ef3f2d tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:51.615406 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22320d38-a1a7-415c-adcb-51fd59ef3f2d tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:51.615406 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22320d38-a1a7-415c-adcb-51fd59ef3f2d tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:52.087605 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-785ee6c3-dbb5-4159-b532-865695040f88 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:52.088216 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-785ee6c3-dbb5-4159-b532-865695040f88 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:52.102546 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-785ee6c3-dbb5-4159-b532-865695040f88 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:52.104787 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-785ee6c3-dbb5-4159-b532-865695040f88 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:52.121948 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-785ee6c3-dbb5-4159-b532-865695040f88 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:52.121948 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-785ee6c3-dbb5-4159-b532-865695040f88 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:52.121948 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-785ee6c3-dbb5-4159-b532-865695040f88 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:52.121948 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-785ee6c3-dbb5-4159-b532-865695040f88 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:52.360983 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-785ee6c3-dbb5-4159-b532-865695040f88 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:52.381544 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-785ee6c3-dbb5-4159-b532-865695040f88 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:52.383223 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-785ee6c3-dbb5-4159-b532-865695040f88 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:52.405872 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-785ee6c3-dbb5-4159-b532-865695040f88 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1447 microversion: 2.75 time: 0.321875 Oct 12 13:22:52.410118 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 201/375] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:52 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1447 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:22:52.723719 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-22320d38-a1a7-415c-adcb-51fd59ef3f2d tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f" status: 200 len: 1614 microversion: 2.1 time: 1.811665 Oct 12 13:22:52.724381 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 175/376] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:50 2022] GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f => generated 1614 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:22:52.748997 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-53518736-6c2f-4014-80ed-5f4aa9d1c523 tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:52.749893 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-53518736-6c2f-4014-80ed-5f4aa9d1c523 tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:52.766593 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-53518736-6c2f-4014-80ed-5f4aa9d1c523 tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:52.768749 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-53518736-6c2f-4014-80ed-5f4aa9d1c523 tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:52.770032 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-53518736-6c2f-4014-80ed-5f4aa9d1c523 tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:52.771048 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-53518736-6c2f-4014-80ed-5f4aa9d1c523 tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:52.771729 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-53518736-6c2f-4014-80ed-5f4aa9d1c523 tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:52.772413 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-53518736-6c2f-4014-80ed-5f4aa9d1c523 tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:52.802990 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c1f0382f-6ec7-423d-9396-769833996187 tempest-SecurityGroupsTestAdminJSON-813442694 tempest-SecurityGroupsTestAdminJSON-813442694-project] Action: 'create', calling method: .version_select at 0x7f8aa034cf70>, body: {"security_group": {"name": "tempest-securitygroup-1520510935", "description": "tempest-description-890797947"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:52.999505 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-53518736-6c2f-4014-80ed-5f4aa9d1c523 tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3c9863b9-a87a-40f5-bb92-39fb31d48d72) Oct 12 13:22:52.999505 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:52.999505 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:52.999505 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:52.999505 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:52.999505 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:52.999505 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 12 13:22:52.999505 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 12 13:22:52.999505 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 12 13:22:52.999505 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 12 13:22:52.999505 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 12 13:22:52.999505 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 12 13:22:52.999505 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:22:52.999505 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:22:53.000644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:22:53.000644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:22:53.000644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:22:53.000644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:22:53.000644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:53.000644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:53.000644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:22:53.000644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:22:53.000644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:53.000644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:53.000644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:22:53.000644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:22:53.000644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:53.000644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:53.000644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:22:53.000644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:22:53.000644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:53.000644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:53.001672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:22:53.001672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:22:53.001672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:22:53.001672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:22:53.001672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:22:53.001672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:22:53.001672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:22:53.001672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:22:53.001672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:22:53.001672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:22:53.001672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:22:53.001672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:22:53.001672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:22:53.001672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:22:53.001672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:22:53.001672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:22:53.002527 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:22:53.002527 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:22:53.002527 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:22:53.002527 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:22:53.002527 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:22:53.002527 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:22:53.002527 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:22:53.002527 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:22:53.002527 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:22:53.002527 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:22:53.002527 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3c9863b9-a87a-40f5-bb92-39fb31d48d72) Oct 12 13:22:53.002527 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:53.002527 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-53518736-6c2f-4014-80ed-5f4aa9d1c523 tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:22:53.002527 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:22:53.010747 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-53518736-6c2f-4014-80ed-5f4aa9d1c523 tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Request method failure captured: Oct 12 13:22:53.010747 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f/action HTTP/1.1 Oct 12 13:22:53.010747 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:22:53.010747 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:22:53.010747 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:22:53.010747 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 15 Oct 12 13:22:53.010747 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:22:53.010747 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:22:53.010747 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:22:53.010747 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:22:53.010747 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr-X9s6OnMePnTkPdpdpXuH5wy46cOe9GRya0mAbV1EHPGS4giy7zHykGQ0hAqQmeHuyseLok3sv3L76_swYqSY77owooCQIk27k4UBy44jI7NX2E5DeEN5U3Ww6datBEcPl214U-rUvk_4jvgQkZsvQQqrDmZmuru2fHkEUj2Bi2LQ Oct 12 13:22:53.010747 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:22:53.010747 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:22:53.010747 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:22:53.010747 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:22:53.010747 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:22:53.010747 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:22:53.010747 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: a597640040eb4f28afccca47c7c4e4be Oct 12 13:22:53.010747 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-MigrationsAdminTest-1144872436 Oct 12 13:22:53.010747 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,admin,reader Oct 12 13:22:53.010747 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,admin,reader Oct 12 13:22:53.012003 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a597640040eb4f28afccca47c7c4e4be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a597640040eb4f28afccca47c7c4e4be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a597640040eb4f28afccca47c7c4e4be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a597640040eb4f28afccca47c7c4e4be"}]}] Oct 12 13:22:53.012003 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-MigrationsAdminTest-1144872436 Oct 12 13:22:53.012003 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: a597640040eb4f28afccca47c7c4e4be Oct 12 13:22:53.012003 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-MigrationsAdminTest-1144872436 Oct 12 13:22:53.012003 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-MigrationsAdminTest-1144872436-project-admin Oct 12 13:22:53.012003 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:22:53.012003 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:22:53.012003 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 24b53bc4b5a24e57918a421065edd233 Oct 12 13:22:53.012003 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-MigrationsAdminTest-1144872436-project-admin Oct 12 13:22:53.012003 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:22:53.012003 n-d-861076-2 devstack@n-api.service[120932]: {"migrate": {}} Oct 12 13:22:53.012003 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:22:53.012003 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:22:53.012796 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:22:53.012796 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '085c7252-d302-4b81-a7f1-15311733615f', 'body': {'migrate': {}}} Oct 12 13:22:53.012796 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:22:53.012796 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:53.012796 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:22:53.012796 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:22:53.012796 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:22:53.012796 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:22:53.012796 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 12 13:22:53.012796 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 12 13:22:53.012796 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 12 13:22:53.012796 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 12 13:22:53.012796 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 12 13:22:53.012796 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 12 13:22:53.012796 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:22:53.012796 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:22:53.012796 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:22:53.012796 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:22:53.012796 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:22:53.015041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:22:53.015041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:53.015041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:53.015041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:22:53.015041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:22:53.015041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:53.015041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:53.015041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:22:53.015041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:22:53.015041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:53.015041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:53.015041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:22:53.015041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:22:53.015041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:22:53.015041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:22:53.015041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:22:53.015041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:22:53.015041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:22:53.016025 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:22:53.016025 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:22:53.016025 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:22:53.016025 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:22:53.016025 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:22:53.016025 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:22:53.016025 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:22:53.016025 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:22:53.016025 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:22:53.016025 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:22:53.016025 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:22:53.016025 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:22:53.016025 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:22:53.016025 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:22:53.016025 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:22:53.016025 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:22:53.016025 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:22:53.017073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:22:53.017073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:22:53.017073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:22:53.017073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:22:53.017073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:22:53.017073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:22:53.017073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3c9863b9-a87a-40f5-bb92-39fb31d48d72) Oct 12 13:22:53.017073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:53.017073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:53.017073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:53.017073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:53.017073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:53.017073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:53.017073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:22:53.017073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:22:53.017073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:22:53.017073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:22:53.019389 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:22:53.019389 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:53.019389 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:53.019389 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:22:53.019389 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:53.019389 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:22:53.019389 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:22:53.019389 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:22:53.019389 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:22:53.019389 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:22:53.019389 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:22:53.019389 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:53.019389 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:22:53.019389 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-53518736-6c2f-4014-80ed-5f4aa9d1c523 tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:22:53.019389 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:22:53.021668 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-53518736-6c2f-4014-80ed-5f4aa9d1c523 tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f/action" status: 500 len: 214 microversion: 2.1 time: 0.272657 Oct 12 13:22:53.025144 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 176/377] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:22:52 2022] POST /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f/action => generated 214 bytes in 281 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:22:53.032057 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6a613e73-b8a3-4ea3-a330-585bda5b229d tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Calling method '.version_select at 0x7f8aa0085940>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:53.038320 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6a613e73-b8a3-4ea3-a330-585bda5b229d tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:53.039086 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6a613e73-b8a3-4ea3-a330-585bda5b229d tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:53.039776 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6a613e73-b8a3-4ea3-a330-585bda5b229d tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:53.061573 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6a613e73-b8a3-4ea3-a330-585bda5b229d tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 18 microversion: 2.1 time: 0.034763 Oct 12 13:22:53.075685 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 177/378] 10.222.0.52 () {58 vars in 1143 bytes} [Wed Oct 12 13:22:53 2022] GET /compute/v2.1/os-migrations => generated 18 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:22:53.348591 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-539ae92c-6b3e-4044-8e87-80e25386f578 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-443780028", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:53.487430 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-539ae92c-6b3e-4044-8e87-80e25386f578 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] validate_networks() for None {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:22:54.020561 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-539ae92c-6b3e-4044-8e87-80e25386f578 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:22:54.021125 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-539ae92c-6b3e-4044-8e87-80e25386f578 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:22:54.021486 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-539ae92c-6b3e-4044-8e87-80e25386f578 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:22:54.021890 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-539ae92c-6b3e-4044-8e87-80e25386f578 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:22:54.022318 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-539ae92c-6b3e-4044-8e87-80e25386f578 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:22:54.046187 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-539ae92c-6b3e-4044-8e87-80e25386f578 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:54.046687 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-539ae92c-6b3e-4044-8e87-80e25386f578 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:54.047133 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-539ae92c-6b3e-4044-8e87-80e25386f578 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:54.047905 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-539ae92c-6b3e-4044-8e87-80e25386f578 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:54.048364 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-539ae92c-6b3e-4044-8e87-80e25386f578 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:54.049546 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-539ae92c-6b3e-4044-8e87-80e25386f578 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:54.066941 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c1f0382f-6ec7-423d-9396-769833996187 tempest-SecurityGroupsTestAdminJSON-813442694 tempest-SecurityGroupsTestAdminJSON-813442694-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.633538 Oct 12 13:22:54.066941 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 202/379] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:22:52 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:54.071806 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2c41d7b9-3e74-43cf-b4a8-b8ecd89ff234 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:54.072420 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-2c41d7b9-3e74-43cf-b4a8-b8ecd89ff234 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:54.083610 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2c41d7b9-3e74-43cf-b4a8-b8ecd89ff234 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:54.084732 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2c41d7b9-3e74-43cf-b4a8-b8ecd89ff234 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:54.085441 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2c41d7b9-3e74-43cf-b4a8-b8ecd89ff234 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:54.086655 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2c41d7b9-3e74-43cf-b4a8-b8ecd89ff234 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:54.087131 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2c41d7b9-3e74-43cf-b4a8-b8ecd89ff234 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:54.087555 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2c41d7b9-3e74-43cf-b4a8-b8ecd89ff234 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:54.091035 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-539ae92c-6b3e-4044-8e87-80e25386f578 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Getting quotas for project b92cdc745c654b538146a4a64f5f4b6f. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:22:54.098422 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-539ae92c-6b3e-4044-8e87-80e25386f578 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Getting quotas for user 0df255f194e54dfb8781b982c2c60a98 and project b92cdc745c654b538146a4a64f5f4b6f. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:22:54.121701 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-539ae92c-6b3e-4044-8e87-80e25386f578 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:22:54.125621 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-539ae92c-6b3e-4044-8e87-80e25386f578 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 177cff06-72ce-423d-bbe7-9ebcd331d29d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:22:54.185042 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-2c41d7b9-3e74-43cf-b4a8-b8ecd89ff234 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:54.197276 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-2c41d7b9-3e74-43cf-b4a8-b8ecd89ff234 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:54.200305 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-2c41d7b9-3e74-43cf-b4a8-b8ecd89ff234 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:54.221324 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2c41d7b9-3e74-43cf-b4a8-b8ecd89ff234 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1447 microversion: 2.75 time: 0.154633 Oct 12 13:22:54.240994 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 203/380] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:54 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1447 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:54.254123 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e1096f22-680d-456c-ba2e-83e90ee95ff0 tempest-SecurityGroupsTestAdminJSON-813442694 tempest-SecurityGroupsTestAdminJSON-813442694-project] Action: 'create', calling method: .version_select at 0x7f8aa0321040>, body: {"security_group": {"name": "tempest-securitygroup-1779452446", "description": "tempest-description-869195738"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:54.379287 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-539ae92c-6b3e-4044-8e87-80e25386f578 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.035788 Oct 12 13:22:54.380585 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 178/381] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:22:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 13:22:54.393022 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5633c7a7-5e5a-474c-856d-c45eb279718f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:54.396711 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5633c7a7-5e5a-474c-856d-c45eb279718f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 177cff06-72ce-423d-bbe7-9ebcd331d29d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:54.608886 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-5633c7a7-5e5a-474c-856d-c45eb279718f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:54.629569 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5633c7a7-5e5a-474c-856d-c45eb279718f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d" status: 200 len: 1212 microversion: 2.1 time: 0.234406 Oct 12 13:22:54.629569 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 179/382] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:54 2022] GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d => generated 1212 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:22:54.861428 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e1096f22-680d-456c-ba2e-83e90ee95ff0 tempest-SecurityGroupsTestAdminJSON-813442694 tempest-SecurityGroupsTestAdminJSON-813442694-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.619085 Oct 12 13:22:54.882026 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 204/383] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:22:54 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:55.196415 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8b2c6ee6-0dc6-469d-8ade-9af3e590badd tempest-SecurityGroupsTestAdminJSON-1322968516 tempest-SecurityGroupsTestAdminJSON-1322968516-project-admin] Action: 'create', calling method: .version_select at 0x7f8aa0091940>, body: {"security_group": {"name": "tempest-securitygroup-1435846262", "description": "tempest-description-420126251"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:55.254076 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-da64e019-8e22-4739-94cb-12f071b23655 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:55.254683 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-da64e019-8e22-4739-94cb-12f071b23655 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:55.285670 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da64e019-8e22-4739-94cb-12f071b23655 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:55.287125 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da64e019-8e22-4739-94cb-12f071b23655 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:55.288275 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da64e019-8e22-4739-94cb-12f071b23655 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:55.289629 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da64e019-8e22-4739-94cb-12f071b23655 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:55.291046 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da64e019-8e22-4739-94cb-12f071b23655 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:55.292881 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da64e019-8e22-4739-94cb-12f071b23655 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:55.523249 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-da64e019-8e22-4739-94cb-12f071b23655 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:55.541425 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-da64e019-8e22-4739-94cb-12f071b23655 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:55.543456 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-da64e019-8e22-4739-94cb-12f071b23655 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:55.558892 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-da64e019-8e22-4739-94cb-12f071b23655 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1447 microversion: 2.75 time: 0.308820 Oct 12 13:22:55.576565 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 205/384] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:55 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1447 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:55.648972 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6ccf68a9-315f-4539-a4ba-a8445400f110 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:55.649907 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-6ccf68a9-315f-4539-a4ba-a8445400f110 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 177cff06-72ce-423d-bbe7-9ebcd331d29d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:55.993375 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-6ccf68a9-315f-4539-a4ba-a8445400f110 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:56.004732 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6ccf68a9-315f-4539-a4ba-a8445400f110 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d" status: 200 len: 1212 microversion: 2.1 time: 0.360877 Oct 12 13:22:56.007475 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 206/385] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:55 2022] GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d => generated 1212 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:22:56.400856 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8b2c6ee6-0dc6-469d-8ade-9af3e590badd tempest-SecurityGroupsTestAdminJSON-1322968516 tempest-SecurityGroupsTestAdminJSON-1322968516-project-admin] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.526135 Oct 12 13:22:56.401369 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 180/386] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:22:54 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:22:56.417113 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2a8952ad-3712-4fdb-9ce1-16577d81ee7d tempest-SecurityGroupsTestAdminJSON-1322968516 tempest-SecurityGroupsTestAdminJSON-1322968516-project-admin] Action: 'create', calling method: .version_select at 0x7f8aa03b50d0>, body: {"security_group": {"name": "tempest-securitygroup-1467542367", "description": "tempest-description-627701733"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:22:56.599315 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8d53340b-403a-479c-8a43-1c335e9dce2a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:56.600034 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8d53340b-403a-479c-8a43-1c335e9dce2a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:56.612207 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8d53340b-403a-479c-8a43-1c335e9dce2a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:56.670738 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8d53340b-403a-479c-8a43-1c335e9dce2a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.058s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:56.673927 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8d53340b-403a-479c-8a43-1c335e9dce2a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:56.677186 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8d53340b-403a-479c-8a43-1c335e9dce2a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:56.681398 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8d53340b-403a-479c-8a43-1c335e9dce2a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:56.690139 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8d53340b-403a-479c-8a43-1c335e9dce2a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:57.185161 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8d53340b-403a-479c-8a43-1c335e9dce2a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:57.205961 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8d53340b-403a-479c-8a43-1c335e9dce2a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:57.207827 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8d53340b-403a-479c-8a43-1c335e9dce2a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:57.217198 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8d53340b-403a-479c-8a43-1c335e9dce2a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1453 microversion: 2.75 time: 0.628199 Oct 12 13:22:57.240637 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 181/387] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:56 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1453 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:22:57.253100 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f4b31e85-0198-45e6-86bb-64a16c9a0d67 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:57.253994 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f4b31e85-0198-45e6-86bb-64a16c9a0d67 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 177cff06-72ce-423d-bbe7-9ebcd331d29d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:57.263646 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4b31e85-0198-45e6-86bb-64a16c9a0d67 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:57.270775 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4b31e85-0198-45e6-86bb-64a16c9a0d67 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:57.270775 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4b31e85-0198-45e6-86bb-64a16c9a0d67 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:57.271428 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4b31e85-0198-45e6-86bb-64a16c9a0d67 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:57.272099 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4b31e85-0198-45e6-86bb-64a16c9a0d67 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:57.274001 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4b31e85-0198-45e6-86bb-64a16c9a0d67 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:57.311212 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2a8952ad-3712-4fdb-9ce1-16577d81ee7d tempest-SecurityGroupsTestAdminJSON-1322968516 tempest-SecurityGroupsTestAdminJSON-1322968516-project-admin] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.900360 Oct 12 13:22:57.325870 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 207/388] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:22:56 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:22:57.328114 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5881813e-4135-41ed-9a82-c2391a5b2dfe tempest-SecurityGroupsTestAdminJSON-1322968516 tempest-SecurityGroupsTestAdminJSON-1322968516-project-admin] Calling method '.version_select at 0x7f8aa03f3e50>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:57.995925 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f4b31e85-0198-45e6-86bb-64a16c9a0d67 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:58.022892 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f4b31e85-0198-45e6-86bb-64a16c9a0d67 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d" status: 200 len: 1208 microversion: 2.1 time: 0.780345 Oct 12 13:22:58.024969 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 182/389] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:57 2022] GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d => generated 1208 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:22:58.258961 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-85b03eeb-007e-459e-8223-167099092914 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:58.259585 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-85b03eeb-007e-459e-8223-167099092914 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:58.287251 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-85b03eeb-007e-459e-8223-167099092914 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:58.287976 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-85b03eeb-007e-459e-8223-167099092914 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:58.292798 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-85b03eeb-007e-459e-8223-167099092914 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:58.293906 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-85b03eeb-007e-459e-8223-167099092914 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:58.294537 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-85b03eeb-007e-459e-8223-167099092914 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:58.295110 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-85b03eeb-007e-459e-8223-167099092914 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:58.513255 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-85b03eeb-007e-459e-8223-167099092914 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:58.521132 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-85b03eeb-007e-459e-8223-167099092914 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:58.525804 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-85b03eeb-007e-459e-8223-167099092914 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:58.544488 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-85b03eeb-007e-459e-8223-167099092914 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1453 microversion: 2.75 time: 0.290601 Oct 12 13:22:58.549681 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 183/390] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:22:58 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1453 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:22:59.080844 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-24a7bc33-69a5-4176-b747-ba4f58d68c37 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:22:59.088014 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-24a7bc33-69a5-4176-b747-ba4f58d68c37 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 177cff06-72ce-423d-bbe7-9ebcd331d29d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:22:59.138628 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-24a7bc33-69a5-4176-b747-ba4f58d68c37 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:59.139134 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-24a7bc33-69a5-4176-b747-ba4f58d68c37 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:59.160441 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-24a7bc33-69a5-4176-b747-ba4f58d68c37 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:59.163589 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-24a7bc33-69a5-4176-b747-ba4f58d68c37 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:22:59.164273 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-24a7bc33-69a5-4176-b747-ba4f58d68c37 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:22:59.178002 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-24a7bc33-69a5-4176-b747-ba4f58d68c37 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:22:59.552293 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-24a7bc33-69a5-4176-b747-ba4f58d68c37 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:22:59.573081 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-24a7bc33-69a5-4176-b747-ba4f58d68c37 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d" status: 200 len: 1282 microversion: 2.1 time: 0.521632 Oct 12 13:22:59.578344 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 184/391] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:22:59 2022] GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d => generated 1282 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:00.188084 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b8784dc7-8e18-46ce-81d2-39ab96bc3430 tempest-QuotaClassesAdminTestJSON-1281241214 tempest-QuotaClassesAdminTestJSON-1281241214-project-admin] Calling method '.version_select at 0x7f8aa008e940>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:00.205188 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b8784dc7-8e18-46ce-81d2-39ab96bc3430 tempest-QuotaClassesAdminTestJSON-1281241214 tempest-QuotaClassesAdminTestJSON-1281241214-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.624582 Oct 12 13:23:00.206003 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 185/392] 10.222.0.52 () {58 vars in 1185 bytes} [Wed Oct 12 13:22:59 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:00.212032 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d0a05c65-1db6-4723-923a-ab45dde6fd8c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:00.214686 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d0a05c65-1db6-4723-923a-ab45dde6fd8c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:00.221133 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0a05c65-1db6-4723-923a-ab45dde6fd8c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:00.222688 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0a05c65-1db6-4723-923a-ab45dde6fd8c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:00.223412 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0a05c65-1db6-4723-923a-ab45dde6fd8c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:00.224438 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0a05c65-1db6-4723-923a-ab45dde6fd8c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:00.225329 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0a05c65-1db6-4723-923a-ab45dde6fd8c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:00.226489 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0a05c65-1db6-4723-923a-ab45dde6fd8c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:00.352848 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d0a05c65-1db6-4723-923a-ab45dde6fd8c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:00.365972 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d0a05c65-1db6-4723-923a-ab45dde6fd8c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:00.367509 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d0a05c65-1db6-4723-923a-ab45dde6fd8c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:00.375699 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d0a05c65-1db6-4723-923a-ab45dde6fd8c tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1453 microversion: 2.75 time: 0.168431 Oct 12 13:23:00.376279 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 186/393] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:00 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:00.380856 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ddca1d3e-2a3b-4f87-be95-d4d29c6960d0 tempest-QuotaClassesAdminTestJSON-1281241214 tempest-QuotaClassesAdminTestJSON-1281241214-project-admin] Action: 'update', calling method: .version_select at 0x7f8a9bfd7310>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:02.345789 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ddca1d3e-2a3b-4f87-be95-d4d29c6960d0 tempest-QuotaClassesAdminTestJSON-1281241214 tempest-QuotaClassesAdminTestJSON-1281241214-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.965428 Oct 12 13:23:02.358092 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 187/394] 10.222.0.52 () {60 vars in 1206 bytes} [Wed Oct 12 13:23:00 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:02.390138 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-040aba29-fa5f-4529-88d3-877200ba7b2f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:02.393683 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-040aba29-fa5f-4529-88d3-877200ba7b2f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 177cff06-72ce-423d-bbe7-9ebcd331d29d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:02.418416 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-040aba29-fa5f-4529-88d3-877200ba7b2f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:02.420376 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-040aba29-fa5f-4529-88d3-877200ba7b2f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:02.421017 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-040aba29-fa5f-4529-88d3-877200ba7b2f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:02.422141 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-040aba29-fa5f-4529-88d3-877200ba7b2f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:02.422747 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-040aba29-fa5f-4529-88d3-877200ba7b2f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:02.423311 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-040aba29-fa5f-4529-88d3-877200ba7b2f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:02.851099 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-040aba29-fa5f-4529-88d3-877200ba7b2f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:02.878102 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-040aba29-fa5f-4529-88d3-877200ba7b2f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d" status: 200 len: 1312 microversion: 2.1 time: 0.502281 Oct 12 13:23:02.879744 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 188/395] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:02 2022] GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d => generated 1312 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:03.154766 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c8c01396-1943-43c2-994a-07accff056c7 tempest-ServersWithSpecificFlavorTestJSON-697882130 tempest-ServersWithSpecificFlavorTestJSON-697882130-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:03.185246 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c8c01396-1943-43c2-994a-07accff056c7 tempest-ServersWithSpecificFlavorTestJSON-697882130 tempest-ServersWithSpecificFlavorTestJSON-697882130-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.293598 Oct 12 13:23:03.186257 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 189/396] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:23:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:03.190045 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=10,nova_api:UPDATE=12 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:03.203914 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-aaf6af5a-6841-4ead-afc6-2d097e06cbcb tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:03.206555 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-aaf6af5a-6841-4ead-afc6-2d097e06cbcb tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:03.223956 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aaf6af5a-6841-4ead-afc6-2d097e06cbcb tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:03.224721 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aaf6af5a-6841-4ead-afc6-2d097e06cbcb tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:03.228427 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aaf6af5a-6841-4ead-afc6-2d097e06cbcb tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:03.240016 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aaf6af5a-6841-4ead-afc6-2d097e06cbcb tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:03.240016 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aaf6af5a-6841-4ead-afc6-2d097e06cbcb tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:03.240016 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aaf6af5a-6841-4ead-afc6-2d097e06cbcb tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:03.451258 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-aaf6af5a-6841-4ead-afc6-2d097e06cbcb tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:03.464695 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-aaf6af5a-6841-4ead-afc6-2d097e06cbcb tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:03.466216 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-aaf6af5a-6841-4ead-afc6-2d097e06cbcb tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:03.481026 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-aaf6af5a-6841-4ead-afc6-2d097e06cbcb tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1438 microversion: 2.75 time: 0.291713 Oct 12 13:23:03.485033 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 190/397] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:03 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1438 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:03.489773 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1360f48e-4933-49e2-ac83-90c18efc7532 tempest-QuotaClassesAdminTestJSON-1281241214 tempest-QuotaClassesAdminTestJSON-1281241214-project-admin] Calling method '.version_select at 0x7f8a9bff10d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:03.517923 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1360f48e-4933-49e2-ac83-90c18efc7532 tempest-QuotaClassesAdminTestJSON-1281241214 tempest-QuotaClassesAdminTestJSON-1281241214-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.031571 Oct 12 13:23:03.521271 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 191/398] 10.222.0.52 () {58 vars in 1185 bytes} [Wed Oct 12 13:23:03 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:03.627459 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-63575479-9968-49de-9275-caed3196bd53 tempest-ServersWithSpecificFlavorTestJSON-1027282137 tempest-ServersWithSpecificFlavorTestJSON-1027282137-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-2024906694", "id": 1633196281, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:03.738620 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-63575479-9968-49de-9275-caed3196bd53 tempest-ServersWithSpecificFlavorTestJSON-1027282137 tempest-ServersWithSpecificFlavorTestJSON-1027282137-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.213683 Oct 12 13:23:03.739459 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 192/399] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:23:03 2022] POST /compute/v2.1/flavors => generated 425 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:03.744997 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-1fc013c2-8515-4683-a314-a6a3d554ae72 req-d8cc5a60-c8ec-4d33-9f9a-e51cc870f474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "177cff06-72ce-423d-bbe7-9ebcd331d29d", "tag": "6849491b-9544-4029-90ad-8fe791181f39"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:03.755752 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-1fc013c2-8515-4683-a314-a6a3d554ae72 req-d8cc5a60-c8ec-4d33-9f9a-e51cc870f474 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:03.756518 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-1fc013c2-8515-4683-a314-a6a3d554ae72 req-d8cc5a60-c8ec-4d33-9f9a-e51cc870f474 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:03.757146 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-1fc013c2-8515-4683-a314-a6a3d554ae72 req-d8cc5a60-c8ec-4d33-9f9a-e51cc870f474 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:03.770351 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-1fc013c2-8515-4683-a314-a6a3d554ae72 req-d8cc5a60-c8ec-4d33-9f9a-e51cc870f474 service nova] Creating event network-changed:6849491b-9544-4029-90ad-8fe791181f39 for instance 177cff06-72ce-423d-bbe7-9ebcd331d29d on n-h1-861076-2 Oct 12 13:23:03.776891 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-1fc013c2-8515-4683-a314-a6a3d554ae72 req-d8cc5a60-c8ec-4d33-9f9a-e51cc870f474 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035688 Oct 12 13:23:03.778271 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 193/400] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:03.791284 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5881813e-4135-41ed-9a82-c2391a5b2dfe tempest-SecurityGroupsTestAdminJSON-1322968516 tempest-SecurityGroupsTestAdminJSON-1322968516-project-admin] 10.222.0.52 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10367 microversion: 2.1 time: 6.467575 Oct 12 13:23:03.805771 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 208/401] 10.222.0.52 () {58 vars in 1191 bytes} [Wed Oct 12 13:22:57 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10367 bytes in 6482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:23:03.811561 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b35bd0b1-0fbb-4dc5-afb5-6f5851102d96 tempest-QuotaClassesAdminTestJSON-1281241214 tempest-QuotaClassesAdminTestJSON-1281241214-project-admin] Action: 'update', calling method: .version_select at 0x7f8aa03f35e0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:03.830423 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:03.944827 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f829237b-f5bf-41f2-9fe4-66c3e7724960 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:03.948989 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f829237b-f5bf-41f2-9fe4-66c3e7724960 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:03.957740 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f829237b-f5bf-41f2-9fe4-66c3e7724960 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:03.958907 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f829237b-f5bf-41f2-9fe4-66c3e7724960 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:03.959570 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f829237b-f5bf-41f2-9fe4-66c3e7724960 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:03.960482 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f829237b-f5bf-41f2-9fe4-66c3e7724960 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:03.961621 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f829237b-f5bf-41f2-9fe4-66c3e7724960 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:03.962261 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f829237b-f5bf-41f2-9fe4-66c3e7724960 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:04.058462 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:04.129574 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-f829237b-f5bf-41f2-9fe4-66c3e7724960 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:23:04.130008 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-f829237b-f5bf-41f2-9fe4-66c3e7724960 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:23:04.137297 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-f829237b-f5bf-41f2-9fe4-66c3e7724960 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:23:04.137297 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-f829237b-f5bf-41f2-9fe4-66c3e7724960 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:23:04.138277 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-f829237b-f5bf-41f2-9fe4-66c3e7724960 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:23:04.443208 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f829237b-f5bf-41f2-9fe4-66c3e7724960 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:04.452964 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f829237b-f5bf-41f2-9fe4-66c3e7724960 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:04.454509 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f829237b-f5bf-41f2-9fe4-66c3e7724960 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:04.455732 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f829237b-f5bf-41f2-9fe4-66c3e7724960 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:04.456842 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f829237b-f5bf-41f2-9fe4-66c3e7724960 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:04.457590 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f829237b-f5bf-41f2-9fe4-66c3e7724960 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:04.458521 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f829237b-f5bf-41f2-9fe4-66c3e7724960 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:04.649528 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-f829237b-f5bf-41f2-9fe4-66c3e7724960 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lazy-loading 'services' on Instance uuid d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:04.732116 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:04.747930 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f829237b-f5bf-41f2-9fe4-66c3e7724960 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0/action" status: 202 len: 1942 microversion: 2.75 time: 0.963354 Oct 12 13:23:04.756922 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 194/402] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Oct 12 13:23:03 2022] POST /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0/action => generated 1942 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 12 13:23:04.768227 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d573eab6-17cd-49d3-a7bf-923d34cdfc26 tempest-ServersWithSpecificFlavorTestJSON-1027282137 tempest-ServersWithSpecificFlavorTestJSON-1027282137-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:04.777980 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d573eab6-17cd-49d3-a7bf-923d34cdfc26 tempest-ServersWithSpecificFlavorTestJSON-1027282137 tempest-ServersWithSpecificFlavorTestJSON-1027282137-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019838 Oct 12 13:23:04.778576 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 195/403] 10.222.0.52 () {58 vars in 1182 bytes} [Wed Oct 12 13:23:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:23:04.783731 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c4ebd663-88e0-404e-802a-0b6c61a93110 tempest-SecurityGroupsTestAdminJSON-813442694 tempest-SecurityGroupsTestAdminJSON-813442694-project] Calling method '.version_select at 0x7f8a9bff1af0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:04.826077 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=37 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:04.840651 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b35bd0b1-0fbb-4dc5-afb5-6f5851102d96 tempest-QuotaClassesAdminTestJSON-1281241214 tempest-QuotaClassesAdminTestJSON-1281241214-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.028405 Oct 12 13:23:04.841953 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 209/404] 10.222.0.52 () {60 vars in 1206 bytes} [Wed Oct 12 13:23:03 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:04.846865 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fdca8509-f0b5-416e-a386-996318ecfbfd tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:04.851455 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-fdca8509-f0b5-416e-a386-996318ecfbfd tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 177cff06-72ce-423d-bbe7-9ebcd331d29d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:04.873022 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fdca8509-f0b5-416e-a386-996318ecfbfd tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:04.874025 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fdca8509-f0b5-416e-a386-996318ecfbfd tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:04.875607 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fdca8509-f0b5-416e-a386-996318ecfbfd tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:04.878858 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fdca8509-f0b5-416e-a386-996318ecfbfd tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:04.879514 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fdca8509-f0b5-416e-a386-996318ecfbfd tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:04.880120 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fdca8509-f0b5-416e-a386-996318ecfbfd tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:05.329376 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c4ebd663-88e0-404e-802a-0b6c61a93110 tempest-SecurityGroupsTestAdminJSON-813442694 tempest-SecurityGroupsTestAdminJSON-813442694-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.549571 Oct 12 13:23:05.330288 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 196/405] 10.222.0.52 () {58 vars in 1191 bytes} [Wed Oct 12 13:23:04 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:05.349183 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a5dbb2cc-21d4-469c-b330-46b631d0e8e3 tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1343901315", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f8b19b17-bd23-4f27-bfe1-281ccaba4d85"}], "block_device_mapping_v2": [{"uuid": "14f42b5b-d944-4b9c-8a2e-8bdb5e2bc18f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:05.393658 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-fdca8509-f0b5-416e-a386-996318ecfbfd tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:05.421603 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fdca8509-f0b5-416e-a386-996318ecfbfd tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d" status: 200 len: 1312 microversion: 2.1 time: 0.571927 Oct 12 13:23:05.436623 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 210/406] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:04 2022] GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d => generated 1312 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:05.452738 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9c1ef26d-336a-4f81-83d6-fa11d0af736c tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:05.457538 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-9c1ef26d-336a-4f81-83d6-fa11d0af736c tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:05.475816 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9c1ef26d-336a-4f81-83d6-fa11d0af736c tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:05.477710 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9c1ef26d-336a-4f81-83d6-fa11d0af736c tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:05.479454 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9c1ef26d-336a-4f81-83d6-fa11d0af736c tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:05.480583 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9c1ef26d-336a-4f81-83d6-fa11d0af736c tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:05.481972 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9c1ef26d-336a-4f81-83d6-fa11d0af736c tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:05.483182 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9c1ef26d-336a-4f81-83d6-fa11d0af736c tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:05.534637 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-a5dbb2cc-21d4-469c-b330-46b631d0e8e3 tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] validate_networks() for [('f8b19b17-bd23-4f27-bfe1-281ccaba4d85', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:23:06.071182 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-9c1ef26d-336a-4f81-83d6-fa11d0af736c tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lazy-loading 'services' on Instance uuid d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:06.252034 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9c1ef26d-336a-4f81-83d6-fa11d0af736c tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1929 microversion: 2.75 time: 0.813825 Oct 12 13:23:06.270464 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 211/407] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:05 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1929 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:06.290080 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-872ea44f-071a-42eb-bf1c-28527c808e8f tempest-ServersWithSpecificFlavorTestJSON-1027282137 tempest-ServersWithSpecificFlavorTestJSON-1027282137-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1136709186", "id": 2131911841, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:06.360317 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-a5dbb2cc-21d4-469c-b330-46b631d0e8e3 tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-35ff3f11-97d0-42ed-8257-eff362dcf602) Oct 12 13:23:06.360317 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:06.360317 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:23:06.360317 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:23:06.360317 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:06.360317 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:06.360317 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:06.360317 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:06.360317 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:06.360317 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:06.360317 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:23:06.360317 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:23:06.360317 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:23:06.360317 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:23:06.360317 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:23:06.360317 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:23:06.361472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:23:06.361472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:23:06.361472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:23:06.361472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:23:06.361472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:23:06.361472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:23:06.361472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:23:06.361472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:23:06.361472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:23:06.361472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:23:06.361472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:23:06.361472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:06.361472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:06.361472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:23:06.361472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:23:06.361472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:06.361472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:06.361472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:23:06.362488 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:23:06.362488 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:06.362488 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:06.362488 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:23:06.362488 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:23:06.362488 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:06.362488 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:06.362488 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:23:06.362488 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:23:06.362488 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:23:06.362488 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:23:06.362488 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:23:06.362488 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:23:06.362488 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:23:06.362488 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:23:06.362488 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:23:06.362488 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:23:06.362488 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:23:06.363464 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:23:06.363464 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:23:06.363464 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:23:06.363464 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:23:06.363464 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:23:06.363464 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:23:06.363464 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:23:06.363464 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:23:06.363464 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:23:06.363464 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:23:06.363464 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:23:06.363464 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:23:06.363464 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:23:06.363464 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:23:06.363464 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-35ff3f11-97d0-42ed-8257-eff362dcf602) Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-a5dbb2cc-21d4-469c-b330-46b631d0e8e3 tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a5dbb2cc-21d4-469c-b330-46b631d0e8e3 tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] Request method failure captured: Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 362 Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr94e9Lovd_6wKxNl_JdjNknQjnVEEV0iEB1Wv4X1GnAYah2d6SLZ1cdu5yb_P2VD3YueOK5el--I7xgrTV1Ivko28VuoL8DV3x4iyalWBU8ProRzP7gH_7Rd_edn-YZLsXIHxcHBsLHvinvny9pvZo6yqBaLRm_O6GdA_XZgCu9sR8 Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: X-Openstack-Nova-Api-Version: 2.25 Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: b6be2b28cd33472bbdb04d6db1526921 Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-579442985 Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:23:06.364364 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:23:06.378532 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b6be2b28cd33472bbdb04d6db1526921"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b6be2b28cd33472bbdb04d6db1526921"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b6be2b28cd33472bbdb04d6db1526921"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b6be2b28cd33472bbdb04d6db1526921"}]}] Oct 12 13:23:06.378532 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-579442985 Oct 12 13:23:06.378532 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: b6be2b28cd33472bbdb04d6db1526921 Oct 12 13:23:06.378532 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-579442985 Oct 12 13:23:06.378532 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-LiveAutoBlockMigrationV225Test-579442985-project Oct 12 13:23:06.378532 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:23:06.378532 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:23:06.378532 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: fd24f238584e443cbb549e4799eb5c4f Oct 12 13:23:06.378532 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-579442985-project Oct 12 13:23:06.378532 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:23:06.379107 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1343901315", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f8b19b17-bd23-4f27-bfe1-281ccaba4d85"}], "block_device_mapping_v2": [{"uuid": "14f42b5b-d944-4b9c-8a2e-8bdb5e2bc18f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} Oct 12 13:23:06.379107 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:23:06.379107 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:06.379107 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:23:06.379107 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-LiveAutoBlockMigrationV225Test-server-1343901315', 'imageRef': '', 'flavorRef': '452', 'networks': [{'uuid': 'f8b19b17-bd23-4f27-bfe1-281ccaba4d85'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': '14f42b5b-d944-4b9c-8a2e-8bdb5e2bc18f'}]}}} Oct 12 13:23:06.379107 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:23:06.379107 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:06.379107 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:23:06.379107 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:23:06.379107 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:06.379107 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:06.379107 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:06.379107 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:06.379107 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:06.379107 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:06.379948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:23:06.379948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:23:06.379948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:23:06.379948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:23:06.379948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:23:06.379948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:23:06.379948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:23:06.379948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:23:06.379948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:23:06.379948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:23:06.379948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:23:06.379948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:23:06.379948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:23:06.379948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:23:06.379948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:23:06.379948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:23:06.379948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:23:06.379948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:06.379948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:06.383152 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:23:06.383152 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:23:06.383152 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:06.383152 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:06.383152 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:23:06.383152 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:23:06.383152 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:06.383152 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:06.383152 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:23:06.383152 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:23:06.383152 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:06.383152 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:06.383152 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:23:06.383152 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:23:06.383152 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:23:06.383152 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:23:06.383152 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:23:06.383152 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:23:06.385433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:23:06.385433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:23:06.385433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:23:06.385433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:23:06.385433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:23:06.385433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:23:06.385433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:23:06.385433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:23:06.385433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:23:06.385433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:23:06.385433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:23:06.385433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:23:06.385433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:23:06.385433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:23:06.385433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:23:06.385433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:23:06.387692 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:23:06.387692 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:23:06.387692 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:23:06.387692 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:23:06.387692 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-35ff3f11-97d0-42ed-8257-eff362dcf602) Oct 12 13:23:06.387692 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:06.387692 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:23:06.387692 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:06.387692 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:06.387692 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:23:06.387692 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:23:06.387692 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:23:06.387692 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:23:06.387692 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:23:06.387692 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:23:06.387692 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:06.387692 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:06.387692 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:06.393431 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:23:06.393431 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:06.393431 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:06.393431 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:23:06.393431 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:23:06.393431 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:23:06.393431 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:23:06.393431 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:06.393431 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:06.393431 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:06.393431 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a5dbb2cc-21d4-469c-b330-46b631d0e8e3 tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:06.393431 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:23:06.393431 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a5dbb2cc-21d4-469c-b330-46b631d0e8e3 tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.25 time: 1.033116 Oct 12 13:23:06.394389 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 197/408] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 12 13:23:05 2022] POST /compute/v2.1/servers => generated 214 bytes in 1046 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Oct 12 13:23:06.394389 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c5c4a31a-d5d6-403b-9187-8b5f43374f39 tempest-SecurityGroupsTestAdminJSON-1322968516 tempest-SecurityGroupsTestAdminJSON-1322968516-project-admin] Calling method '.version_select at 0x7f8a9be4d040>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:06.399263 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-872ea44f-071a-42eb-bf1c-28527c808e8f tempest-ServersWithSpecificFlavorTestJSON-1027282137 tempest-ServersWithSpecificFlavorTestJSON-1027282137-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.127216 Oct 12 13:23:06.400121 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 212/409] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:23:06 2022] POST /compute/v2.1/flavors => generated 425 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:06.755317 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3934c4a4-4dec-428a-8a0d-715b0ed359a9 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Calling method '.version_select at 0x7f8aa0321280>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:06.825389 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c5c4a31a-d5d6-403b-9187-8b5f43374f39 tempest-SecurityGroupsTestAdminJSON-1322968516 tempest-SecurityGroupsTestAdminJSON-1322968516-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/0be3c709-30dd-4d33-9037-350d867bcdf4" status: 202 len: 0 microversion: 2.1 time: 0.445908 Oct 12 13:23:06.828596 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 198/410] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:23:06 2022] DELETE /compute/v2.1/os-security-groups/0be3c709-30dd-4d33-9037-350d867bcdf4 => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:23:06.836539 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f18eff64-75e7-464a-9ee1-e891861a3ab3 tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] Calling method '.version_select at 0x7f8aa01faaf0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:06.840861 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3934c4a4-4dec-428a-8a0d-715b0ed359a9 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/0ae4e8293b9a4380892cf59572cf7a67" status: 200 len: 371 microversion: 2.1 time: 0.439647 Oct 12 13:23:06.841547 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 213/411] 10.222.0.52 () {58 vars in 1242 bytes} [Wed Oct 12 13:23:06 2022] GET /compute/v2.1/os-quota-sets/0ae4e8293b9a4380892cf59572cf7a67 => generated 371 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:06.847151 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c7425a8e-2ae9-4467-932b-04a5de72b4d7 tempest-ServersWithSpecificFlavorTestJSON-1027282137 tempest-ServersWithSpecificFlavorTestJSON-1027282137-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:06.858094 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c7425a8e-2ae9-4467-932b-04a5de72b4d7 tempest-ServersWithSpecificFlavorTestJSON-1027282137 tempest-ServersWithSpecificFlavorTestJSON-1027282137-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015229 Oct 12 13:23:06.867819 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 214/412] 10.222.0.52 () {58 vars in 1182 bytes} [Wed Oct 12 13:23:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:23:06.867819 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-924b8a90-48a7-4473-8e22-0302c07a3ce8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:06.867819 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-924b8a90-48a7-4473-8e22-0302c07a3ce8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 177cff06-72ce-423d-bbe7-9ebcd331d29d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:06.875578 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-924b8a90-48a7-4473-8e22-0302c07a3ce8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:06.876354 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-924b8a90-48a7-4473-8e22-0302c07a3ce8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:06.879009 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-924b8a90-48a7-4473-8e22-0302c07a3ce8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:06.879009 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-924b8a90-48a7-4473-8e22-0302c07a3ce8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:06.879009 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-924b8a90-48a7-4473-8e22-0302c07a3ce8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:06.879009 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-924b8a90-48a7-4473-8e22-0302c07a3ce8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:06.934853 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f18eff64-75e7-464a-9ee1-e891861a3ab3 tempest-LiveAutoBlockMigrationV225Test-579442985 tempest-LiveAutoBlockMigrationV225Test-579442985-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019596395" status: 204 len: 0 microversion: 2.25 time: 0.104929 Oct 12 13:23:06.935510 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 199/413] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 12 13:23:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019596395 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 13:23:07.062135 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-924b8a90-48a7-4473-8e22-0302c07a3ce8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:07.071282 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-924b8a90-48a7-4473-8e22-0302c07a3ce8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d" status: 200 len: 1312 microversion: 2.1 time: 0.208765 Oct 12 13:23:07.073412 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 215/414] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:06 2022] GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d => generated 1312 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:07.078181 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-83a8ece1-a30b-43cb-8cdb-ed4ac5f9af5c tempest-SecurityGroupsTestAdminJSON-1322968516 tempest-SecurityGroupsTestAdminJSON-1322968516-project-admin] Calling method '.version_select at 0x7f8aa0364160>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:07.189713 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5e523f20-5a5d-451f-9937-ae2b44fdc08c tempest-VolumesAdminNegativeTest-54280835 tempest-VolumesAdminNegativeTest-54280835-project] Action: 'create', calling method: .version_select at 0x7f8a9be53f70>, body: {"keypair": {"name": "tempest-keypair-243914233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMsH/VvACAR6afQbBSXMwr8sU9OUFqS2PaqS9fW1fxurNHWBIA/aMK4fkKCdimlYlaSeRJQoCPQyLitXr1EU2GV4wJcs79SVUV1r0yRwB55cpehrwySqIimPd/DcyOL8w=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:07.212130 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-5e523f20-5a5d-451f-9937-ae2b44fdc08c tempest-VolumesAdminNegativeTest-54280835 tempest-VolumesAdminNegativeTest-54280835-project] Getting quotas for project d63dd8a88d9345d2b527dd235cf4ecfe. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:23:07.219180 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-5e523f20-5a5d-451f-9937-ae2b44fdc08c tempest-VolumesAdminNegativeTest-54280835 tempest-VolumesAdminNegativeTest-54280835-project] Getting quotas for user 08e3e0353c194e7eb2cfce558ca23d39 and project d63dd8a88d9345d2b527dd235cf4ecfe. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:23:07.323815 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5e523f20-5a5d-451f-9937-ae2b44fdc08c tempest-VolumesAdminNegativeTest-54280835 tempest-VolumesAdminNegativeTest-54280835-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.386893 Oct 12 13:23:07.324548 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 200/415] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:23:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:07.330010 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6f002d48-8200-4bd7-b04c-a7f20e618f2a tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Action: 'update', calling method: .version_select at 0x7f8a9be53310>, body: {"quota_set": {"ram": "5120"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:07.364802 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-83a8ece1-a30b-43cb-8cdb-ed4ac5f9af5c tempest-SecurityGroupsTestAdminJSON-1322968516 tempest-SecurityGroupsTestAdminJSON-1322968516-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/40d910ee-8bbd-4d82-b9a4-931cc5a4fa4f" status: 202 len: 0 microversion: 2.1 time: 0.290100 Oct 12 13:23:07.365455 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 216/416] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:23:07 2022] DELETE /compute/v2.1/os-security-groups/40d910ee-8bbd-4d82-b9a4-931cc5a4fa4f => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:23:07.373840 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-dc488f2a-0964-42ac-ac14-d3065af1384c tempest-ServersWithSpecificFlavorTestJSON-697882130 tempest-ServersWithSpecificFlavorTestJSON-697882130-project] Action: 'create', calling method: .version_select at 0x7f8aa038c940>, body: {"keypair": {"name": "tempest-keypair-2107283945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWgSPz/J8GZYiQaDMdPgcFv3PZstPuBSDjiP9jTs4T3dJbRlA0yx2EgWcf7DZjPHqcF7d+mC4hCiOhLF4JxjlS4SKBPgvQcimIGU8UbiBbengt4PY4GfzCxX7nW+fIzcQ=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:07.390520 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-dc488f2a-0964-42ac-ac14-d3065af1384c tempest-ServersWithSpecificFlavorTestJSON-697882130 tempest-ServersWithSpecificFlavorTestJSON-697882130-project] Getting quotas for project b5c157d3d6234bc5b0a10865d8c3dcb4. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:23:07.396874 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-dc488f2a-0964-42ac-ac14-d3065af1384c tempest-ServersWithSpecificFlavorTestJSON-697882130 tempest-ServersWithSpecificFlavorTestJSON-697882130-project] Getting quotas for user ef027b7b52ce44b2a4cf9c3363271e3a and project b5c157d3d6234bc5b0a10865d8c3dcb4. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:23:07.491643 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f002d48-8200-4bd7-b04c-a7f20e618f2a tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:07.492399 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f002d48-8200-4bd7-b04c-a7f20e618f2a tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:07.493592 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f002d48-8200-4bd7-b04c-a7f20e618f2a tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:07.494660 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f002d48-8200-4bd7-b04c-a7f20e618f2a tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:07.495291 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f002d48-8200-4bd7-b04c-a7f20e618f2a tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:07.496039 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f002d48-8200-4bd7-b04c-a7f20e618f2a tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:07.531826 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-dc488f2a-0964-42ac-ac14-d3065af1384c tempest-ServersWithSpecificFlavorTestJSON-697882130 tempest-ServersWithSpecificFlavorTestJSON-697882130-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.163764 Oct 12 13:23:07.546054 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 217/417] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:23:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:07.552123 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ba09fdc6-df9d-4d88-923b-8b418c86fa2a tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:07.553148 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-ba09fdc6-df9d-4d88-923b-8b418c86fa2a tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:07.561816 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ba09fdc6-df9d-4d88-923b-8b418c86fa2a tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:07.562549 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ba09fdc6-df9d-4d88-923b-8b418c86fa2a tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:07.563165 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ba09fdc6-df9d-4d88-923b-8b418c86fa2a tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:07.564639 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ba09fdc6-df9d-4d88-923b-8b418c86fa2a tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:07.565306 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ba09fdc6-df9d-4d88-923b-8b418c86fa2a tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:07.565918 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ba09fdc6-df9d-4d88-923b-8b418c86fa2a tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:07.669184 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-ba09fdc6-df9d-4d88-923b-8b418c86fa2a tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lazy-loading 'services' on Instance uuid d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:07.678558 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6f002d48-8200-4bd7-b04c-a7f20e618f2a tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/0ae4e8293b9a4380892cf59572cf7a67" status: 200 len: 328 microversion: 2.1 time: 0.349912 Oct 12 13:23:07.678558 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 201/418] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 12 13:23:07 2022] PUT /compute/v2.1/os-quota-sets/0ae4e8293b9a4380892cf59572cf7a67 => generated 328 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:07.700475 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2aef1a41-9315-4053-bd15-78203f9b1f9c tempest-SecurityGroupsTestAdminJSON-813442694 tempest-SecurityGroupsTestAdminJSON-813442694-project] Calling method '.version_select at 0x7f8a9be5fe50>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:07.723227 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ba09fdc6-df9d-4d88-923b-8b418c86fa2a tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1929 microversion: 2.75 time: 0.175824 Oct 12 13:23:07.723733 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 218/419] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:07 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1929 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:07.728956 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c503334f-eaf1-4758-a2c5-4a4983335a17 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:07.818797 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c503334f-eaf1-4758-a2c5-4a4983335a17 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-quota-sets/0ae4e8293b9a4380892cf59572cf7a67" status: 202 len: 0 microversion: 2.1 time: 0.093129 Oct 12 13:23:07.820932 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 219/420] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:23:07 2022] DELETE /compute/v2.1/os-quota-sets/0ae4e8293b9a4380892cf59572cf7a67 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:23:07.828095 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9242425f-9819-4a8a-ad62-c171636b1f72 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Calling method '.version_select at 0x7f8aa0300430>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:08.078383 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9242425f-9819-4a8a-ad62-c171636b1f72 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/0ae4e8293b9a4380892cf59572cf7a67" status: 200 len: 371 microversion: 2.1 time: 0.254278 Oct 12 13:23:08.089627 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 220/421] 10.222.0.52 () {58 vars in 1242 bytes} [Wed Oct 12 13:23:07 2022] GET /compute/v2.1/os-quota-sets/0ae4e8293b9a4380892cf59572cf7a67 => generated 371 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:23:08.096192 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-356cd89a-fff3-4759-a191-7c229dcd4b6c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:08.096820 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-356cd89a-fff3-4759-a191-7c229dcd4b6c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 177cff06-72ce-423d-bbe7-9ebcd331d29d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:08.113031 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-356cd89a-fff3-4759-a191-7c229dcd4b6c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:08.113659 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-356cd89a-fff3-4759-a191-7c229dcd4b6c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:08.114117 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-356cd89a-fff3-4759-a191-7c229dcd4b6c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:08.130230 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-356cd89a-fff3-4759-a191-7c229dcd4b6c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:08.130758 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-356cd89a-fff3-4759-a191-7c229dcd4b6c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:08.131205 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-356cd89a-fff3-4759-a191-7c229dcd4b6c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:08.349986 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2aef1a41-9315-4053-bd15-78203f9b1f9c tempest-SecurityGroupsTestAdminJSON-813442694 tempest-SecurityGroupsTestAdminJSON-813442694-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/df631997-1984-47c9-b059-3ada1744df39" status: 202 len: 0 microversion: 2.1 time: 0.670835 Oct 12 13:23:08.354469 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 202/422] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:23:07 2022] DELETE /compute/v2.1/os-security-groups/df631997-1984-47c9-b059-3ada1744df39 => generated 0 bytes in 676 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:23:08.359797 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cbc4c095-6b62-4e20-8baf-6246e78ff051 tempest-SecurityGroupsTestAdminJSON-813442694 tempest-SecurityGroupsTestAdminJSON-813442694-project] Calling method '.version_select at 0x7f8a9be6c310>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:08.586604 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-356cd89a-fff3-4759-a191-7c229dcd4b6c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:08.598380 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-356cd89a-fff3-4759-a191-7c229dcd4b6c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d" status: 200 len: 1312 microversion: 2.1 time: 0.503253 Oct 12 13:23:08.601781 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 221/423] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:08 2022] GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d => generated 1312 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:23:08.608163 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7db5defa-19c7-48ee-b0d2-69366a3f1746 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Calling method '.version_select at 0x7f8aa03b60d0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:09.053153 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-7db5defa-19c7-48ee-b0d2-69366a3f1746 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/dedbcd12886a410499e5c3f7f41453d3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.449446 Oct 12 13:23:09.064391 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 222/424] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 12 13:23:08 2022] GET /compute/v2.1/os-quota-sets/dedbcd12886a410499e5c3f7f41453d3/defaults => generated 371 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:09.074776 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-43f81310-be5f-43ee-a034-0772bea3c7de tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:09.074776 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-43f81310-be5f-43ee-a034-0772bea3c7de tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:09.080518 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-43f81310-be5f-43ee-a034-0772bea3c7de tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:09.083122 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-43f81310-be5f-43ee-a034-0772bea3c7de tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:09.098786 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-43f81310-be5f-43ee-a034-0772bea3c7de tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:09.098786 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-43f81310-be5f-43ee-a034-0772bea3c7de tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:09.101186 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-43f81310-be5f-43ee-a034-0772bea3c7de tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:09.103217 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-43f81310-be5f-43ee-a034-0772bea3c7de tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:09.157029 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cbc4c095-6b62-4e20-8baf-6246e78ff051 tempest-SecurityGroupsTestAdminJSON-813442694 tempest-SecurityGroupsTestAdminJSON-813442694-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/5c340726-9e44-4a89-b989-9337ac14d128" status: 202 len: 0 microversion: 2.1 time: 0.801139 Oct 12 13:23:09.157855 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 203/425] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:23:08 2022] DELETE /compute/v2.1/os-security-groups/5c340726-9e44-4a89-b989-9337ac14d128 => generated 0 bytes in 803 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:23:09.497367 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-43f81310-be5f-43ee-a034-0772bea3c7de tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lazy-loading 'services' on Instance uuid d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:09.537760 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-43f81310-be5f-43ee-a034-0772bea3c7de tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1929 microversion: 2.75 time: 0.467265 Oct 12 13:23:09.539020 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 223/426] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:09 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1929 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:09.628771 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fbdce474-a5f1-42d9-bb7e-fb046084e57b tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Action: 'update', calling method: .version_select at 0x7f8aa049a3a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:09.634556 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a255d2d6-a655-47fc-8cae-ce0171d34b90 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:09.638439 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a255d2d6-a655-47fc-8cae-ce0171d34b90 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 177cff06-72ce-423d-bbe7-9ebcd331d29d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:09.666142 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a255d2d6-a655-47fc-8cae-ce0171d34b90 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:09.667624 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a255d2d6-a655-47fc-8cae-ce0171d34b90 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:09.674483 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a255d2d6-a655-47fc-8cae-ce0171d34b90 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:09.676469 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a255d2d6-a655-47fc-8cae-ce0171d34b90 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:09.677691 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a255d2d6-a655-47fc-8cae-ce0171d34b90 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:09.679856 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a255d2d6-a655-47fc-8cae-ce0171d34b90 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:10.156107 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-a255d2d6-a655-47fc-8cae-ce0171d34b90 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:10.164401 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a255d2d6-a655-47fc-8cae-ce0171d34b90 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d" status: 200 len: 1312 microversion: 2.1 time: 0.540207 Oct 12 13:23:10.178621 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 204/427] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:09 2022] GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d => generated 1312 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:10.331823 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fbdce474-a5f1-42d9-bb7e-fb046084e57b tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:10.332315 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fbdce474-a5f1-42d9-bb7e-fb046084e57b tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:10.332748 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fbdce474-a5f1-42d9-bb7e-fb046084e57b tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:10.334169 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fbdce474-a5f1-42d9-bb7e-fb046084e57b tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:10.334540 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fbdce474-a5f1-42d9-bb7e-fb046084e57b tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:10.334973 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fbdce474-a5f1-42d9-bb7e-fb046084e57b tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:10.529390 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fbdce474-a5f1-42d9-bb7e-fb046084e57b tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/aed6b849c5b0471a8cb0f59323bd3516" status: 200 len: 328 microversion: 2.1 time: 0.903961 Oct 12 13:23:10.530640 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 224/428] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 12 13:23:09 2022] PUT /compute/v2.1/os-quota-sets/aed6b849c5b0471a8cb0f59323bd3516 => generated 328 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:10.542712 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a41a3cf8-b45e-4dcb-9b92-433f2807e8bc tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Calling method '.version_select at 0x7f8a9be6ce50>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:10.584118 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-976e4407-91c0-44d9-bbf7-59f30e29f597 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:10.584732 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-976e4407-91c0-44d9-bbf7-59f30e29f597 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:10.620190 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-976e4407-91c0-44d9-bbf7-59f30e29f597 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:10.621963 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-976e4407-91c0-44d9-bbf7-59f30e29f597 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:10.623628 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-976e4407-91c0-44d9-bbf7-59f30e29f597 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:10.624556 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-976e4407-91c0-44d9-bbf7-59f30e29f597 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:10.627518 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-976e4407-91c0-44d9-bbf7-59f30e29f597 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:10.628163 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-976e4407-91c0-44d9-bbf7-59f30e29f597 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:10.847547 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=100 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:10.853364 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-976e4407-91c0-44d9-bbf7-59f30e29f597 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lazy-loading 'services' on Instance uuid d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:10.887683 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-976e4407-91c0-44d9-bbf7-59f30e29f597 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1929 microversion: 2.75 time: 0.307796 Oct 12 13:23:10.889782 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 225/429] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:10 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1929 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:10.970924 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a41a3cf8-b45e-4dcb-9b92-433f2807e8bc tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:10.971434 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a41a3cf8-b45e-4dcb-9b92-433f2807e8bc tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:10.971832 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a41a3cf8-b45e-4dcb-9b92-433f2807e8bc tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:10.972757 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a41a3cf8-b45e-4dcb-9b92-433f2807e8bc tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:10.973413 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a41a3cf8-b45e-4dcb-9b92-433f2807e8bc tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:10.974036 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a41a3cf8-b45e-4dcb-9b92-433f2807e8bc tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:11.020702 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a41a3cf8-b45e-4dcb-9b92-433f2807e8bc tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/aed6b849c5b0471a8cb0f59323bd3516/detail" status: 200 len: 916 microversion: 2.1 time: 0.481508 Oct 12 13:23:11.021987 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 205/430] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 12 13:23:10 2022] GET /compute/v2.1/os-quota-sets/aed6b849c5b0471a8cb0f59323bd3516/detail => generated 916 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:11.209202 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5193c1db-29aa-41b2-bd44-b6a47d695741 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:11.211561 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-5193c1db-29aa-41b2-bd44-b6a47d695741 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 177cff06-72ce-423d-bbe7-9ebcd331d29d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:11.221819 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5193c1db-29aa-41b2-bd44-b6a47d695741 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:11.222542 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5193c1db-29aa-41b2-bd44-b6a47d695741 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:11.224372 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5193c1db-29aa-41b2-bd44-b6a47d695741 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:11.225567 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5193c1db-29aa-41b2-bd44-b6a47d695741 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:11.226172 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5193c1db-29aa-41b2-bd44-b6a47d695741 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:11.226755 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5193c1db-29aa-41b2-bd44-b6a47d695741 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:11.248922 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e885128e-6262-4217-9556-0581e88c03bb tempest-VolumesAdminNegativeTest-54280835 tempest-VolumesAdminNegativeTest-54280835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-544289383", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "a418d84c-35d7-4999-aadb-193056d3c6f0"}], "security_groups": [{"name": "tempest-securitygroup--1129302130"}], "key_name": "tempest-keypair-243914233", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:11.524828 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-e885128e-6262-4217-9556-0581e88c03bb tempest-VolumesAdminNegativeTest-54280835 tempest-VolumesAdminNegativeTest-54280835-project] validate_networks() for [('a418d84c-35d7-4999-aadb-193056d3c6f0', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:23:11.737805 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-5193c1db-29aa-41b2-bd44-b6a47d695741 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:11.751620 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5193c1db-29aa-41b2-bd44-b6a47d695741 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d" status: 200 len: 1312 microversion: 2.1 time: 0.551156 Oct 12 13:23:11.762310 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 226/431] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:11 2022] GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d => generated 1312 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:11.778950 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-d17404aa-c668-4382-8fe5-f1301e75dd5a req-3f830c50-c44a-47f4-927f-a6f2307a44c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "177cff06-72ce-423d-bbe7-9ebcd331d29d", "name": "network-vif-plugged", "status": "completed", "tag": "6849491b-9544-4029-90ad-8fe791181f39"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:11.812283 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-d17404aa-c668-4382-8fe5-f1301e75dd5a req-3f830c50-c44a-47f4-927f-a6f2307a44c6 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:11.813307 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-d17404aa-c668-4382-8fe5-f1301e75dd5a req-3f830c50-c44a-47f4-927f-a6f2307a44c6 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:11.814051 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-d17404aa-c668-4382-8fe5-f1301e75dd5a req-3f830c50-c44a-47f4-927f-a6f2307a44c6 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:11.828694 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-d17404aa-c668-4382-8fe5-f1301e75dd5a req-3f830c50-c44a-47f4-927f-a6f2307a44c6 service nova] Creating event network-vif-plugged:6849491b-9544-4029-90ad-8fe791181f39 for instance 177cff06-72ce-423d-bbe7-9ebcd331d29d on n-h1-861076-2 Oct 12 13:23:11.835810 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-d17404aa-c668-4382-8fe5-f1301e75dd5a req-3f830c50-c44a-47f4-927f-a6f2307a44c6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071591 Oct 12 13:23:11.836660 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 227/432] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:11.844820 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d3d905b3-2c29-440a-9fc2-9c25a3048dda tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Action: 'update', calling method: .version_select at 0x7f8aa13e6af0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:12.670684 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3d905b3-2c29-440a-9fc2-9c25a3048dda tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:12.671404 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3d905b3-2c29-440a-9fc2-9c25a3048dda tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:12.671977 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3d905b3-2c29-440a-9fc2-9c25a3048dda tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:12.672793 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3d905b3-2c29-440a-9fc2-9c25a3048dda tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:12.673916 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3d905b3-2c29-440a-9fc2-9c25a3048dda tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:12.675572 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3d905b3-2c29-440a-9fc2-9c25a3048dda tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:12.695783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-e885128e-6262-4217-9556-0581e88c03bb tempest-VolumesAdminNegativeTest-54280835 tempest-VolumesAdminNegativeTest-54280835-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f5e94ffc-7f99-4304-bab4-8ea14fadaf45) Oct 12 13:23:12.695783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:12.695783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:23:12.695783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:23:12.695783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:12.695783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:12.695783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:12.695783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:12.695783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:12.695783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:12.695783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:23:12.695783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:23:12.695783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:23:12.695783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:23:12.695783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:23:12.695783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:23:12.697726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:23:12.697726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:23:12.697726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:23:12.697726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:23:12.697726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:23:12.697726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:23:12.697726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:23:12.697726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:23:12.697726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:23:12.697726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:23:12.697726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:23:12.697726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:12.697726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:12.697726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:23:12.697726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:23:12.697726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:12.697726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:12.697726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:23:12.698935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:23:12.698935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:12.698935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:12.698935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:23:12.698935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:23:12.698935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:12.698935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:12.698935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:23:12.698935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:23:12.698935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:23:12.698935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:23:12.698935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:23:12.698935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:23:12.698935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:23:12.698935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:23:12.698935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:23:12.698935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:23:12.698935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:23:12.700110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:23:12.700110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:23:12.700110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:23:12.700110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:23:12.700110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:23:12.700110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:23:12.700110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:23:12.700110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:23:12.700110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:23:12.700110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:23:12.700110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:23:12.700110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:23:12.700110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:23:12.700110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:23:12.700110 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:23:12.701147 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f5e94ffc-7f99-4304-bab4-8ea14fadaf45) Oct 12 13:23:12.701147 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:12.702123 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-e885128e-6262-4217-9556-0581e88c03bb tempest-VolumesAdminNegativeTest-54280835 tempest-VolumesAdminNegativeTest-54280835-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:12.702123 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:23:12.705206 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e885128e-6262-4217-9556-0581e88c03bb tempest-VolumesAdminNegativeTest-54280835 tempest-VolumesAdminNegativeTest-54280835-project] Request method failure captured: Oct 12 13:23:12.705206 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:23:12.705206 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:23:12.705206 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:23:12.705206 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:23:12.705206 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 463 Oct 12 13:23:12.705206 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:23:12.705206 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:23:12.705206 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:23:12.705206 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:23:12.705206 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr-t6dgSAeacUyj6NSw1-rQlfl6GNGCNBWVcFoVtALpWx3kNkLsKUky2yJ3atqGakSxfAc85_uBGtkkcomOaEfQP0vKAh35mPIBbJUFRP9IKtqfqrOKNvxA9WHjHGCday3HBBR80jH4wkmViI5HlEQLqCgv_aIt0TB6EWEgCL1KFC8s Oct 12 13:23:12.705206 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:23:12.705206 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:23:12.705206 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:23:12.705206 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:23:12.705206 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:23:12.705206 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:23:12.705206 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: d63dd8a88d9345d2b527dd235cf4ecfe Oct 12 13:23:12.705206 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-VolumesAdminNegativeTest-54280835 Oct 12 13:23:12.705206 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:23:12.705206 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:23:12.706751 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d63dd8a88d9345d2b527dd235cf4ecfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d63dd8a88d9345d2b527dd235cf4ecfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d63dd8a88d9345d2b527dd235cf4ecfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d63dd8a88d9345d2b527dd235cf4ecfe"}]}] Oct 12 13:23:12.706751 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-VolumesAdminNegativeTest-54280835 Oct 12 13:23:12.706751 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: d63dd8a88d9345d2b527dd235cf4ecfe Oct 12 13:23:12.706751 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-54280835 Oct 12 13:23:12.706751 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-VolumesAdminNegativeTest-54280835-project Oct 12 13:23:12.706751 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:23:12.706751 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:23:12.706751 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 08e3e0353c194e7eb2cfce558ca23d39 Oct 12 13:23:12.706751 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-VolumesAdminNegativeTest-54280835-project Oct 12 13:23:12.706751 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:23:12.707575 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-544289383", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "a418d84c-35d7-4999-aadb-193056d3c6f0"}], "security_groups": [{"name": "tempest-securitygroup--1129302130"}], "key_name": "tempest-keypair-243914233", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 12 13:23:12.707575 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:23:12.707575 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:12.707575 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:23:12.707575 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-VolumesAdminNegativeTest-server-544289383', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': 'a418d84c-35d7-4999-aadb-193056d3c6f0'}], 'security_groups': [{'name': 'tempest-securitygroup--1129302130'}], 'key_name': 'tempest-keypair-243914233', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 12 13:23:12.707575 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:23:12.707575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:12.707575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:23:12.707575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:23:12.707575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:12.707575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:12.707575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:12.707575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:12.709136 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:12.709136 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:12.709136 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:23:12.709136 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:23:12.709136 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:23:12.709136 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:23:12.709136 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:23:12.709136 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:23:12.709136 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:23:12.709136 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:23:12.709136 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:23:12.709136 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:23:12.709136 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:23:12.709136 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:23:12.709136 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:23:12.709136 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:23:12.709136 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:23:12.709136 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:23:12.710294 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:23:12.710294 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:12.710294 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:12.710294 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:23:12.710294 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:23:12.710294 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:12.710294 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:12.710294 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:23:12.710294 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:23:12.710294 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:12.710294 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:12.710294 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:23:12.710294 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:23:12.710294 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:12.710294 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:12.710294 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:23:12.710294 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:23:12.710294 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:23:12.711467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:23:12.711467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:23:12.711467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:23:12.711467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:23:12.711467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:23:12.711467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:23:12.711467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:23:12.711467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:23:12.711467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:23:12.711467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:23:12.711467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:23:12.711467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:23:12.711467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:23:12.711467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:23:12.711467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:23:12.711467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:23:12.711467 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:23:12.712693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:23:12.712693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:23:12.712693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:23:12.712693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:23:12.712693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:23:12.712693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:23:12.712693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f5e94ffc-7f99-4304-bab4-8ea14fadaf45) Oct 12 13:23:12.712693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:12.712693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:23:12.712693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:12.712693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:12.712693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:23:12.712693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:23:12.712693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:23:12.712693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:23:12.712693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:23:12.712693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:23:12.715145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:12.715145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:12.715145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:12.715145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:23:12.715145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:12.715145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:12.715145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:23:12.715145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:23:12.715145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:23:12.715145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:23:12.715145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:12.715145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:12.715145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:12.715145 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e885128e-6262-4217-9556-0581e88c03bb tempest-VolumesAdminNegativeTest-54280835 tempest-VolumesAdminNegativeTest-54280835-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:12.715145 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:23:12.717063 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e885128e-6262-4217-9556-0581e88c03bb tempest-VolumesAdminNegativeTest-54280835 tempest-VolumesAdminNegativeTest-54280835-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.472991 Oct 12 13:23:12.730170 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 206/433] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:23:11 2022] POST /compute/v2.1/servers => generated 214 bytes in 1487 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:23:12.747773 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:UPDATE=12,nova_api:SELECT=83,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:12.756916 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-706422c4-caed-48c6-8719-464f64615972 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:12.757903 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-706422c4-caed-48c6-8719-464f64615972 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:12.767032 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-706422c4-caed-48c6-8719-464f64615972 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:12.767967 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-706422c4-caed-48c6-8719-464f64615972 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:12.768551 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-706422c4-caed-48c6-8719-464f64615972 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:12.771840 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-706422c4-caed-48c6-8719-464f64615972 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:12.771840 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-706422c4-caed-48c6-8719-464f64615972 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:12.771840 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-706422c4-caed-48c6-8719-464f64615972 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:12.846366 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3d905b3-2c29-440a-9fc2-9c25a3048dda tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:12.846366 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3d905b3-2c29-440a-9fc2-9c25a3048dda tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:12.846366 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3d905b3-2c29-440a-9fc2-9c25a3048dda tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:12.861355 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3d905b3-2c29-440a-9fc2-9c25a3048dda tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:12.861941 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3d905b3-2c29-440a-9fc2-9c25a3048dda tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:12.862395 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3d905b3-2c29-440a-9fc2-9c25a3048dda tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:12.943424 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-706422c4-caed-48c6-8719-464f64615972 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lazy-loading 'services' on Instance uuid d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:12.984006 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-706422c4-caed-48c6-8719-464f64615972 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1929 microversion: 2.75 time: 0.252431 Oct 12 13:23:12.993098 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 207/434] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:12 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1929 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:13.008759 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-01490eca-4544-4d5e-86d4-f9b92c48d3e9 tempest-ServersWithSpecificFlavorTestJSON-697882130 tempest-ServersWithSpecificFlavorTestJSON-697882130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2146500089", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "2131911841", "adminPass": "***", "networks": [{"uuid": "3a216d60-f51f-4fe1-816c-df508eabceac"}], "security_groups": [{"name": "tempest-securitygroup--1052976844"}], "key_name": "tempest-keypair-2107283945", "user_data": "}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:13.101539 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d3d905b3-2c29-440a-9fc2-9c25a3048dda tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/aed6b849c5b0471a8cb0f59323bd3516?user_id=9575963784314945ba1b20f9acc97f26" status: 200 len: 328 microversion: 2.1 time: 1.259490 Oct 12 13:23:13.101539 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 228/435] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Oct 12 13:23:11 2022] PUT /compute/v2.1/os-quota-sets/aed6b849c5b0471a8cb0f59323bd3516?user_id=9575963784314945ba1b20f9acc97f26 => generated 328 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:13.109850 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-dacd86dd-2c0b-487c-a007-a5304db9898c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:13.110788 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-dacd86dd-2c0b-487c-a007-a5304db9898c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 177cff06-72ce-423d-bbe7-9ebcd331d29d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:13.125770 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dacd86dd-2c0b-487c-a007-a5304db9898c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:13.126627 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dacd86dd-2c0b-487c-a007-a5304db9898c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:13.127069 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dacd86dd-2c0b-487c-a007-a5304db9898c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:13.127786 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dacd86dd-2c0b-487c-a007-a5304db9898c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:13.128239 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dacd86dd-2c0b-487c-a007-a5304db9898c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:13.132253 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dacd86dd-2c0b-487c-a007-a5304db9898c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:13.321263 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-01490eca-4544-4d5e-86d4-f9b92c48d3e9 tempest-ServersWithSpecificFlavorTestJSON-697882130 tempest-ServersWithSpecificFlavorTestJSON-697882130-project] validate_networks() for [('3a216d60-f51f-4fe1-816c-df508eabceac', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:23:13.505599 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-dacd86dd-2c0b-487c-a007-a5304db9898c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:13.522171 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-dacd86dd-2c0b-487c-a007-a5304db9898c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d" status: 200 len: 1312 microversion: 2.1 time: 0.420064 Oct 12 13:23:13.525188 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 229/436] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:13 2022] GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d => generated 1312 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:13.543833 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-68312c43-351a-47ef-bcba-68f9df0f8d3a tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Calling method '.version_select at 0x7f8aa0364160>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:13.753872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-01490eca-4544-4d5e-86d4-f9b92c48d3e9 tempest-ServersWithSpecificFlavorTestJSON-697882130 tempest-ServersWithSpecificFlavorTestJSON-697882130-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-44c16478-8647-4632-9cd2-44659d1d5ddf) Oct 12 13:23:13.753872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:13.753872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:23:13.753872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:23:13.753872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:13.753872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:13.753872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:13.753872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:13.753872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:13.753872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:13.753872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:23:13.753872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:23:13.753872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:23:13.753872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:23:13.753872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:23:13.753872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:23:13.755966 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:23:13.755966 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:23:13.755966 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:23:13.755966 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:23:13.755966 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:23:13.755966 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:23:13.755966 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:23:13.755966 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:23:13.755966 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:23:13.755966 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:23:13.755966 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:23:13.755966 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:13.755966 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:13.755966 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:23:13.755966 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:23:13.755966 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:13.755966 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:13.755966 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:23:13.757164 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:23:13.757164 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:13.757164 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:13.757164 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:23:13.757164 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:23:13.757164 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:13.757164 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:13.757164 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:23:13.757164 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:23:13.757164 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:23:13.757164 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:23:13.757164 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:23:13.757164 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:23:13.757164 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:23:13.757164 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:23:13.757164 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:23:13.757164 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:23:13.757164 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:23:13.759162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:23:13.759162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:23:13.759162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:23:13.759162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:23:13.759162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:23:13.759162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:23:13.759162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:23:13.759162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:23:13.759162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:23:13.759162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:23:13.759162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:23:13.759162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:23:13.759162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:23:13.759162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:23:13.759162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-44c16478-8647-4632-9cd2-44659d1d5ddf) Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-01490eca-4544-4d5e-86d4-f9b92c48d3e9 tempest-ServersWithSpecificFlavorTestJSON-697882130 tempest-ServersWithSpecificFlavorTestJSON-697882130-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-01490eca-4544-4d5e-86d4-f9b92c48d3e9 tempest-ServersWithSpecificFlavorTestJSON-697882130 tempest-ServersWithSpecificFlavorTestJSON-697882130-project] Request method failure captured: Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 506 Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr-mGbOXArzKUtZO8CigtuC1WWYxvZoZQfzhlxbL1d_c1XbVqjFNmVcDUCy29PqHOAsR3RWWRaqTE-ssK6T7SzJz9gnFv6hkTS9GSiLuIBxlTO3vDbk4TaHb8SL4RntZTNIBehTR4dptAhHW4Sz_fUW4V0XNIsvCPYNcgkfaP3ILTa4 Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: b5c157d3d6234bc5b0a10865d8c3dcb4 Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-697882130 Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:23:13.761633 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:23:13.763568 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b5c157d3d6234bc5b0a10865d8c3dcb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b5c157d3d6234bc5b0a10865d8c3dcb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b5c157d3d6234bc5b0a10865d8c3dcb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b5c157d3d6234bc5b0a10865d8c3dcb4"}]}] Oct 12 13:23:13.763568 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-697882130 Oct 12 13:23:13.763568 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: b5c157d3d6234bc5b0a10865d8c3dcb4 Oct 12 13:23:13.763568 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-697882130 Oct 12 13:23:13.763568 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServersWithSpecificFlavorTestJSON-697882130-project Oct 12 13:23:13.763568 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:23:13.763568 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:23:13.763568 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: ef027b7b52ce44b2a4cf9c3363271e3a Oct 12 13:23:13.763568 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-697882130-project Oct 12 13:23:13.763568 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:23:13.764255 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2146500089", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "2131911841", "adminPass": "password", "networks": [{"uuid": "3a216d60-f51f-4fe1-816c-df508eabceac"}], "security_groups": [{"name": "tempest-securitygroup--1052976844"}], "key_name": "tempest-keypair-2107283945", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 12 13:23:13.764255 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:23:13.764255 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:13.764255 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:23:13.764255 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-ServersWithSpecificFlavorTestJSON-server-2146500089', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '2131911841', 'adminPass': 'password', 'networks': [{'uuid': '3a216d60-f51f-4fe1-816c-df508eabceac'}], 'security_groups': [{'name': 'tempest-securitygroup--1052976844'}], 'key_name': 'tempest-keypair-2107283945', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 12 13:23:13.764255 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:23:13.764255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:13.764255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:23:13.764255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:23:13.764255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:13.764255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:13.764255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:13.765094 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:13.765094 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:13.765094 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:13.765094 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:23:13.765094 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:23:13.765094 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:23:13.765094 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:23:13.765094 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:23:13.765094 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:23:13.765094 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:23:13.765094 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:23:13.765094 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:23:13.765094 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:23:13.765094 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:23:13.765094 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:23:13.765094 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:23:13.765094 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:23:13.765094 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:23:13.765094 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:23:13.770409 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:23:13.770409 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:13.770409 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:13.770409 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:23:13.770409 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:23:13.770409 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:13.770409 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:13.770409 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:23:13.770409 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:23:13.770409 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:13.770409 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:13.770409 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:23:13.770409 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:23:13.770409 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:13.770409 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:13.770409 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:23:13.770409 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:23:13.770409 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:23:13.772252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:23:13.772252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:23:13.772252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:23:13.772252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:23:13.772252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:23:13.772252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:23:13.772252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:23:13.772252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:23:13.772252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:23:13.772252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:23:13.772252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:23:13.772252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:23:13.772252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:23:13.772252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:23:13.772252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:23:13.772252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:23:13.772252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:23:13.773361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:23:13.773361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:23:13.773361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:23:13.773361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:23:13.773361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:23:13.773361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:23:13.773361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-44c16478-8647-4632-9cd2-44659d1d5ddf) Oct 12 13:23:13.773361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:13.773361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:23:13.773361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:13.773361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:13.773361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:23:13.773361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:23:13.773361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:23:13.773361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:23:13.773361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:23:13.773361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:23:13.774397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:13.774397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:13.774397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:13.774397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:23:13.774397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:13.774397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:13.774397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:23:13.774397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:23:13.774397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:23:13.774397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:23:13.774397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:13.774397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:13.774397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:13.774397 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-01490eca-4544-4d5e-86d4-f9b92c48d3e9 tempest-ServersWithSpecificFlavorTestJSON-697882130 tempest-ServersWithSpecificFlavorTestJSON-697882130-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:13.774397 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:23:13.775305 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-01490eca-4544-4d5e-86d4-f9b92c48d3e9 tempest-ServersWithSpecificFlavorTestJSON-697882130 tempest-ServersWithSpecificFlavorTestJSON-697882130-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.769636 Oct 12 13:23:13.775305 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 208/437] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:23:12 2022] POST /compute/v2.1/servers => generated 214 bytes in 772 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:23:13.783039 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a4ca4708-6a13-4c04-846c-8e4c114443f8 tempest-VolumesAdminNegativeTest-54280835 tempest-VolumesAdminNegativeTest-54280835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2102713718", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "a418d84c-35d7-4999-aadb-193056d3c6f0"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:13.861066 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-a4ca4708-6a13-4c04-846c-8e4c114443f8 tempest-VolumesAdminNegativeTest-54280835 tempest-VolumesAdminNegativeTest-54280835-project] validate_networks() for [('a418d84c-35d7-4999-aadb-193056d3c6f0', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:23:13.932179 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-68312c43-351a-47ef-bcba-68f9df0f8d3a tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/aed6b849c5b0471a8cb0f59323bd3516?user_id=9575963784314945ba1b20f9acc97f26" status: 200 len: 370 microversion: 2.1 time: 0.405691 Oct 12 13:23:13.932767 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 230/438] 10.222.0.52 () {58 vars in 1323 bytes} [Wed Oct 12 13:23:13 2022] GET /compute/v2.1/os-quota-sets/aed6b849c5b0471a8cb0f59323bd3516?user_id=9575963784314945ba1b20f9acc97f26 => generated 370 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:14.243784 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c2b3bc19-8489-4f70-859b-e55e22c1bd89 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-544816397", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:14.307674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-a4ca4708-6a13-4c04-846c-8e4c114443f8 tempest-VolumesAdminNegativeTest-54280835 tempest-VolumesAdminNegativeTest-54280835-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9a1858ed-88eb-40d1-93a1-f27495e4eed6) Oct 12 13:23:14.307674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:14.307674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:23:14.307674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:23:14.307674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:14.307674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:14.307674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:14.307674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:14.307674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:14.307674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:14.307674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:23:14.307674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:23:14.307674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:23:14.307674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:23:14.307674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:23:14.307674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:23:14.308805 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:23:14.308805 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:23:14.308805 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:23:14.308805 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:23:14.308805 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:23:14.308805 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:23:14.308805 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:23:14.308805 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:23:14.308805 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:23:14.308805 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:23:14.308805 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:23:14.308805 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:14.308805 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:14.308805 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:23:14.308805 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:23:14.308805 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:14.308805 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:14.308805 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:23:14.310099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:23:14.310099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:14.310099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:14.310099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:23:14.310099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:23:14.310099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:14.310099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:14.310099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:23:14.310099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:23:14.310099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:23:14.310099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:23:14.310099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:23:14.310099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:23:14.310099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:23:14.310099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:23:14.310099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:23:14.310099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:23:14.310099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:23:14.311362 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:23:14.311362 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:23:14.311362 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:23:14.311362 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:23:14.311362 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:23:14.311362 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:23:14.311362 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:23:14.311362 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:23:14.311362 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:23:14.311362 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:23:14.311362 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:23:14.311362 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:23:14.311362 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:23:14.311362 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:23:14.311362 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9a1858ed-88eb-40d1-93a1-f27495e4eed6) Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-a4ca4708-6a13-4c04-846c-8e4c114443f8 tempest-VolumesAdminNegativeTest-54280835 tempest-VolumesAdminNegativeTest-54280835-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a4ca4708-6a13-4c04-846c-8e4c114443f8 tempest-VolumesAdminNegativeTest-54280835 tempest-VolumesAdminNegativeTest-54280835-project] Request method failure captured: Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 210 Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr-t6dgSAeacUyj6NSw1-rQlfl6GNGCNBWVcFoVtALpWx3kNkLsKUky2yJ3atqGakSxfAc85_uBGtkkcomOaEfQP0vKAh35mPIBbJUFRP9IKtqfqrOKNvxA9WHjHGCday3HBBR80jH4wkmViI5HlEQLqCgv_aIt0TB6EWEgCL1KFC8s Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: d63dd8a88d9345d2b527dd235cf4ecfe Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-VolumesAdminNegativeTest-54280835 Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:23:14.312343 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:23:14.319789 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d63dd8a88d9345d2b527dd235cf4ecfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d63dd8a88d9345d2b527dd235cf4ecfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d63dd8a88d9345d2b527dd235cf4ecfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d63dd8a88d9345d2b527dd235cf4ecfe"}]}] Oct 12 13:23:14.319789 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-VolumesAdminNegativeTest-54280835 Oct 12 13:23:14.319789 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: d63dd8a88d9345d2b527dd235cf4ecfe Oct 12 13:23:14.319789 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-54280835 Oct 12 13:23:14.319789 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-VolumesAdminNegativeTest-54280835-project Oct 12 13:23:14.319789 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:23:14.319789 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:23:14.319789 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 08e3e0353c194e7eb2cfce558ca23d39 Oct 12 13:23:14.319789 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-VolumesAdminNegativeTest-54280835-project Oct 12 13:23:14.319789 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:23:14.319789 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2102713718", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "a418d84c-35d7-4999-aadb-193056d3c6f0"}]}} Oct 12 13:23:14.320508 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:23:14.320508 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:14.320508 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:23:14.320508 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-VolumesAdminNegativeTest-server-2102713718', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': 'a418d84c-35d7-4999-aadb-193056d3c6f0'}]}}} Oct 12 13:23:14.320508 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:23:14.320508 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:14.320508 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:23:14.320508 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:23:14.320508 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:14.320508 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:14.320508 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:14.320508 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:14.320508 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:14.320508 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:14.320508 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:23:14.320508 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:23:14.320508 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:23:14.320508 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:23:14.320508 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:23:14.321672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:23:14.321672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:23:14.321672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:23:14.321672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:23:14.321672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:23:14.321672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:23:14.321672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:23:14.321672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:23:14.321672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:23:14.321672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:23:14.321672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:23:14.321672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:23:14.321672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:14.321672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:14.321672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:23:14.321672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:23:14.321672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:14.321672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:14.322820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:23:14.322820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:23:14.322820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:14.322820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:14.322820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:23:14.322820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:23:14.322820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:14.322820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:14.322820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:23:14.322820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:23:14.322820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:23:14.322820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:23:14.322820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:23:14.322820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:23:14.322820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:23:14.322820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:23:14.322820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:23:14.322820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:23:14.323938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:23:14.323938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:23:14.323938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:23:14.323938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:23:14.323938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:23:14.323938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:23:14.323938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:23:14.323938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:23:14.323938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:23:14.323938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:23:14.323938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:23:14.323938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:23:14.323938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:23:14.323938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:23:14.323938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:23:14.323938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:23:14.324987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9a1858ed-88eb-40d1-93a1-f27495e4eed6) Oct 12 13:23:14.324987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:14.324987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:23:14.324987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:14.324987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:14.324987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:23:14.324987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:23:14.324987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:23:14.324987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:23:14.324987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:23:14.324987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:23:14.324987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:14.324987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:14.324987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:14.324987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:23:14.324987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:14.324987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:14.324987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:23:14.324987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:23:14.326189 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:23:14.326189 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:23:14.326189 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:14.326189 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:14.326189 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:14.326189 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a4ca4708-6a13-4c04-846c-8e4c114443f8 tempest-VolumesAdminNegativeTest-54280835 tempest-VolumesAdminNegativeTest-54280835-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:14.326189 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:23:14.326189 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a4ca4708-6a13-4c04-846c-8e4c114443f8 tempest-VolumesAdminNegativeTest-54280835 tempest-VolumesAdminNegativeTest-54280835-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.544217 Oct 12 13:23:14.326189 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 209/439] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:23:13 2022] POST /compute/v2.1/servers => generated 214 bytes in 547 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:23:14.326762 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-c2b3bc19-8489-4f70-859b-e55e22c1bd89 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] validate_networks() for None {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:23:14.326850 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7a4d7483-77e7-4107-a722-fecdb0e5e2f6 tempest-ServersWithSpecificFlavorTestJSON-697882130 tempest-ServersWithSpecificFlavorTestJSON-697882130-project] Calling method '.version_select at 0x7f8aa008ec10>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:14.413894 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7a4d7483-77e7-4107-a722-fecdb0e5e2f6 tempest-ServersWithSpecificFlavorTestJSON-697882130 tempest-ServersWithSpecificFlavorTestJSON-697882130-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2107283945" status: 202 len: 0 microversion: 2.1 time: 0.099640 Oct 12 13:23:14.418299 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 210/440] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 12 13:23:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2107283945 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:23:14.422979 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7a6c7f71-58c0-4be6-aeb9-2c077185d7b2 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:14.423597 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7a6c7f71-58c0-4be6-aeb9-2c077185d7b2 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:14.441669 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7a6c7f71-58c0-4be6-aeb9-2c077185d7b2 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:14.442282 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7a6c7f71-58c0-4be6-aeb9-2c077185d7b2 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:14.442734 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7a6c7f71-58c0-4be6-aeb9-2c077185d7b2 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:14.443503 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7a6c7f71-58c0-4be6-aeb9-2c077185d7b2 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:14.443929 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7a6c7f71-58c0-4be6-aeb9-2c077185d7b2 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:14.444353 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7a6c7f71-58c0-4be6-aeb9-2c077185d7b2 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:14.583972 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-7a6c7f71-58c0-4be6-aeb9-2c077185d7b2 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lazy-loading 'services' on Instance uuid d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:14.610498 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7a6c7f71-58c0-4be6-aeb9-2c077185d7b2 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1929 microversion: 2.75 time: 0.190983 Oct 12 13:23:14.622744 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 211/441] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:14 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1929 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:14.628792 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f300bd34-c2f1-46eb-907f-2503c091af57 tempest-VolumesAdminNegativeTest-54280835 tempest-VolumesAdminNegativeTest-54280835-project] Calling method '.version_select at 0x7f8a9be70b80>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:14.721174 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-c2b3bc19-8489-4f70-859b-e55e22c1bd89 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:23:14.722394 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-c2b3bc19-8489-4f70-859b-e55e22c1bd89 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:23:14.722992 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-c2b3bc19-8489-4f70-859b-e55e22c1bd89 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:23:14.723674 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-c2b3bc19-8489-4f70-859b-e55e22c1bd89 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:23:14.724189 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-c2b3bc19-8489-4f70-859b-e55e22c1bd89 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:23:14.735101 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2b3bc19-8489-4f70-859b-e55e22c1bd89 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:14.735756 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2b3bc19-8489-4f70-859b-e55e22c1bd89 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:14.736594 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2b3bc19-8489-4f70-859b-e55e22c1bd89 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:14.738374 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2b3bc19-8489-4f70-859b-e55e22c1bd89 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:14.739770 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2b3bc19-8489-4f70-859b-e55e22c1bd89 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:14.744150 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f300bd34-c2f1-46eb-907f-2503c091af57 tempest-VolumesAdminNegativeTest-54280835 tempest-VolumesAdminNegativeTest-54280835-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-243914233" status: 202 len: 0 microversion: 2.1 time: 0.120073 Oct 12 13:23:14.744798 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2b3bc19-8489-4f70-859b-e55e22c1bd89 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:14.744963 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 212/442] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Oct 12 13:23:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-243914233 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:23:14.761200 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-090daab9-9ca3-4271-bb86-250f4671d942 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:14.765431 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-090daab9-9ca3-4271-bb86-250f4671d942 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 177cff06-72ce-423d-bbe7-9ebcd331d29d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:14.780753 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-090daab9-9ca3-4271-bb86-250f4671d942 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:14.781506 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-090daab9-9ca3-4271-bb86-250f4671d942 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:14.781962 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-090daab9-9ca3-4271-bb86-250f4671d942 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:14.783626 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-090daab9-9ca3-4271-bb86-250f4671d942 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:14.784886 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-090daab9-9ca3-4271-bb86-250f4671d942 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:14.785653 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-090daab9-9ca3-4271-bb86-250f4671d942 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:14.794104 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-c2b3bc19-8489-4f70-859b-e55e22c1bd89 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Getting quotas for project 6bd2bdad116244d4a2e0f0057e035817. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:23:14.800458 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-c2b3bc19-8489-4f70-859b-e55e22c1bd89 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Getting quotas for user 259ebdabdff34c40b01cf3545f88aeeb and project 6bd2bdad116244d4a2e0f0057e035817. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:23:14.823574 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c2b3bc19-8489-4f70-859b-e55e22c1bd89 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Going to run 1 instances... {{(pid=120933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:23:14.826271 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c2b3bc19-8489-4f70-859b-e55e22c1bd89 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] [instance: 03732e0a-4ecf-4659-a7f2-1fb9519a272d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:23:15.004976 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c2b3bc19-8489-4f70-859b-e55e22c1bd89 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.069245 Oct 12 13:23:15.007374 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 231/443] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:23:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 13:23:15.021136 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-dd5c601d-15ed-434a-9572-8318d2f1abb5 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Calling method '.version_select at 0x7f8aa03f3310>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:15.128633 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-090daab9-9ca3-4271-bb86-250f4671d942 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:15.140422 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-090daab9-9ca3-4271-bb86-250f4671d942 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d" status: 200 len: 1462 microversion: 2.1 time: 0.394474 Oct 12 13:23:15.143651 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 213/444] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:14 2022] GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d => generated 1462 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:15.168149 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a76a9eb0-e444-4a0b-9434-8e88e6174aa9 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:15.169458 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a76a9eb0-e444-4a0b-9434-8e88e6174aa9 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] [instance: 03732e0a-4ecf-4659-a7f2-1fb9519a272d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:15.279150 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-a76a9eb0-e444-4a0b-9434-8e88e6174aa9 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259ebdabdff34c40b01cf3545f88aeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd2bdad116244d4a2e0f0057e035817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:15.291893 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a76a9eb0-e444-4a0b-9434-8e88e6174aa9 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] 10.222.0.52 "GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d" status: 200 len: 1213 microversion: 2.1 time: 0.142605 Oct 12 13:23:15.292532 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 214/445] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:15 2022] GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d => generated 1213 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:15.313881 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bb12f1f8-b81d-4a30-b76a-a5759813f49c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:15.314474 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-bb12f1f8-b81d-4a30-b76a-a5759813f49c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 177cff06-72ce-423d-bbe7-9ebcd331d29d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:15.330227 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb12f1f8-b81d-4a30-b76a-a5759813f49c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:15.330726 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb12f1f8-b81d-4a30-b76a-a5759813f49c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:15.331164 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb12f1f8-b81d-4a30-b76a-a5759813f49c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:15.331873 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb12f1f8-b81d-4a30-b76a-a5759813f49c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:15.341333 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb12f1f8-b81d-4a30-b76a-a5759813f49c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:15.341333 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb12f1f8-b81d-4a30-b76a-a5759813f49c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:15.523799 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-dd5c601d-15ed-434a-9572-8318d2f1abb5 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/dedbcd12886a410499e5c3f7f41453d3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.514949 Oct 12 13:23:15.525746 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 232/446] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 12 13:23:15 2022] GET /compute/v2.1/os-quota-sets/dedbcd12886a410499e5c3f7f41453d3/defaults => generated 371 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:15.540774 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-20d837a4-0fb5-4a8e-8b42-20d86995e932 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Action: 'update', calling method: .version_select at 0x7f8aa03213a0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:15.564831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-bb12f1f8-b81d-4a30-b76a-a5759813f49c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8be2878f-116e-4cc5-92ff-7c31c8259a41) Oct 12 13:23:15.564831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:15.564831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:23:15.564831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:23:15.564831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:15.564831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:15.564831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 12 13:23:15.564831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 12 13:23:15.564831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 12 13:23:15.564831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 12 13:23:15.564831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 12 13:23:15.564831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 12 13:23:15.564831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 12 13:23:15.564831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 12 13:23:15.565781 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:23:15.565781 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:23:15.565781 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:23:15.565781 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:23:15.565781 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:23:15.565781 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:23:15.565781 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:15.565781 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:15.565781 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:23:15.565781 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:23:15.565781 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:15.565781 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:15.565781 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:23:15.565781 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:23:15.565781 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:15.565781 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:15.565781 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:23:15.565781 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:23:15.567437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:15.567437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:15.567437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:23:15.567437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:23:15.567437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:23:15.567437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:23:15.567437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:23:15.567437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:23:15.567437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:23:15.567437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:23:15.567437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:23:15.567437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:23:15.567437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:23:15.567437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:23:15.567437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:23:15.567437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:23:15.567437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:23:15.568573 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:23:15.568573 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:23:15.568573 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:23:15.568573 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:23:15.568573 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:23:15.568573 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:23:15.568573 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:23:15.568573 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:23:15.568573 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:23:15.568573 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:23:15.568573 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:23:15.568573 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8be2878f-116e-4cc5-92ff-7c31c8259a41) Oct 12 13:23:15.568573 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:15.568573 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-bb12f1f8-b81d-4a30-b76a-a5759813f49c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:15.570712 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:23:15.581328 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bb12f1f8-b81d-4a30-b76a-a5759813f49c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Request method failure captured: Oct 12 13:23:15.581328 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d/action HTTP/1.1 Oct 12 13:23:15.581328 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:23:15.581328 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:23:15.581328 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:23:15.581328 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 32 Oct 12 13:23:15.581328 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:23:15.581328 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:23:15.581328 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:23:15.581328 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:23:15.581328 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr-Uy7R0-vO84LNBAwxPsssPvLLJJvDLLoKGFa8vBBM7F1Mf1vlFFzFToaRgPGnPKfPfeQQEWDVwjA-kXG2ItKpreMCd93oSqbLTmiWoKKoCe0M_BbZ4_liwNDN0-6wBzZaO_Moy7e6iBmO_tj-vMYydnf_VGtaHbljYhF2p-bsDVq4 Oct 12 13:23:15.581328 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:23:15.581328 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:23:15.581328 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:23:15.581328 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:23:15.581328 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:23:15.581328 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:23:15.581328 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: b92cdc745c654b538146a4a64f5f4b6f Oct 12 13:23:15.581328 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-MigrationsAdminTest-933851851 Oct 12 13:23:15.581328 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:23:15.581328 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:23:15.582582 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b92cdc745c654b538146a4a64f5f4b6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b92cdc745c654b538146a4a64f5f4b6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b92cdc745c654b538146a4a64f5f4b6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b92cdc745c654b538146a4a64f5f4b6f"}]}] Oct 12 13:23:15.582582 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-MigrationsAdminTest-933851851 Oct 12 13:23:15.582582 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: b92cdc745c654b538146a4a64f5f4b6f Oct 12 13:23:15.582582 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-MigrationsAdminTest-933851851 Oct 12 13:23:15.582582 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-MigrationsAdminTest-933851851-project Oct 12 13:23:15.582582 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:23:15.582582 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:23:15.582582 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 0df255f194e54dfb8781b982c2c60a98 Oct 12 13:23:15.582582 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-MigrationsAdminTest-933851851-project Oct 12 13:23:15.582582 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:23:15.582582 n-d-861076-2 devstack@n-api.service[120932]: {"resize": {"flavorRef": "451"}} Oct 12 13:23:15.582582 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:23:15.582582 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:15.583330 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:23:15.583330 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '177cff06-72ce-423d-bbe7-9ebcd331d29d', 'body': {'resize': {'flavorRef': '451'}}} Oct 12 13:23:15.583330 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:23:15.583330 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:15.583330 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:23:15.583330 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:23:15.583330 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:15.583330 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:15.583330 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 12 13:23:15.583330 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 12 13:23:15.583330 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 12 13:23:15.583330 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 12 13:23:15.583330 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 12 13:23:15.583330 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 12 13:23:15.583330 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 12 13:23:15.583330 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 12 13:23:15.583330 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:23:15.583330 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:23:15.583330 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:23:15.585085 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:23:15.585085 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:23:15.585085 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:23:15.585085 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:15.585085 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:15.585085 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:23:15.585085 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:23:15.585085 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:15.585085 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:15.585085 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:23:15.585085 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:23:15.585085 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:15.585085 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:15.585085 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:23:15.585085 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:23:15.585085 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:15.585085 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:15.585085 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:23:15.586119 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:23:15.586119 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:23:15.586119 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:23:15.586119 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:23:15.586119 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:23:15.586119 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:23:15.586119 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:23:15.586119 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:23:15.586119 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:23:15.586119 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:23:15.586119 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:23:15.586119 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:23:15.586119 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:23:15.586119 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:23:15.586119 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:23:15.586119 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:23:15.586119 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:23:15.587483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:23:15.587483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:23:15.587483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:23:15.587483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:23:15.587483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:23:15.587483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:23:15.587483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:23:15.587483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:23:15.587483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8be2878f-116e-4cc5-92ff-7c31c8259a41) Oct 12 13:23:15.587483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:15.587483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:23:15.587483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:15.587483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:15.587483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:23:15.587483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:23:15.587483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:23:15.587483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:23:15.588615 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:23:15.588615 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:23:15.588615 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:15.588615 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:15.588615 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:15.588615 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:23:15.588615 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:15.588615 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:15.588615 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:23:15.588615 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:23:15.588615 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:23:15.588615 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:23:15.588615 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:15.588615 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:15.588615 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:15.588615 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bb12f1f8-b81d-4a30-b76a-a5759813f49c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:15.588615 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:23:15.591173 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bb12f1f8-b81d-4a30-b76a-a5759813f49c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "POST /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d/action" status: 500 len: 214 microversion: 2.1 time: 0.289019 Oct 12 13:23:15.591173 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 215/447] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:23:15 2022] POST /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d/action => generated 214 bytes in 290 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:23:15.617232 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d19496f2-9a22-41c1-a6db-30d4e384231e tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:15.636641 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d19496f2-9a22-41c1-a6db-30d4e384231e tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033907 Oct 12 13:23:15.641416 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 216/448] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:23:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:15.664890 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-60db91b0-ec09-48f0-b0f6-6c6857c1ea65 tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1336250159", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:15.672819 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:15.766193 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-60db91b0-ec09-48f0-b0f6-6c6857c1ea65 tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.115506 Oct 12 13:23:15.768994 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 217/449] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Oct 12 13:23:15 2022] POST /compute/v2.1/flavors => generated 499 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:15.784416 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-87b9c6d4-a576-4399-98dd-5c1854f96e14 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:15.785652 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-87b9c6d4-a576-4399-98dd-5c1854f96e14 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:15.801606 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-87b9c6d4-a576-4399-98dd-5c1854f96e14 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:15.802104 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-87b9c6d4-a576-4399-98dd-5c1854f96e14 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:15.802545 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-87b9c6d4-a576-4399-98dd-5c1854f96e14 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:15.803251 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-87b9c6d4-a576-4399-98dd-5c1854f96e14 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:15.803706 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-87b9c6d4-a576-4399-98dd-5c1854f96e14 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:15.804128 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-87b9c6d4-a576-4399-98dd-5c1854f96e14 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:16.033342 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-20d837a4-0fb5-4a8e-8b42-20d86995e932 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:16.034401 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-20d837a4-0fb5-4a8e-8b42-20d86995e932 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:16.035293 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-20d837a4-0fb5-4a8e-8b42-20d86995e932 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:16.037766 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-20d837a4-0fb5-4a8e-8b42-20d86995e932 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:16.041137 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-20d837a4-0fb5-4a8e-8b42-20d86995e932 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:16.042419 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-20d837a4-0fb5-4a8e-8b42-20d86995e932 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:16.384562 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-87b9c6d4-a576-4399-98dd-5c1854f96e14 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lazy-loading 'services' on Instance uuid d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:16.414001 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-87b9c6d4-a576-4399-98dd-5c1854f96e14 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1929 microversion: 2.75 time: 0.644238 Oct 12 13:23:16.415442 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 218/450] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:15 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1929 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:16.432965 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9a55c59b-3f1f-48d9-aabe-94d53d5bc9da tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:16.446131 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9a55c59b-3f1f-48d9-aabe-94d53d5bc9da tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.023672 Oct 12 13:23:16.456701 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 219/451] 10.222.0.52 () {58 vars in 1182 bytes} [Wed Oct 12 13:23:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:23:16.462071 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0b5086a2-b8e1-49b7-b25a-a66dc0e0e099 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:16.462945 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0b5086a2-b8e1-49b7-b25a-a66dc0e0e099 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] [instance: 03732e0a-4ecf-4659-a7f2-1fb9519a272d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:16.551107 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-0b5086a2-b8e1-49b7-b25a-a66dc0e0e099 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259ebdabdff34c40b01cf3545f88aeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd2bdad116244d4a2e0f0057e035817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:16.561382 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0b5086a2-b8e1-49b7-b25a-a66dc0e0e099 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] 10.222.0.52 "GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d" status: 200 len: 1213 microversion: 2.1 time: 0.103289 Oct 12 13:23:16.562326 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 220/452] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:16 2022] GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d => generated 1213 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:16.713689 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-da6de595-a11e-421f-b700-f99296c133cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-409684723", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:16.797907 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-da6de595-a11e-421f-b700-f99296c133cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] validate_networks() for None {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:23:17.050999 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-da6de595-a11e-421f-b700-f99296c133cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:23:17.051439 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-da6de595-a11e-421f-b700-f99296c133cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:23:17.051907 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-da6de595-a11e-421f-b700-f99296c133cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:23:17.052510 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-da6de595-a11e-421f-b700-f99296c133cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:23:17.052979 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-da6de595-a11e-421f-b700-f99296c133cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:23:17.067921 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-da6de595-a11e-421f-b700-f99296c133cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:17.069638 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-da6de595-a11e-421f-b700-f99296c133cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:17.070258 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-da6de595-a11e-421f-b700-f99296c133cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:17.074179 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-da6de595-a11e-421f-b700-f99296c133cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:17.074658 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-da6de595-a11e-421f-b700-f99296c133cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:17.077519 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-da6de595-a11e-421f-b700-f99296c133cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:17.109182 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-da6de595-a11e-421f-b700-f99296c133cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for project be50900be6b246aa9289de6ec5d366f9. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:23:17.114904 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-da6de595-a11e-421f-b700-f99296c133cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for user a0fd9458bb2842829a1e13ac93fade30 and project be50900be6b246aa9289de6ec5d366f9. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:23:17.121834 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=86,nova_cell0:UPDATE=14 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:17.129205 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-da6de595-a11e-421f-b700-f99296c133cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:23:17.134602 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-da6de595-a11e-421f-b700-f99296c133cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:23:17.247610 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-da6de595-a11e-421f-b700-f99296c133cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683969 Oct 12 13:23:17.248267 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 221/453] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:23:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 13:23:17.253475 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-de80f990-7020-4642-9dd7-1cd61d326c1c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-487722577", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "4a656d45-4a60-44fd-90b4-f33e5a6cecd8"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:17.313383 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-de80f990-7020-4642-9dd7-1cd61d326c1c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] validate_networks() for None {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:23:17.543825 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-20d837a4-0fb5-4a8e-8b42-20d86995e932 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/dedbcd12886a410499e5c3f7f41453d3" status: 200 len: 329 microversion: 2.1 time: 2.008266 Oct 12 13:23:17.550257 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 233/454] 10.222.0.52 () {60 vars in 1263 bytes} [Wed Oct 12 13:23:15 2022] PUT /compute/v2.1/os-quota-sets/dedbcd12886a410499e5c3f7f41453d3 => generated 329 bytes in 2015 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:17.558731 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3e6296d0-7df3-4bc0-ac46-b5527345440b tempest-ServersWithSpecificFlavorTestJSON-1027282137 tempest-ServersWithSpecificFlavorTestJSON-1027282137-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:17.628405 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3e6296d0-7df3-4bc0-ac46-b5527345440b tempest-ServersWithSpecificFlavorTestJSON-1027282137 tempest-ServersWithSpecificFlavorTestJSON-1027282137-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/2131911841" status: 202 len: 0 microversion: 2.1 time: 0.076313 Oct 12 13:23:17.634490 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 234/455] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 12 13:23:17 2022] DELETE /compute/v2.1/flavors/2131911841 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:23:17.641228 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e85f07bd-1571-4554-8a47-66bfa3d3789f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:17.642096 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-e85f07bd-1571-4554-8a47-66bfa3d3789f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:17.723574 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-de80f990-7020-4642-9dd7-1cd61d326c1c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:23:17.724105 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-de80f990-7020-4642-9dd7-1cd61d326c1c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:23:17.724678 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-de80f990-7020-4642-9dd7-1cd61d326c1c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:23:17.725284 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-de80f990-7020-4642-9dd7-1cd61d326c1c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:23:17.725788 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-de80f990-7020-4642-9dd7-1cd61d326c1c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:23:17.735396 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-de80f990-7020-4642-9dd7-1cd61d326c1c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:17.736331 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-de80f990-7020-4642-9dd7-1cd61d326c1c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:17.736932 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-de80f990-7020-4642-9dd7-1cd61d326c1c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:17.737796 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-de80f990-7020-4642-9dd7-1cd61d326c1c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:17.738245 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-de80f990-7020-4642-9dd7-1cd61d326c1c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:17.738930 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-de80f990-7020-4642-9dd7-1cd61d326c1c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:17.757508 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e85f07bd-1571-4554-8a47-66bfa3d3789f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:17.766819 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-de80f990-7020-4642-9dd7-1cd61d326c1c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Getting quotas for project b92cdc745c654b538146a4a64f5f4b6f. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:23:17.773858 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e85f07bd-1571-4554-8a47-66bfa3d3789f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1216 microversion: 2.1 time: 0.137543 Oct 12 13:23:17.775042 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 235/456] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:17 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1216 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:17.781878 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-780d02eb-9245-445e-b8ed-dbb5f1ced881 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:17.782488 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-780d02eb-9245-445e-b8ed-dbb5f1ced881 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:17.792276 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-de80f990-7020-4642-9dd7-1cd61d326c1c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Getting quotas for user 0df255f194e54dfb8781b982c2c60a98 and project b92cdc745c654b538146a4a64f5f4b6f. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:23:17.800406 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-780d02eb-9245-445e-b8ed-dbb5f1ced881 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:17.800406 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-780d02eb-9245-445e-b8ed-dbb5f1ced881 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:17.800406 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-780d02eb-9245-445e-b8ed-dbb5f1ced881 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:17.800715 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-780d02eb-9245-445e-b8ed-dbb5f1ced881 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:17.801156 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-780d02eb-9245-445e-b8ed-dbb5f1ced881 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:17.803706 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-780d02eb-9245-445e-b8ed-dbb5f1ced881 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:17.824644 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-de80f990-7020-4642-9dd7-1cd61d326c1c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:23:17.828284 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-de80f990-7020-4642-9dd7-1cd61d326c1c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:23:17.888842 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-780d02eb-9245-445e-b8ed-dbb5f1ced881 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lazy-loading 'services' on Instance uuid d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:17.922189 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=18,nova_api:DELETE=3 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:17.923765 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-780d02eb-9245-445e-b8ed-dbb5f1ced881 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1929 microversion: 2.75 time: 0.147468 Oct 12 13:23:17.924558 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 236/457] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:17 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1929 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:17.938395 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-94ee4e88-4f68-4c95-bad4-0dbd4e9fdfd7 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Action: 'update', calling method: .version_select at 0x7f8aa03b69d0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:18.040017 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-de80f990-7020-4642-9dd7-1cd61d326c1c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.790358 Oct 12 13:23:18.040948 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 222/458] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:23:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 13:23:18.083091 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b3a23fce-7f4f-47f7-8c44-e0310a1d5ffc tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:18.083729 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b3a23fce-7f4f-47f7-8c44-e0310a1d5ffc tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] [instance: 03732e0a-4ecf-4659-a7f2-1fb9519a272d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:18.105219 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3a23fce-7f4f-47f7-8c44-e0310a1d5ffc tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:18.105972 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3a23fce-7f4f-47f7-8c44-e0310a1d5ffc tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:18.108747 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3a23fce-7f4f-47f7-8c44-e0310a1d5ffc tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:18.109926 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-94ee4e88-4f68-4c95-bad4-0dbd4e9fdfd7 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:18.110077 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3a23fce-7f4f-47f7-8c44-e0310a1d5ffc tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:18.110465 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-94ee4e88-4f68-4c95-bad4-0dbd4e9fdfd7 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:18.111029 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-94ee4e88-4f68-4c95-bad4-0dbd4e9fdfd7 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:18.111148 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3a23fce-7f4f-47f7-8c44-e0310a1d5ffc tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:18.111723 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3a23fce-7f4f-47f7-8c44-e0310a1d5ffc tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:18.115634 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-94ee4e88-4f68-4c95-bad4-0dbd4e9fdfd7 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:18.116095 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-94ee4e88-4f68-4c95-bad4-0dbd4e9fdfd7 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:18.116668 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-94ee4e88-4f68-4c95-bad4-0dbd4e9fdfd7 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:18.224655 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-b3a23fce-7f4f-47f7-8c44-e0310a1d5ffc tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259ebdabdff34c40b01cf3545f88aeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd2bdad116244d4a2e0f0057e035817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:18.236594 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b3a23fce-7f4f-47f7-8c44-e0310a1d5ffc tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] 10.222.0.52 "GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d" status: 200 len: 1273 microversion: 2.1 time: 0.177488 Oct 12 13:23:18.254661 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 223/459] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:18 2022] GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d => generated 1273 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:18.264750 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f1d2d8b5-b6c3-47e4-8ac1-a3f8f461ac68 tempest-ServersWithSpecificFlavorTestJSON-1027282137 tempest-ServersWithSpecificFlavorTestJSON-1027282137-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:18.298841 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f1d2d8b5-b6c3-47e4-8ac1-a3f8f461ac68 tempest-ServersWithSpecificFlavorTestJSON-1027282137 tempest-ServersWithSpecificFlavorTestJSON-1027282137-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5895 microversion: 2.1 time: 0.042889 Oct 12 13:23:18.299955 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 224/460] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:23:18 2022] GET /compute/v2.1/flavors/detail => generated 5895 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:18.322204 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b344182c-c17e-4ba1-9330-c851f824b3df tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:18.322204 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b344182c-c17e-4ba1-9330-c851f824b3df tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:18.392601 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-b344182c-c17e-4ba1-9330-c851f824b3df tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:18.402794 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b344182c-c17e-4ba1-9330-c851f824b3df tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 200 len: 1278 microversion: 2.1 time: 0.100964 Oct 12 13:23:18.410219 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 225/461] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:18 2022] GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 1278 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:18.415715 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0258bbd7-b049-449c-9322-0023822cfa24 tempest-ServersWithSpecificFlavorTestJSON-1027282137 tempest-ServersWithSpecificFlavorTestJSON-1027282137-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:18.543844 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0258bbd7-b049-449c-9322-0023822cfa24 tempest-ServersWithSpecificFlavorTestJSON-1027282137 tempest-ServersWithSpecificFlavorTestJSON-1027282137-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1633196281" status: 202 len: 0 microversion: 2.1 time: 0.132496 Oct 12 13:23:18.544696 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 226/462] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 12 13:23:18 2022] DELETE /compute/v2.1/flavors/1633196281 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:23:18.553205 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8689ca38-9e3f-4e86-bec6-80e50f670b5a tempest-ServersWithSpecificFlavorTestJSON-1027282137 tempest-ServersWithSpecificFlavorTestJSON-1027282137-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:18.574136 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8689ca38-9e3f-4e86-bec6-80e50f670b5a tempest-ServersWithSpecificFlavorTestJSON-1027282137 tempest-ServersWithSpecificFlavorTestJSON-1027282137-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.025111 Oct 12 13:23:18.574906 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 227/463] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:23:18 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:23:18.798634 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-719867be-bf34-48a2-8296-566058dc9e5a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:18.799492 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-719867be-bf34-48a2-8296-566058dc9e5a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:18.817149 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-719867be-bf34-48a2-8296-566058dc9e5a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:18.818001 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-719867be-bf34-48a2-8296-566058dc9e5a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:18.818690 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-719867be-bf34-48a2-8296-566058dc9e5a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:18.819651 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-719867be-bf34-48a2-8296-566058dc9e5a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:18.820264 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-719867be-bf34-48a2-8296-566058dc9e5a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:18.820962 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-719867be-bf34-48a2-8296-566058dc9e5a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:18.956114 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-719867be-bf34-48a2-8296-566058dc9e5a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:18.967101 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-719867be-bf34-48a2-8296-566058dc9e5a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1220 microversion: 2.1 time: 0.172865 Oct 12 13:23:18.969823 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 228/464] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:18 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1220 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:18.987429 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9071fe97-7d57-4a05-be54-cbf446d10b33 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:18.988030 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9071fe97-7d57-4a05-be54-cbf446d10b33 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:19.002486 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9071fe97-7d57-4a05-be54-cbf446d10b33 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:19.004489 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9071fe97-7d57-4a05-be54-cbf446d10b33 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:19.007273 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9071fe97-7d57-4a05-be54-cbf446d10b33 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:19.011626 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9071fe97-7d57-4a05-be54-cbf446d10b33 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:19.012835 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9071fe97-7d57-4a05-be54-cbf446d10b33 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:19.013732 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9071fe97-7d57-4a05-be54-cbf446d10b33 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:19.193079 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-9071fe97-7d57-4a05-be54-cbf446d10b33 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lazy-loading 'services' on Instance uuid d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:19.228475 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9071fe97-7d57-4a05-be54-cbf446d10b33 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1929 microversion: 2.75 time: 0.257470 Oct 12 13:23:19.229632 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 229/465] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:18 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1929 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:19.263929 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c888ff06-3eec-40be-a1b1-a3f70290047b tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:19.264600 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c888ff06-3eec-40be-a1b1-a3f70290047b tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] [instance: 03732e0a-4ecf-4659-a7f2-1fb9519a272d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:19.275562 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c888ff06-3eec-40be-a1b1-a3f70290047b tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:19.276099 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c888ff06-3eec-40be-a1b1-a3f70290047b tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:19.277588 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c888ff06-3eec-40be-a1b1-a3f70290047b tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:19.277588 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c888ff06-3eec-40be-a1b1-a3f70290047b tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:19.277793 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c888ff06-3eec-40be-a1b1-a3f70290047b tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:19.278208 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c888ff06-3eec-40be-a1b1-a3f70290047b tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:19.402384 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c888ff06-3eec-40be-a1b1-a3f70290047b tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259ebdabdff34c40b01cf3545f88aeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd2bdad116244d4a2e0f0057e035817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:19.435052 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c888ff06-3eec-40be-a1b1-a3f70290047b tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] 10.222.0.52 "GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d" status: 200 len: 1271 microversion: 2.1 time: 0.175377 Oct 12 13:23:19.439381 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 230/466] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:19 2022] GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d => generated 1271 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:19.457762 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e0789057-6fec-46f5-8a74-5c43ea1802ec tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:19.460025 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e0789057-6fec-46f5-8a74-5c43ea1802ec tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:19.495495 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0789057-6fec-46f5-8a74-5c43ea1802ec tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:19.500389 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0789057-6fec-46f5-8a74-5c43ea1802ec tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:19.501169 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0789057-6fec-46f5-8a74-5c43ea1802ec tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:19.502229 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0789057-6fec-46f5-8a74-5c43ea1802ec tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:19.503332 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0789057-6fec-46f5-8a74-5c43ea1802ec tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:19.504757 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0789057-6fec-46f5-8a74-5c43ea1802ec tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:19.717319 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-e0789057-6fec-46f5-8a74-5c43ea1802ec tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:19.730779 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e0789057-6fec-46f5-8a74-5c43ea1802ec tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 200 len: 1282 microversion: 2.1 time: 0.289531 Oct 12 13:23:19.733452 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 231/467] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:19 2022] GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 1282 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:19.755756 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=100 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:20.002837 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f6896d92-54e2-435e-a1f7-332074319b4d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:20.004577 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f6896d92-54e2-435e-a1f7-332074319b4d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:20.023865 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f6896d92-54e2-435e-a1f7-332074319b4d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:20.024619 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f6896d92-54e2-435e-a1f7-332074319b4d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:20.025165 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f6896d92-54e2-435e-a1f7-332074319b4d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:20.049731 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f6896d92-54e2-435e-a1f7-332074319b4d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:20.050324 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f6896d92-54e2-435e-a1f7-332074319b4d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:20.050772 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f6896d92-54e2-435e-a1f7-332074319b4d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:20.455934 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f6896d92-54e2-435e-a1f7-332074319b4d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:20.480939 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f6896d92-54e2-435e-a1f7-332074319b4d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1268 microversion: 2.1 time: 0.489581 Oct 12 13:23:20.493029 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 232/468] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:19 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1268 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:23:20.546240 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7bc5532f-fd0f-451d-be65-5b36aad8bdfa tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:20.546870 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7bc5532f-fd0f-451d-be65-5b36aad8bdfa tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:20.578250 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7bc5532f-fd0f-451d-be65-5b36aad8bdfa tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:20.578798 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7bc5532f-fd0f-451d-be65-5b36aad8bdfa tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:20.579948 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-94ee4e88-4f68-4c95-bad4-0dbd4e9fdfd7 tempest-QuotasAdminTestJSON-1974986759 tempest-QuotasAdminTestJSON-1974986759-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/dedbcd12886a410499e5c3f7f41453d3" status: 200 len: 329 microversion: 2.1 time: 2.642870 Oct 12 13:23:20.580570 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 237/469] 10.222.0.52 () {60 vars in 1263 bytes} [Wed Oct 12 13:23:17 2022] PUT /compute/v2.1/os-quota-sets/dedbcd12886a410499e5c3f7f41453d3 => generated 329 bytes in 2656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:20.582768 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7bc5532f-fd0f-451d-be65-5b36aad8bdfa tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:20.584353 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7bc5532f-fd0f-451d-be65-5b36aad8bdfa tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:20.585017 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7bc5532f-fd0f-451d-be65-5b36aad8bdfa tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:20.585459 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7bc5532f-fd0f-451d-be65-5b36aad8bdfa tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:20.628626 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-40113c3c-15c8-4a5e-b0d3-46b44cf6e3d6 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:20.629566 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-40113c3c-15c8-4a5e-b0d3-46b44cf6e3d6 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] [instance: 03732e0a-4ecf-4659-a7f2-1fb9519a272d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:20.655781 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-40113c3c-15c8-4a5e-b0d3-46b44cf6e3d6 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:20.663594 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-40113c3c-15c8-4a5e-b0d3-46b44cf6e3d6 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:20.664381 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-40113c3c-15c8-4a5e-b0d3-46b44cf6e3d6 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:20.671320 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-40113c3c-15c8-4a5e-b0d3-46b44cf6e3d6 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:20.671898 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-40113c3c-15c8-4a5e-b0d3-46b44cf6e3d6 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:20.672352 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-40113c3c-15c8-4a5e-b0d3-46b44cf6e3d6 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:20.849990 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-7bc5532f-fd0f-451d-be65-5b36aad8bdfa tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lazy-loading 'services' on Instance uuid d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:20.888989 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7bc5532f-fd0f-451d-be65-5b36aad8bdfa tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1929 microversion: 2.75 time: 0.400767 Oct 12 13:23:20.894243 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 233/470] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:20 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1929 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:20.904763 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4e66975e-84a9-4f30-95d4-eac5dccc876e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:20.904763 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-4e66975e-84a9-4f30-95d4-eac5dccc876e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:20.938397 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e66975e-84a9-4f30-95d4-eac5dccc876e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:20.939243 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e66975e-84a9-4f30-95d4-eac5dccc876e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:20.941272 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e66975e-84a9-4f30-95d4-eac5dccc876e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:20.942319 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e66975e-84a9-4f30-95d4-eac5dccc876e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:20.946192 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e66975e-84a9-4f30-95d4-eac5dccc876e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:20.948847 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e66975e-84a9-4f30-95d4-eac5dccc876e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:21.243097 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-4e66975e-84a9-4f30-95d4-eac5dccc876e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:21.245706 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=100 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:21.258158 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4e66975e-84a9-4f30-95d4-eac5dccc876e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 200 len: 1330 microversion: 2.1 time: 0.360416 Oct 12 13:23:21.259011 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 234/471] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:20 2022] GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 1330 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:21.504535 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3aa593d5-13d5-46e9-8773-b6d8cf77e95f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:21.505286 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3aa593d5-13d5-46e9-8773-b6d8cf77e95f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:21.514234 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3aa593d5-13d5-46e9-8773-b6d8cf77e95f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:21.514742 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3aa593d5-13d5-46e9-8773-b6d8cf77e95f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:21.515184 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3aa593d5-13d5-46e9-8773-b6d8cf77e95f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:21.530717 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3aa593d5-13d5-46e9-8773-b6d8cf77e95f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:21.530717 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3aa593d5-13d5-46e9-8773-b6d8cf77e95f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:21.530717 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3aa593d5-13d5-46e9-8773-b6d8cf77e95f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:21.785132 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-40113c3c-15c8-4a5e-b0d3-46b44cf6e3d6 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259ebdabdff34c40b01cf3545f88aeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd2bdad116244d4a2e0f0057e035817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:21.801030 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-40113c3c-15c8-4a5e-b0d3-46b44cf6e3d6 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] 10.222.0.52 "GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d" status: 200 len: 1313 microversion: 2.1 time: 1.218741 Oct 12 13:23:21.802178 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 238/472] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:20 2022] GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d => generated 1313 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:21.809533 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-3aa593d5-13d5-46e9-8773-b6d8cf77e95f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:21.828352 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3aa593d5-13d5-46e9-8773-b6d8cf77e95f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1274 microversion: 2.1 time: 0.327035 Oct 12 13:23:21.830869 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 235/473] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:21 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1274 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:23:21.922855 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1c21c445-c2c4-4472-90eb-5ec8e614a998 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:21.923581 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-1c21c445-c2c4-4472-90eb-5ec8e614a998 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:21.931907 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1c21c445-c2c4-4472-90eb-5ec8e614a998 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:21.932411 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1c21c445-c2c4-4472-90eb-5ec8e614a998 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:21.932853 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1c21c445-c2c4-4472-90eb-5ec8e614a998 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:21.933616 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1c21c445-c2c4-4472-90eb-5ec8e614a998 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:21.942339 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1c21c445-c2c4-4472-90eb-5ec8e614a998 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:21.942339 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1c21c445-c2c4-4472-90eb-5ec8e614a998 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:22.193312 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-1c21c445-c2c4-4472-90eb-5ec8e614a998 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lazy-loading 'services' on Instance uuid d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:22.258428 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1c21c445-c2c4-4472-90eb-5ec8e614a998 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1929 microversion: 2.75 time: 0.339528 Oct 12 13:23:22.259437 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 239/474] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:21 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1929 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:22.287266 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-eb2da833-9205-46fc-91e3-2124bdaf0ab0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:22.291122 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-eb2da833-9205-46fc-91e3-2124bdaf0ab0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:22.347070 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eb2da833-9205-46fc-91e3-2124bdaf0ab0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:22.348607 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eb2da833-9205-46fc-91e3-2124bdaf0ab0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:22.350907 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eb2da833-9205-46fc-91e3-2124bdaf0ab0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:22.352036 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eb2da833-9205-46fc-91e3-2124bdaf0ab0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:22.357630 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eb2da833-9205-46fc-91e3-2124bdaf0ab0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:22.357972 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eb2da833-9205-46fc-91e3-2124bdaf0ab0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:22.585794 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-eb2da833-9205-46fc-91e3-2124bdaf0ab0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:22.602899 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-eb2da833-9205-46fc-91e3-2124bdaf0ab0 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 200 len: 1336 microversion: 2.1 time: 0.319823 Oct 12 13:23:22.618301 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 236/475] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:22 2022] GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 1336 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:22.827627 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-bd3e31fc-a880-40db-973d-8f6987247203 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:22.828827 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-bd3e31fc-a880-40db-973d-8f6987247203 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] [instance: 03732e0a-4ecf-4659-a7f2-1fb9519a272d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:22.846616 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bd3e31fc-a880-40db-973d-8f6987247203 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:22.848863 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bd3e31fc-a880-40db-973d-8f6987247203 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:22.849638 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bd3e31fc-a880-40db-973d-8f6987247203 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:22.850552 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bd3e31fc-a880-40db-973d-8f6987247203 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:22.851172 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bd3e31fc-a880-40db-973d-8f6987247203 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:22.853075 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bd3e31fc-a880-40db-973d-8f6987247203 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:22.853903 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-25b2b805-c545-4d5d-9106-1d654dafbb21 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:22.854521 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-25b2b805-c545-4d5d-9106-1d654dafbb21 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:22.867383 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-25b2b805-c545-4d5d-9106-1d654dafbb21 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:22.869844 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-25b2b805-c545-4d5d-9106-1d654dafbb21 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:22.872290 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-25b2b805-c545-4d5d-9106-1d654dafbb21 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:22.873320 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-25b2b805-c545-4d5d-9106-1d654dafbb21 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:22.873978 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-25b2b805-c545-4d5d-9106-1d654dafbb21 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:22.875776 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-25b2b805-c545-4d5d-9106-1d654dafbb21 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:23.111634 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-25b2b805-c545-4d5d-9106-1d654dafbb21 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:23.122599 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-25b2b805-c545-4d5d-9106-1d654dafbb21 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1274 microversion: 2.1 time: 0.272397 Oct 12 13:23:23.133078 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 237/476] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:22 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1274 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:23.290817 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-582f4ec8-eb3c-4a07-884d-165b2caae4fb tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:23.291433 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-582f4ec8-eb3c-4a07-884d-165b2caae4fb tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:23.303940 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-582f4ec8-eb3c-4a07-884d-165b2caae4fb tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:23.304845 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-582f4ec8-eb3c-4a07-884d-165b2caae4fb tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:23.305588 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-582f4ec8-eb3c-4a07-884d-165b2caae4fb tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:23.306449 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-582f4ec8-eb3c-4a07-884d-165b2caae4fb tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:23.309614 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-582f4ec8-eb3c-4a07-884d-165b2caae4fb tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:23.310288 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-582f4ec8-eb3c-4a07-884d-165b2caae4fb tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:23.759566 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-582f4ec8-eb3c-4a07-884d-165b2caae4fb tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lazy-loading 'services' on Instance uuid d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:23.801423 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-582f4ec8-eb3c-4a07-884d-165b2caae4fb tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1929 microversion: 2.75 time: 0.514863 Oct 12 13:23:23.802596 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 238/477] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:23 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1929 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:23.807834 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-28953ffd-d9b5-4aac-8288-1f0f6fe86992 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:23.808734 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-28953ffd-d9b5-4aac-8288-1f0f6fe86992 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:23.816486 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-28953ffd-d9b5-4aac-8288-1f0f6fe86992 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:23.817190 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-28953ffd-d9b5-4aac-8288-1f0f6fe86992 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:23.818327 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-28953ffd-d9b5-4aac-8288-1f0f6fe86992 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:23.819210 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-28953ffd-d9b5-4aac-8288-1f0f6fe86992 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:23.819841 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-28953ffd-d9b5-4aac-8288-1f0f6fe86992 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:23.820435 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-28953ffd-d9b5-4aac-8288-1f0f6fe86992 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:23.826258 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-bd3e31fc-a880-40db-973d-8f6987247203 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259ebdabdff34c40b01cf3545f88aeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd2bdad116244d4a2e0f0057e035817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:23.837807 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-bd3e31fc-a880-40db-973d-8f6987247203 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] 10.222.0.52 "GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d" status: 200 len: 1313 microversion: 2.1 time: 1.013866 Oct 12 13:23:23.842588 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 240/478] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:22 2022] GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d => generated 1313 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:24.152812 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-03393099-0ec1-4f53-b6c6-19e81ad6b36b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:24.153871 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-03393099-0ec1-4f53-b6c6-19e81ad6b36b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:24.176174 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03393099-0ec1-4f53-b6c6-19e81ad6b36b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:24.179627 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03393099-0ec1-4f53-b6c6-19e81ad6b36b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:24.179627 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03393099-0ec1-4f53-b6c6-19e81ad6b36b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:24.179627 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03393099-0ec1-4f53-b6c6-19e81ad6b36b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:24.183566 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03393099-0ec1-4f53-b6c6-19e81ad6b36b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:24.185781 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03393099-0ec1-4f53-b6c6-19e81ad6b36b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:24.409343 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-28953ffd-d9b5-4aac-8288-1f0f6fe86992 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:24.414786 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-03393099-0ec1-4f53-b6c6-19e81ad6b36b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:24.430451 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-28953ffd-d9b5-4aac-8288-1f0f6fe86992 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 200 len: 1378 microversion: 2.1 time: 0.626282 Oct 12 13:23:24.431953 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-03393099-0ec1-4f53-b6c6-19e81ad6b36b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1274 microversion: 2.1 time: 0.287179 Oct 12 13:23:24.432189 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 239/479] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:23 2022] GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 1378 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:24.441770 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 241/480] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:24 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1274 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:23:24.725458 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-61b2f324-e1d1-409f-928f-df23505a3146 req-6d752cda-2111-4b07-ac3d-d9802233d2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03732e0a-4ecf-4659-a7f2-1fb9519a272d", "tag": "d17b79e3-d2ff-4987-9452-de1fc74be819"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:24.750379 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-61b2f324-e1d1-409f-928f-df23505a3146 req-6d752cda-2111-4b07-ac3d-d9802233d2f9 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:24.752766 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-61b2f324-e1d1-409f-928f-df23505a3146 req-6d752cda-2111-4b07-ac3d-d9802233d2f9 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:24.753748 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-61b2f324-e1d1-409f-928f-df23505a3146 req-6d752cda-2111-4b07-ac3d-d9802233d2f9 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:24.790939 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-61b2f324-e1d1-409f-928f-df23505a3146 req-6d752cda-2111-4b07-ac3d-d9802233d2f9 service nova] Creating event network-changed:d17b79e3-d2ff-4987-9452-de1fc74be819 for instance 03732e0a-4ecf-4659-a7f2-1fb9519a272d on n-h2-861076-2 Oct 12 13:23:24.815382 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-61b2f324-e1d1-409f-928f-df23505a3146 req-6d752cda-2111-4b07-ac3d-d9802233d2f9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093912 Oct 12 13:23:24.823328 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 240/481] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:24.837166 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fc9d358c-acfb-489a-8475-43522c08a00d tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:24.838065 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-fc9d358c-acfb-489a-8475-43522c08a00d tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:24.855789 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fc9d358c-acfb-489a-8475-43522c08a00d tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:24.856593 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fc9d358c-acfb-489a-8475-43522c08a00d tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:24.857265 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fc9d358c-acfb-489a-8475-43522c08a00d tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:24.858328 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fc9d358c-acfb-489a-8475-43522c08a00d tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:24.859026 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fc9d358c-acfb-489a-8475-43522c08a00d tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:24.859846 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fc9d358c-acfb-489a-8475-43522c08a00d tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:24.871010 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d4285414-7bd4-48c6-835d-2e4dd12b4c95 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:24.872180 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d4285414-7bd4-48c6-835d-2e4dd12b4c95 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] [instance: 03732e0a-4ecf-4659-a7f2-1fb9519a272d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:24.898754 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d4285414-7bd4-48c6-835d-2e4dd12b4c95 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:24.904318 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d4285414-7bd4-48c6-835d-2e4dd12b4c95 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:24.904318 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d4285414-7bd4-48c6-835d-2e4dd12b4c95 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:24.908790 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d4285414-7bd4-48c6-835d-2e4dd12b4c95 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:24.910317 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d4285414-7bd4-48c6-835d-2e4dd12b4c95 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:24.918542 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d4285414-7bd4-48c6-835d-2e4dd12b4c95 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:25.493647 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-fc9d358c-acfb-489a-8475-43522c08a00d tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lazy-loading 'services' on Instance uuid d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:25.514235 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fc9d358c-acfb-489a-8475-43522c08a00d tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1929 microversion: 2.75 time: 0.683807 Oct 12 13:23:25.514827 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 242/482] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:24 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1929 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:25.546625 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a2014599-c4b2-4189-bf5b-9731f5292780 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:25.555706 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a2014599-c4b2-4189-bf5b-9731f5292780 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:25.569852 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a2014599-c4b2-4189-bf5b-9731f5292780 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:25.570326 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a2014599-c4b2-4189-bf5b-9731f5292780 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:25.570951 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a2014599-c4b2-4189-bf5b-9731f5292780 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:25.571810 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a2014599-c4b2-4189-bf5b-9731f5292780 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:25.572692 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a2014599-c4b2-4189-bf5b-9731f5292780 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:25.573340 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a2014599-c4b2-4189-bf5b-9731f5292780 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:26.089909 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d4285414-7bd4-48c6-835d-2e4dd12b4c95 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259ebdabdff34c40b01cf3545f88aeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd2bdad116244d4a2e0f0057e035817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:26.098096 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d4285414-7bd4-48c6-835d-2e4dd12b4c95 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] 10.222.0.52 "GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d" status: 200 len: 1313 microversion: 2.1 time: 1.234275 Oct 12 13:23:26.102636 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 241/483] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:24 2022] GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d => generated 1313 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:26.107955 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-af37c9f2-fa0d-4c8e-a0e1-c70cb044d4ae tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:26.108568 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-af37c9f2-fa0d-4c8e-a0e1-c70cb044d4ae tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:26.121950 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-af37c9f2-fa0d-4c8e-a0e1-c70cb044d4ae tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:26.122440 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-af37c9f2-fa0d-4c8e-a0e1-c70cb044d4ae tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:26.129705 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-af37c9f2-fa0d-4c8e-a0e1-c70cb044d4ae tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:26.130675 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-af37c9f2-fa0d-4c8e-a0e1-c70cb044d4ae tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:26.133138 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-af37c9f2-fa0d-4c8e-a0e1-c70cb044d4ae tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:26.137320 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-af37c9f2-fa0d-4c8e-a0e1-c70cb044d4ae tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:26.348729 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a2014599-c4b2-4189-bf5b-9731f5292780 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:26.358064 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a2014599-c4b2-4189-bf5b-9731f5292780 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 200 len: 1378 microversion: 2.1 time: 0.824792 Oct 12 13:23:26.359592 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 243/484] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:25 2022] GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 1378 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:26.547022 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0992edb1-138e-4e87-8ca6-831718d924e2 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:26.547865 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-0992edb1-138e-4e87-8ca6-831718d924e2 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:26.554685 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0992edb1-138e-4e87-8ca6-831718d924e2 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:26.555268 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0992edb1-138e-4e87-8ca6-831718d924e2 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:26.555867 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0992edb1-138e-4e87-8ca6-831718d924e2 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:26.556630 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0992edb1-138e-4e87-8ca6-831718d924e2 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:26.557183 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0992edb1-138e-4e87-8ca6-831718d924e2 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:26.557671 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0992edb1-138e-4e87-8ca6-831718d924e2 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:26.852015 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-0992edb1-138e-4e87-8ca6-831718d924e2 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lazy-loading 'services' on Instance uuid d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:26.891645 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0992edb1-138e-4e87-8ca6-831718d924e2 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1929 microversion: 2.75 time: 0.348376 Oct 12 13:23:26.895275 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 244/485] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:26 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1929 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:23:26.900050 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-af37c9f2-fa0d-4c8e-a0e1-c70cb044d4ae tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:26.908837 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-af37c9f2-fa0d-4c8e-a0e1-c70cb044d4ae tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1316 microversion: 2.1 time: 0.804806 Oct 12 13:23:26.926203 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 242/486] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:26 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1316 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:27.130028 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-85750b2d-4215-4b0b-86c7-f5c6b7385a26 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:27.130646 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-85750b2d-4215-4b0b-86c7-f5c6b7385a26 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] [instance: 03732e0a-4ecf-4659-a7f2-1fb9519a272d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:27.142499 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-85750b2d-4215-4b0b-86c7-f5c6b7385a26 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:27.143002 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-85750b2d-4215-4b0b-86c7-f5c6b7385a26 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:27.143443 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-85750b2d-4215-4b0b-86c7-f5c6b7385a26 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:27.144221 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-85750b2d-4215-4b0b-86c7-f5c6b7385a26 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:27.153508 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-85750b2d-4215-4b0b-86c7-f5c6b7385a26 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:27.154010 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-85750b2d-4215-4b0b-86c7-f5c6b7385a26 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:27.382767 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c9388636-94c2-4876-8cab-36d29616aa50 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:27.384205 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c9388636-94c2-4876-8cab-36d29616aa50 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:27.397637 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9388636-94c2-4876-8cab-36d29616aa50 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:27.398682 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9388636-94c2-4876-8cab-36d29616aa50 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:27.399506 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9388636-94c2-4876-8cab-36d29616aa50 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:27.400410 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9388636-94c2-4876-8cab-36d29616aa50 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:27.401524 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9388636-94c2-4876-8cab-36d29616aa50 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:27.405184 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9388636-94c2-4876-8cab-36d29616aa50 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:27.750779 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=8 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:28.143092 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=13 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:28.196838 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-85750b2d-4215-4b0b-86c7-f5c6b7385a26 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259ebdabdff34c40b01cf3545f88aeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd2bdad116244d4a2e0f0057e035817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:28.206894 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-85750b2d-4215-4b0b-86c7-f5c6b7385a26 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] 10.222.0.52 "GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d" status: 200 len: 1313 microversion: 2.1 time: 1.081277 Oct 12 13:23:28.209647 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 245/487] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:27 2022] GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d => generated 1313 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:28.232917 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3805688d-8c26-4bb4-a31f-548ecb451817 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:28.232917 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-3805688d-8c26-4bb4-a31f-548ecb451817 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:28.241906 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3805688d-8c26-4bb4-a31f-548ecb451817 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:28.243685 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3805688d-8c26-4bb4-a31f-548ecb451817 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:28.244397 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3805688d-8c26-4bb4-a31f-548ecb451817 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:28.245578 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3805688d-8c26-4bb4-a31f-548ecb451817 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:28.248404 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3805688d-8c26-4bb4-a31f-548ecb451817 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:28.249267 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3805688d-8c26-4bb4-a31f-548ecb451817 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:28.342823 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c9388636-94c2-4876-8cab-36d29616aa50 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:28.356670 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c9388636-94c2-4876-8cab-36d29616aa50 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 200 len: 1378 microversion: 2.1 time: 0.976097 Oct 12 13:23:28.358678 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 243/488] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:27 2022] GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 1378 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:28.375507 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7e0a80f1-4ea2-47a6-aaeb-e36e410acce6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:28.379496 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7e0a80f1-4ea2-47a6-aaeb-e36e410acce6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:28.393650 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:28.400154 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e0a80f1-4ea2-47a6-aaeb-e36e410acce6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:28.401112 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e0a80f1-4ea2-47a6-aaeb-e36e410acce6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:28.402395 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e0a80f1-4ea2-47a6-aaeb-e36e410acce6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:28.403426 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e0a80f1-4ea2-47a6-aaeb-e36e410acce6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:28.403886 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e0a80f1-4ea2-47a6-aaeb-e36e410acce6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:28.405307 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e0a80f1-4ea2-47a6-aaeb-e36e410acce6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:28.462143 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-3805688d-8c26-4bb4-a31f-548ecb451817 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lazy-loading 'services' on Instance uuid d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:28.494326 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3805688d-8c26-4bb4-a31f-548ecb451817 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1929 microversion: 2.75 time: 0.282032 Oct 12 13:23:28.959970 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 246/489] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:28 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1929 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:28.960188 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=8 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:28.960188 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-7e0a80f1-4ea2-47a6-aaeb-e36e410acce6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:28.960188 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7e0a80f1-4ea2-47a6-aaeb-e36e410acce6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1316 microversion: 2.1 time: 0.413915 Oct 12 13:23:28.960188 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 244/490] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:28 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1316 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:29.233795 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f1ad3102-148d-4a21-b20d-1409dfb7b7d5 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:29.234494 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f1ad3102-148d-4a21-b20d-1409dfb7b7d5 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] [instance: 03732e0a-4ecf-4659-a7f2-1fb9519a272d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:29.248289 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1ad3102-148d-4a21-b20d-1409dfb7b7d5 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:29.248953 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1ad3102-148d-4a21-b20d-1409dfb7b7d5 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:29.249787 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1ad3102-148d-4a21-b20d-1409dfb7b7d5 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:29.251554 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1ad3102-148d-4a21-b20d-1409dfb7b7d5 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:29.252876 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1ad3102-148d-4a21-b20d-1409dfb7b7d5 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:29.263019 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1ad3102-148d-4a21-b20d-1409dfb7b7d5 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:29.312462 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=100 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:29.356658 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-58296d37-c5af-4c62-97f8-7dfb389c996b req-f7944e12-07c3-416c-95ad-6844ca215bcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad899a20-368e-4d9b-908d-4081aabc4e96", "tag": "5e2de395-46bb-4f74-87a2-7ec1e55f5f38"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:29.371554 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-58296d37-c5af-4c62-97f8-7dfb389c996b req-f7944e12-07c3-416c-95ad-6844ca215bcf service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:29.375566 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-58296d37-c5af-4c62-97f8-7dfb389c996b req-f7944e12-07c3-416c-95ad-6844ca215bcf service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:29.375566 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-58296d37-c5af-4c62-97f8-7dfb389c996b req-f7944e12-07c3-416c-95ad-6844ca215bcf service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:29.388951 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-58296d37-c5af-4c62-97f8-7dfb389c996b req-f7944e12-07c3-416c-95ad-6844ca215bcf service nova] Creating event network-changed:5e2de395-46bb-4f74-87a2-7ec1e55f5f38 for instance ad899a20-368e-4d9b-908d-4081aabc4e96 on n-h1-861076-2 Oct 12 13:23:29.400047 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-58296d37-c5af-4c62-97f8-7dfb389c996b req-f7944e12-07c3-416c-95ad-6844ca215bcf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049790 Oct 12 13:23:29.410874 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 245/491] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:23:29.412403 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d5ac147b-f1f4-4410-b7dc-cc9001b9ff3c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:29.413562 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d5ac147b-f1f4-4410-b7dc-cc9001b9ff3c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:29.426873 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d5ac147b-f1f4-4410-b7dc-cc9001b9ff3c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:29.427749 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d5ac147b-f1f4-4410-b7dc-cc9001b9ff3c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:29.429687 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d5ac147b-f1f4-4410-b7dc-cc9001b9ff3c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:29.430657 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d5ac147b-f1f4-4410-b7dc-cc9001b9ff3c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:29.431540 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d5ac147b-f1f4-4410-b7dc-cc9001b9ff3c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:29.432080 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d5ac147b-f1f4-4410-b7dc-cc9001b9ff3c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:30.149768 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f1ad3102-148d-4a21-b20d-1409dfb7b7d5 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259ebdabdff34c40b01cf3545f88aeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd2bdad116244d4a2e0f0057e035817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:30.176123 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f1ad3102-148d-4a21-b20d-1409dfb7b7d5 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] 10.222.0.52 "GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d" status: 200 len: 1313 microversion: 2.1 time: 0.944421 Oct 12 13:23:30.176123 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 247/492] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:29 2022] GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d => generated 1313 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:23:30.178420 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b26eedb1-8449-4a71-8d87-9b95cac57b5c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:30.179027 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-b26eedb1-8449-4a71-8d87-9b95cac57b5c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:30.192068 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b26eedb1-8449-4a71-8d87-9b95cac57b5c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:30.194105 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d5ac147b-f1f4-4410-b7dc-cc9001b9ff3c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:30.198147 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b26eedb1-8449-4a71-8d87-9b95cac57b5c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:30.198602 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b26eedb1-8449-4a71-8d87-9b95cac57b5c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:30.199342 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b26eedb1-8449-4a71-8d87-9b95cac57b5c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:30.199799 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b26eedb1-8449-4a71-8d87-9b95cac57b5c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:30.200219 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b26eedb1-8449-4a71-8d87-9b95cac57b5c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:30.202526 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d5ac147b-f1f4-4410-b7dc-cc9001b9ff3c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 200 len: 1378 microversion: 2.1 time: 0.798983 Oct 12 13:23:30.206267 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 246/493] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:29 2022] GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 1378 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:30.220779 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ed3cc8cc-4cc2-4edd-8002-b121471e0bcb tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:30.221596 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ed3cc8cc-4cc2-4edd-8002-b121471e0bcb tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:30.238699 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ed3cc8cc-4cc2-4edd-8002-b121471e0bcb tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:30.239474 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ed3cc8cc-4cc2-4edd-8002-b121471e0bcb tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:30.240080 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ed3cc8cc-4cc2-4edd-8002-b121471e0bcb tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:30.241039 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ed3cc8cc-4cc2-4edd-8002-b121471e0bcb tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:30.241647 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ed3cc8cc-4cc2-4edd-8002-b121471e0bcb tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:30.242221 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ed3cc8cc-4cc2-4edd-8002-b121471e0bcb tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:30.693134 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=9 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:30.739296 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-ed3cc8cc-4cc2-4edd-8002-b121471e0bcb tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lazy-loading 'services' on Instance uuid d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:30.769251 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ed3cc8cc-4cc2-4edd-8002-b121471e0bcb tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1929 microversion: 2.75 time: 0.561692 Oct 12 13:23:30.776037 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 247/494] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:30 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1929 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:31.083427 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b26eedb1-8449-4a71-8d87-9b95cac57b5c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:31.092811 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b26eedb1-8449-4a71-8d87-9b95cac57b5c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1316 microversion: 2.1 time: 0.917855 Oct 12 13:23:31.095746 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 248/495] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:30 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1316 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:31.194951 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d5aa5c04-546e-4e96-9e28-684b63065005 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:31.195918 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d5aa5c04-546e-4e96-9e28-684b63065005 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] [instance: 03732e0a-4ecf-4659-a7f2-1fb9519a272d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:31.204773 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d5aa5c04-546e-4e96-9e28-684b63065005 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:31.204773 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d5aa5c04-546e-4e96-9e28-684b63065005 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:31.204773 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d5aa5c04-546e-4e96-9e28-684b63065005 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:31.205129 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d5aa5c04-546e-4e96-9e28-684b63065005 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:31.205734 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d5aa5c04-546e-4e96-9e28-684b63065005 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:31.206318 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d5aa5c04-546e-4e96-9e28-684b63065005 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:31.230914 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e5d88bec-5384-4bd5-bf63-473715c4c65c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:31.231812 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-e5d88bec-5384-4bd5-bf63-473715c4c65c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:31.238070 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=14,nova_api:UPDATE=14 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:31.244362 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e5d88bec-5384-4bd5-bf63-473715c4c65c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:31.248164 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e5d88bec-5384-4bd5-bf63-473715c4c65c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:31.248618 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e5d88bec-5384-4bd5-bf63-473715c4c65c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:31.249377 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e5d88bec-5384-4bd5-bf63-473715c4c65c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:31.252350 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e5d88bec-5384-4bd5-bf63-473715c4c65c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:31.252796 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e5d88bec-5384-4bd5-bf63-473715c4c65c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:31.921856 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e5d88bec-5384-4bd5-bf63-473715c4c65c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:31.933445 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d5aa5c04-546e-4e96-9e28-684b63065005 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259ebdabdff34c40b01cf3545f88aeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd2bdad116244d4a2e0f0057e035817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:31.936312 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e5d88bec-5384-4bd5-bf63-473715c4c65c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 200 len: 1378 microversion: 2.1 time: 0.709025 Oct 12 13:23:31.949127 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d5aa5c04-546e-4e96-9e28-684b63065005 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] 10.222.0.52 "GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d" status: 200 len: 1313 microversion: 2.1 time: 0.750661 Oct 12 13:23:31.949127 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 248/496] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:31 2022] GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d => generated 1313 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:31.951554 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 249/497] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:31 2022] GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 1378 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:23:31.960587 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-ea6e59b4-90dc-449b-a702-0e746bea715c req-e7a50c7f-0aad-49f0-bd2d-5336ac14434e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9443e943-93c1-4a5f-aad4-da32545368fa", "tag": "f9aac7ee-1cd4-40d6-ac7b-0a00f2c6da9b"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:31.966896 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f7f3a67d-3504-4ba0-b7e4-5b4a62e33f2e tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:31.970057 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f7f3a67d-3504-4ba0-b7e4-5b4a62e33f2e tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:31.981426 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ea6e59b4-90dc-449b-a702-0e746bea715c req-e7a50c7f-0aad-49f0-bd2d-5336ac14434e service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:31.982419 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ea6e59b4-90dc-449b-a702-0e746bea715c req-e7a50c7f-0aad-49f0-bd2d-5336ac14434e service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:31.985655 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ea6e59b4-90dc-449b-a702-0e746bea715c req-e7a50c7f-0aad-49f0-bd2d-5336ac14434e service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:31.987849 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f7f3a67d-3504-4ba0-b7e4-5b4a62e33f2e tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:31.992087 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f7f3a67d-3504-4ba0-b7e4-5b4a62e33f2e tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:31.993013 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f7f3a67d-3504-4ba0-b7e4-5b4a62e33f2e tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:31.993942 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f7f3a67d-3504-4ba0-b7e4-5b4a62e33f2e tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:31.995612 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f7f3a67d-3504-4ba0-b7e4-5b4a62e33f2e tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:31.997469 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f7f3a67d-3504-4ba0-b7e4-5b4a62e33f2e tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:32.052339 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-ea6e59b4-90dc-449b-a702-0e746bea715c req-e7a50c7f-0aad-49f0-bd2d-5336ac14434e service nova] Creating event network-changed:f9aac7ee-1cd4-40d6-ac7b-0a00f2c6da9b for instance 9443e943-93c1-4a5f-aad4-da32545368fa on n-h1-861076-2 Oct 12 13:23:32.085187 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-ea6e59b4-90dc-449b-a702-0e746bea715c req-e7a50c7f-0aad-49f0-bd2d-5336ac14434e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136558 Oct 12 13:23:32.088033 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 249/498] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:32.119002 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a5d6506f-9063-41ab-b774-de330f10116c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:32.120011 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a5d6506f-9063-41ab-b774-de330f10116c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:32.133224 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a5d6506f-9063-41ab-b774-de330f10116c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:32.144185 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a5d6506f-9063-41ab-b774-de330f10116c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:32.145616 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a5d6506f-9063-41ab-b774-de330f10116c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:32.147433 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a5d6506f-9063-41ab-b774-de330f10116c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:32.147937 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a5d6506f-9063-41ab-b774-de330f10116c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:32.148404 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a5d6506f-9063-41ab-b774-de330f10116c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:32.293588 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-f7f3a67d-3504-4ba0-b7e4-5b4a62e33f2e tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lazy-loading 'services' on Instance uuid d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:32.310535 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f7f3a67d-3504-4ba0-b7e4-5b4a62e33f2e tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1929 microversion: 2.75 time: 0.351510 Oct 12 13:23:32.311120 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 250/499] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:31 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1929 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:32.680457 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-a5d6506f-9063-41ab-b774-de330f10116c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:32.688229 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a5d6506f-9063-41ab-b774-de330f10116c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1316 microversion: 2.1 time: 0.573710 Oct 12 13:23:32.688781 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 250/500] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:32 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1316 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:23:32.966860 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-377a8b2d-6149-4a67-a469-dbd3676518b8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:32.967554 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-377a8b2d-6149-4a67-a469-dbd3676518b8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:32.975696 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1d22ede5-94c0-43b8-8b8a-6a18ba0038db tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:32.977056 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1d22ede5-94c0-43b8-8b8a-6a18ba0038db tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] [instance: 03732e0a-4ecf-4659-a7f2-1fb9519a272d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:32.982664 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-377a8b2d-6149-4a67-a469-dbd3676518b8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:32.988941 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-377a8b2d-6149-4a67-a469-dbd3676518b8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:32.989112 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1d22ede5-94c0-43b8-8b8a-6a18ba0038db tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:32.989222 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-377a8b2d-6149-4a67-a469-dbd3676518b8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:32.989322 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1d22ede5-94c0-43b8-8b8a-6a18ba0038db tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:32.989420 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-377a8b2d-6149-4a67-a469-dbd3676518b8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:32.989520 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1d22ede5-94c0-43b8-8b8a-6a18ba0038db tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:32.989610 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-377a8b2d-6149-4a67-a469-dbd3676518b8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:32.989696 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1d22ede5-94c0-43b8-8b8a-6a18ba0038db tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:32.989782 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-377a8b2d-6149-4a67-a469-dbd3676518b8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:32.989868 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1d22ede5-94c0-43b8-8b8a-6a18ba0038db tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:32.989868 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1d22ede5-94c0-43b8-8b8a-6a18ba0038db tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:33.460825 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-1d22ede5-94c0-43b8-8b8a-6a18ba0038db tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259ebdabdff34c40b01cf3545f88aeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd2bdad116244d4a2e0f0057e035817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:33.463513 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-377a8b2d-6149-4a67-a469-dbd3676518b8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:33.471356 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-377a8b2d-6149-4a67-a469-dbd3676518b8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 200 len: 1378 microversion: 2.1 time: 0.509005 Oct 12 13:23:33.471927 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 251/501] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:32 2022] GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 1378 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:33.472074 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1d22ede5-94c0-43b8-8b8a-6a18ba0038db tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] 10.222.0.52 "GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d" status: 200 len: 1313 microversion: 2.1 time: 0.503780 Oct 12 13:23:33.492497 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-1e9fcfda-85fa-4ec2-874f-466607d8073d req-b502e1da-e92a-4042-84f2-34decc4478cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03732e0a-4ecf-4659-a7f2-1fb9519a272d", "name": "network-vif-plugged", "status": "completed", "tag": "d17b79e3-d2ff-4987-9452-de1fc74be819"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:33.492763 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 251/502] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:32 2022] GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d => generated 1313 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:23:33.500119 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b56ad914-b127-4ab9-926b-2cac0121e523 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:33.502153 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b56ad914-b127-4ab9-926b-2cac0121e523 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:33.512416 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b56ad914-b127-4ab9-926b-2cac0121e523 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:33.512687 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-1e9fcfda-85fa-4ec2-874f-466607d8073d req-b502e1da-e92a-4042-84f2-34decc4478cd service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:33.513231 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-1e9fcfda-85fa-4ec2-874f-466607d8073d req-b502e1da-e92a-4042-84f2-34decc4478cd service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:33.513553 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b56ad914-b127-4ab9-926b-2cac0121e523 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:33.513690 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-1e9fcfda-85fa-4ec2-874f-466607d8073d req-b502e1da-e92a-4042-84f2-34decc4478cd service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:33.514326 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b56ad914-b127-4ab9-926b-2cac0121e523 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:33.515230 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b56ad914-b127-4ab9-926b-2cac0121e523 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:33.515942 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b56ad914-b127-4ab9-926b-2cac0121e523 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:33.516629 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b56ad914-b127-4ab9-926b-2cac0121e523 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:33.537297 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-1e9fcfda-85fa-4ec2-874f-466607d8073d req-b502e1da-e92a-4042-84f2-34decc4478cd service nova] Creating event network-vif-plugged:d17b79e3-d2ff-4987-9452-de1fc74be819 for instance 03732e0a-4ecf-4659-a7f2-1fb9519a272d on n-h2-861076-2 Oct 12 13:23:33.545213 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-1e9fcfda-85fa-4ec2-874f-466607d8073d req-b502e1da-e92a-4042-84f2-34decc4478cd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069534 Oct 12 13:23:33.545816 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 252/503] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:33.613941 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=100 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:33.622015 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-b56ad914-b127-4ab9-926b-2cac0121e523 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lazy-loading 'services' on Instance uuid d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:33.642333 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b56ad914-b127-4ab9-926b-2cac0121e523 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1935 microversion: 2.75 time: 0.149917 Oct 12 13:23:33.642993 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 252/504] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:33 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1935 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:33.712430 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4a082f5e-a0b5-4447-8cf7-0d61cb4c75ac tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:33.727099 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-4a082f5e-a0b5-4447-8cf7-0d61cb4c75ac tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:33.734857 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4a082f5e-a0b5-4447-8cf7-0d61cb4c75ac tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:33.735379 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4a082f5e-a0b5-4447-8cf7-0d61cb4c75ac tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:33.735809 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4a082f5e-a0b5-4447-8cf7-0d61cb4c75ac tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:33.737020 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4a082f5e-a0b5-4447-8cf7-0d61cb4c75ac tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:33.738019 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4a082f5e-a0b5-4447-8cf7-0d61cb4c75ac tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:33.738457 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4a082f5e-a0b5-4447-8cf7-0d61cb4c75ac tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:34.046461 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-4a082f5e-a0b5-4447-8cf7-0d61cb4c75ac tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:34.054935 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4a082f5e-a0b5-4447-8cf7-0d61cb4c75ac tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1316 microversion: 2.1 time: 0.346969 Oct 12 13:23:34.069538 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 253/505] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:33 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1316 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:34.497850 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3151df93-06ed-42d0-9499-a80a19411d8e tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:34.499005 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-3151df93-06ed-42d0-9499-a80a19411d8e tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] [instance: 03732e0a-4ecf-4659-a7f2-1fb9519a272d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:34.502130 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fb0e0ac7-1bb9-445b-8c61-f55184b5ca96 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:34.504764 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fb0e0ac7-1bb9-445b-8c61-f55184b5ca96 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:34.522532 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3151df93-06ed-42d0-9499-a80a19411d8e tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:34.522532 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3151df93-06ed-42d0-9499-a80a19411d8e tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:34.522532 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3151df93-06ed-42d0-9499-a80a19411d8e tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:34.522532 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3151df93-06ed-42d0-9499-a80a19411d8e tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:34.522875 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3151df93-06ed-42d0-9499-a80a19411d8e tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:34.522875 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3151df93-06ed-42d0-9499-a80a19411d8e tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:34.530722 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fb0e0ac7-1bb9-445b-8c61-f55184b5ca96 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:34.531770 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fb0e0ac7-1bb9-445b-8c61-f55184b5ca96 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:34.534819 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fb0e0ac7-1bb9-445b-8c61-f55184b5ca96 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:34.536567 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fb0e0ac7-1bb9-445b-8c61-f55184b5ca96 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:34.537080 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fb0e0ac7-1bb9-445b-8c61-f55184b5ca96 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:34.538596 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fb0e0ac7-1bb9-445b-8c61-f55184b5ca96 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:34.905422 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-fb0e0ac7-1bb9-445b-8c61-f55184b5ca96 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:34.921212 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fb0e0ac7-1bb9-445b-8c61-f55184b5ca96 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 200 len: 1378 microversion: 2.1 time: 0.427652 Oct 12 13:23:34.921847 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 253/506] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:34 2022] GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 1378 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:34.949066 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-55f85c72-2edb-459a-afe1-7403e42a4b86 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:34.950569 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-55f85c72-2edb-459a-afe1-7403e42a4b86 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:34.967157 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-3151df93-06ed-42d0-9499-a80a19411d8e tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259ebdabdff34c40b01cf3545f88aeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd2bdad116244d4a2e0f0057e035817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:34.975810 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-55f85c72-2edb-459a-afe1-7403e42a4b86 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:34.979773 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-55f85c72-2edb-459a-afe1-7403e42a4b86 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:34.980501 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-55f85c72-2edb-459a-afe1-7403e42a4b86 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:34.982482 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-55f85c72-2edb-459a-afe1-7403e42a4b86 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:34.985140 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-55f85c72-2edb-459a-afe1-7403e42a4b86 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:34.988123 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3151df93-06ed-42d0-9499-a80a19411d8e tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] 10.222.0.52 "GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d" status: 200 len: 1313 microversion: 2.1 time: 0.494558 Oct 12 13:23:34.988850 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-55f85c72-2edb-459a-afe1-7403e42a4b86 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:34.997969 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 254/507] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:34 2022] GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:23:35.080003 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-51800bd2-2576-4f2d-9670-c258753864d2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:35.080627 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-51800bd2-2576-4f2d-9670-c258753864d2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:35.106966 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-51800bd2-2576-4f2d-9670-c258753864d2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:35.107615 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-51800bd2-2576-4f2d-9670-c258753864d2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:35.108077 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-51800bd2-2576-4f2d-9670-c258753864d2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:35.108764 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-51800bd2-2576-4f2d-9670-c258753864d2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:35.109277 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-51800bd2-2576-4f2d-9670-c258753864d2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:35.111486 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-51800bd2-2576-4f2d-9670-c258753864d2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:35.172515 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-55f85c72-2edb-459a-afe1-7403e42a4b86 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lazy-loading 'services' on Instance uuid d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:35.206636 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-55f85c72-2edb-459a-afe1-7403e42a4b86 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1935 microversion: 2.75 time: 0.280295 Oct 12 13:23:35.207984 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 254/508] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:34 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1935 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:35.539982 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-51800bd2-2576-4f2d-9670-c258753864d2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:35.549051 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-51800bd2-2576-4f2d-9670-c258753864d2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1316 microversion: 2.1 time: 0.473537 Oct 12 13:23:35.556492 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 255/509] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:35 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1316 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:35.947498 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fe3abd43-a6b5-493c-a01e-20d1447a5784 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:35.948306 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fe3abd43-a6b5-493c-a01e-20d1447a5784 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:35.955694 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe3abd43-a6b5-493c-a01e-20d1447a5784 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:35.956184 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe3abd43-a6b5-493c-a01e-20d1447a5784 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:35.956613 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe3abd43-a6b5-493c-a01e-20d1447a5784 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:35.957348 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe3abd43-a6b5-493c-a01e-20d1447a5784 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:35.957797 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe3abd43-a6b5-493c-a01e-20d1447a5784 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:35.958217 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe3abd43-a6b5-493c-a01e-20d1447a5784 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:36.020422 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-152357f3-4a17-470e-b964-3ebc65cc6d79 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:36.023856 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-152357f3-4a17-470e-b964-3ebc65cc6d79 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] [instance: 03732e0a-4ecf-4659-a7f2-1fb9519a272d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:36.027589 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-152357f3-4a17-470e-b964-3ebc65cc6d79 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:36.028358 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-152357f3-4a17-470e-b964-3ebc65cc6d79 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:36.029016 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-152357f3-4a17-470e-b964-3ebc65cc6d79 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:36.029939 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-152357f3-4a17-470e-b964-3ebc65cc6d79 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:36.030603 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-152357f3-4a17-470e-b964-3ebc65cc6d79 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:36.031243 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-152357f3-4a17-470e-b964-3ebc65cc6d79 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:36.218595 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-fe3abd43-a6b5-493c-a01e-20d1447a5784 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:36.229621 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fe3abd43-a6b5-493c-a01e-20d1447a5784 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 200 len: 1378 microversion: 2.1 time: 0.286143 Oct 12 13:23:36.247596 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 255/510] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:35 2022] GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 1378 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:36.254971 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9142ee1d-04bb-410f-8a31-972a88d69504 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:36.262057 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9142ee1d-04bb-410f-8a31-972a88d69504 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:36.273619 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9142ee1d-04bb-410f-8a31-972a88d69504 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:36.274382 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9142ee1d-04bb-410f-8a31-972a88d69504 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:36.274997 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9142ee1d-04bb-410f-8a31-972a88d69504 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:36.277191 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9142ee1d-04bb-410f-8a31-972a88d69504 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:36.277191 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9142ee1d-04bb-410f-8a31-972a88d69504 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:36.277191 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9142ee1d-04bb-410f-8a31-972a88d69504 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:36.339297 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-152357f3-4a17-470e-b964-3ebc65cc6d79 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259ebdabdff34c40b01cf3545f88aeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd2bdad116244d4a2e0f0057e035817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:36.347940 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-152357f3-4a17-470e-b964-3ebc65cc6d79 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] 10.222.0.52 "GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d" status: 200 len: 1313 microversion: 2.1 time: 0.332016 Oct 12 13:23:36.349133 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 256/511] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:36 2022] GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:23:36.381195 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-9142ee1d-04bb-410f-8a31-972a88d69504 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lazy-loading 'services' on Instance uuid d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:36.399173 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9142ee1d-04bb-410f-8a31-972a88d69504 tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1935 microversion: 2.75 time: 0.147795 Oct 12 13:23:36.400196 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 256/512] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:36 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1935 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:36.580044 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f10eeb11-2d0a-479c-8853-f829f9b0a51d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:36.581624 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f10eeb11-2d0a-479c-8853-f829f9b0a51d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:36.589170 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f10eeb11-2d0a-479c-8853-f829f9b0a51d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:36.590035 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f10eeb11-2d0a-479c-8853-f829f9b0a51d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:36.590661 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f10eeb11-2d0a-479c-8853-f829f9b0a51d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:36.592340 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f10eeb11-2d0a-479c-8853-f829f9b0a51d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:36.594038 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f10eeb11-2d0a-479c-8853-f829f9b0a51d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:36.594838 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f10eeb11-2d0a-479c-8853-f829f9b0a51d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:36.870370 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f10eeb11-2d0a-479c-8853-f829f9b0a51d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:36.883852 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f10eeb11-2d0a-479c-8853-f829f9b0a51d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1316 microversion: 2.1 time: 0.307528 Oct 12 13:23:36.884772 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 257/513] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:36 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1316 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:37.259670 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8379086b-0cc5-4b02-b057-2c103ab5538b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:37.259670 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8379086b-0cc5-4b02-b057-2c103ab5538b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:37.266319 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-96c83bb4-8b79-4e8f-983d-22dde905b074 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa03213a0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:37.286761 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8379086b-0cc5-4b02-b057-2c103ab5538b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:37.287526 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8379086b-0cc5-4b02-b057-2c103ab5538b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:37.289512 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8379086b-0cc5-4b02-b057-2c103ab5538b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:37.292555 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8379086b-0cc5-4b02-b057-2c103ab5538b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:37.295207 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8379086b-0cc5-4b02-b057-2c103ab5538b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:37.296214 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8379086b-0cc5-4b02-b057-2c103ab5538b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:37.347810 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-96c83bb4-8b79-4e8f-983d-22dde905b074 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/cc6f4315-2e6b-4487-a0a7-0da1bcd0e1a3" status: 200 len: 662 microversion: 2.1 time: 0.084940 Oct 12 13:23:37.349140 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 258/514] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:23:37 2022] GET /compute/v2.1/images/cc6f4315-2e6b-4487-a0a7-0da1bcd0e1a3 => generated 662 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:37.362850 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-86a1fcb1-8f89-41ae-9c30-621110f17843 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa02bde50>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:37.435682 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-86a1fcb1-8f89-41ae-9c30-621110f17843 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/cc6f4315-2e6b-4487-a0a7-0da1bcd0e1a3" status: 200 len: 662 microversion: 2.1 time: 0.076642 Oct 12 13:23:37.436502 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 259/515] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:23:37 2022] GET /compute/v2.1/images/cc6f4315-2e6b-4487-a0a7-0da1bcd0e1a3 => generated 662 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:37.441301 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-53f1708d-4006-4b94-ba4e-b9e3586e471c tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:37.442030 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-53f1708d-4006-4b94-ba4e-b9e3586e471c tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] [instance: 03732e0a-4ecf-4659-a7f2-1fb9519a272d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:37.457753 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-53f1708d-4006-4b94-ba4e-b9e3586e471c tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:37.457753 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-53f1708d-4006-4b94-ba4e-b9e3586e471c tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:37.457982 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-53f1708d-4006-4b94-ba4e-b9e3586e471c tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:37.458736 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-53f1708d-4006-4b94-ba4e-b9e3586e471c tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:37.459206 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-53f1708d-4006-4b94-ba4e-b9e3586e471c tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:37.459639 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-53f1708d-4006-4b94-ba4e-b9e3586e471c tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:37.832368 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8379086b-0cc5-4b02-b057-2c103ab5538b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:37.839044 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-53f1708d-4006-4b94-ba4e-b9e3586e471c tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259ebdabdff34c40b01cf3545f88aeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd2bdad116244d4a2e0f0057e035817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:37.846584 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8379086b-0cc5-4b02-b057-2c103ab5538b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 200 len: 1378 microversion: 2.1 time: 0.593580 Oct 12 13:23:37.847547 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-53f1708d-4006-4b94-ba4e-b9e3586e471c tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] 10.222.0.52 "GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d" status: 200 len: 1313 microversion: 2.1 time: 0.409883 Oct 12 13:23:37.850660 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 260/516] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:37 2022] GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d => generated 1313 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:37.852319 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 257/517] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:37 2022] GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 1378 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:37.869269 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-468374cc-a9c7-4419-b338-d3845379fc8a tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:37.870131 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-468374cc-a9c7-4419-b338-d3845379fc8a tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:37.878551 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-468374cc-a9c7-4419-b338-d3845379fc8a tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:37.879278 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-468374cc-a9c7-4419-b338-d3845379fc8a tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:37.879902 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-468374cc-a9c7-4419-b338-d3845379fc8a tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:37.880771 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-468374cc-a9c7-4419-b338-d3845379fc8a tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:37.881675 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-468374cc-a9c7-4419-b338-d3845379fc8a tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:37.882248 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-468374cc-a9c7-4419-b338-d3845379fc8a tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:37.913783 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9b5b80db-b383-4c12-a606-5f26a0447c1e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:37.915863 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9b5b80db-b383-4c12-a606-5f26a0447c1e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:37.930017 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b5b80db-b383-4c12-a606-5f26a0447c1e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:37.930843 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b5b80db-b383-4c12-a606-5f26a0447c1e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:37.931445 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b5b80db-b383-4c12-a606-5f26a0447c1e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:37.932422 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b5b80db-b383-4c12-a606-5f26a0447c1e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:37.933096 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b5b80db-b383-4c12-a606-5f26a0447c1e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:37.933699 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b5b80db-b383-4c12-a606-5f26a0447c1e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:38.150470 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-468374cc-a9c7-4419-b338-d3845379fc8a tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] Lazy-loading 'services' on Instance uuid d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:38.188887 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-468374cc-a9c7-4419-b338-d3845379fc8a tempest-ServersAdmin275Test-480091644 tempest-ServersAdmin275Test-480091644-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1920 microversion: 2.75 time: 0.333719 Oct 12 13:23:38.192963 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 261/518] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:37 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1920 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:38.232239 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4bffe5e9-d96a-460d-88c9-9af90765dd48 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:38.234023 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-4bffe5e9-d96a-460d-88c9-9af90765dd48 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:38.242608 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4bffe5e9-d96a-460d-88c9-9af90765dd48 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:38.246721 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4bffe5e9-d96a-460d-88c9-9af90765dd48 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:38.247359 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4bffe5e9-d96a-460d-88c9-9af90765dd48 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:38.248267 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4bffe5e9-d96a-460d-88c9-9af90765dd48 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:38.248880 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4bffe5e9-d96a-460d-88c9-9af90765dd48 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:38.250339 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4bffe5e9-d96a-460d-88c9-9af90765dd48 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:38.283624 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-4bffe5e9-d96a-460d-88c9-9af90765dd48 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Going to try to terminate instance {{(pid=120933) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:23:38.532606 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-9b5b80db-b383-4c12-a606-5f26a0447c1e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:38.551266 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9b5b80db-b383-4c12-a606-5f26a0447c1e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1316 microversion: 2.1 time: 0.644857 Oct 12 13:23:38.553022 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 258/519] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:37 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1316 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:38.669734 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4bffe5e9-d96a-460d-88c9-9af90765dd48 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 204 len: 0 microversion: 2.75 time: 0.440917 Oct 12 13:23:38.673329 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 262/520] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 12 13:23:38 2022] DELETE /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 13:23:38.680053 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8e18a748-c18c-4265-83a7-6a9df92b1077 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:38.680707 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8e18a748-c18c-4265-83a7-6a9df92b1077 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:38.692869 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8e18a748-c18c-4265-83a7-6a9df92b1077 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:38.696225 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8e18a748-c18c-4265-83a7-6a9df92b1077 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:38.696971 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8e18a748-c18c-4265-83a7-6a9df92b1077 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:38.698261 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8e18a748-c18c-4265-83a7-6a9df92b1077 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:38.698755 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8e18a748-c18c-4265-83a7-6a9df92b1077 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:38.699191 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8e18a748-c18c-4265-83a7-6a9df92b1077 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:38.881421 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a8f54a2a-c441-450f-bb59-b014eef92d38 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:38.882426 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a8f54a2a-c441-450f-bb59-b014eef92d38 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] [instance: 03732e0a-4ecf-4659-a7f2-1fb9519a272d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:38.902040 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a8f54a2a-c441-450f-bb59-b014eef92d38 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:38.902812 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a8f54a2a-c441-450f-bb59-b014eef92d38 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:38.903463 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a8f54a2a-c441-450f-bb59-b014eef92d38 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:38.904374 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a8f54a2a-c441-450f-bb59-b014eef92d38 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:38.905043 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a8f54a2a-c441-450f-bb59-b014eef92d38 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:38.907462 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a8f54a2a-c441-450f-bb59-b014eef92d38 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:39.027429 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8e18a748-c18c-4265-83a7-6a9df92b1077 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:39.042549 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8e18a748-c18c-4265-83a7-6a9df92b1077 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:39.044185 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8e18a748-c18c-4265-83a7-6a9df92b1077 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:39.055787 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8e18a748-c18c-4265-83a7-6a9df92b1077 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1444 microversion: 2.75 time: 0.379357 Oct 12 13:23:39.057839 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 259/521] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:38 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1444 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:39.063145 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-468c40bf-eca0-4681-88cd-bc58b3517a06 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:39.064708 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-468c40bf-eca0-4681-88cd-bc58b3517a06 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:39.071887 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-468c40bf-eca0-4681-88cd-bc58b3517a06 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:39.072522 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-468c40bf-eca0-4681-88cd-bc58b3517a06 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:39.083918 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-468c40bf-eca0-4681-88cd-bc58b3517a06 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:39.085094 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-468c40bf-eca0-4681-88cd-bc58b3517a06 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:39.085766 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-468c40bf-eca0-4681-88cd-bc58b3517a06 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:39.086416 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-468c40bf-eca0-4681-88cd-bc58b3517a06 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:39.611409 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a8f54a2a-c441-450f-bb59-b014eef92d38 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259ebdabdff34c40b01cf3545f88aeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd2bdad116244d4a2e0f0057e035817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:39.628441 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a8f54a2a-c441-450f-bb59-b014eef92d38 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] 10.222.0.52 "GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d" status: 200 len: 1463 microversion: 2.1 time: 0.748284 Oct 12 13:23:39.629289 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 263/522] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:38 2022] GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d => generated 1463 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:23:39.636550 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c9040733-55a2-4865-bdf2-ca31e42c809d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:39.641803 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c9040733-55a2-4865-bdf2-ca31e42c809d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:39.654894 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c9040733-55a2-4865-bdf2-ca31e42c809d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:39.656671 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c9040733-55a2-4865-bdf2-ca31e42c809d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:39.657838 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c9040733-55a2-4865-bdf2-ca31e42c809d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:39.658560 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c9040733-55a2-4865-bdf2-ca31e42c809d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:39.659027 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c9040733-55a2-4865-bdf2-ca31e42c809d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:39.659451 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c9040733-55a2-4865-bdf2-ca31e42c809d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:39.678774 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:39.698220 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-468c40bf-eca0-4681-88cd-bc58b3517a06 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:39.708401 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-468c40bf-eca0-4681-88cd-bc58b3517a06 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 200 len: 1378 microversion: 2.1 time: 0.649614 Oct 12 13:23:39.709998 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 260/523] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:39 2022] GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 1378 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:39.714750 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-96e2c204-7ec9-48e6-8bb0-91764a48b689 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bd46280>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:39.774266 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-96e2c204-7ec9-48e6-8bb0-91764a48b689 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/f6fd2fb8-d410-4738-bc3c-050f993fb3b6" status: 200 len: 662 microversion: 2.1 time: 0.062936 Oct 12 13:23:39.774797 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 261/524] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:23:39 2022] GET /compute/v2.1/images/f6fd2fb8-d410-4738-bc3c-050f993fb3b6 => generated 662 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:40.020734 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-c9040733-55a2-4865-bdf2-ca31e42c809d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:40.030232 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c9040733-55a2-4865-bdf2-ca31e42c809d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1316 microversion: 2.1 time: 0.398861 Oct 12 13:23:40.034774 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 264/525] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:39 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1316 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:40.048746 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2c545892-c945-443a-80c6-f66734986cf5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa038cd30>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:40.134280 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2c545892-c945-443a-80c6-f66734986cf5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/f6fd2fb8-d410-4738-bc3c-050f993fb3b6" status: 200 len: 662 microversion: 2.1 time: 0.097987 Oct 12 13:23:40.148739 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 265/526] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:23:40 2022] GET /compute/v2.1/images/f6fd2fb8-d410-4738-bc3c-050f993fb3b6 => generated 662 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:40.157185 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-084f5c39-d8b3-459c-8eb3-ad73a23f5e11 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:40.157185 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-084f5c39-d8b3-459c-8eb3-ad73a23f5e11 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:40.162164 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-084f5c39-d8b3-459c-8eb3-ad73a23f5e11 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:40.163149 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-084f5c39-d8b3-459c-8eb3-ad73a23f5e11 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:40.164112 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-084f5c39-d8b3-459c-8eb3-ad73a23f5e11 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:40.165102 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-084f5c39-d8b3-459c-8eb3-ad73a23f5e11 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:40.165838 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-084f5c39-d8b3-459c-8eb3-ad73a23f5e11 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:40.166523 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-084f5c39-d8b3-459c-8eb3-ad73a23f5e11 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:40.237060 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bfce2be4-5dd8-4f59-8b7e-223210b8673a tempest-TenantUsagesTestJSON-1128020237 tempest-TenantUsagesTestJSON-1128020237-project-admin] Calling method '.version_select at 0x7f8a9bd05af0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:40.275582 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bfce2be4-5dd8-4f59-8b7e-223210b8673a tempest-TenantUsagesTestJSON-1128020237 tempest-TenantUsagesTestJSON-1128020237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:40.276335 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bfce2be4-5dd8-4f59-8b7e-223210b8673a tempest-TenantUsagesTestJSON-1128020237 tempest-TenantUsagesTestJSON-1128020237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:40.277017 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bfce2be4-5dd8-4f59-8b7e-223210b8673a tempest-TenantUsagesTestJSON-1128020237 tempest-TenantUsagesTestJSON-1128020237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:40.307167 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-084f5c39-d8b3-459c-8eb3-ad73a23f5e11 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:40.318757 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-084f5c39-d8b3-459c-8eb3-ad73a23f5e11 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:40.320566 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-084f5c39-d8b3-459c-8eb3-ad73a23f5e11 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:40.325257 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bfce2be4-5dd8-4f59-8b7e-223210b8673a tempest-TenantUsagesTestJSON-1128020237 tempest-TenantUsagesTestJSON-1128020237-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:40.325754 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bfce2be4-5dd8-4f59-8b7e-223210b8673a tempest-TenantUsagesTestJSON-1128020237 tempest-TenantUsagesTestJSON-1128020237-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:40.326208 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bfce2be4-5dd8-4f59-8b7e-223210b8673a tempest-TenantUsagesTestJSON-1128020237 tempest-TenantUsagesTestJSON-1128020237-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:40.328316 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-084f5c39-d8b3-459c-8eb3-ad73a23f5e11 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1444 microversion: 2.75 time: 0.178320 Oct 12 13:23:40.329541 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 266/527] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:40 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1444 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:40.367252 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bfce2be4-5dd8-4f59-8b7e-223210b8673a tempest-TenantUsagesTestJSON-1128020237 tempest-TenantUsagesTestJSON-1128020237-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/6bd2bdad116244d4a2e0f0057e035817?start=2022-10-11T13%3A23%3A39.646957&end=2022-10-13T13%3A23%3A39.646957" status: 200 len: 650 microversion: 2.1 time: 0.591271 Oct 12 13:23:40.367857 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 262/528] 10.222.0.52 () {58 vars in 1412 bytes} [Wed Oct 12 13:23:39 2022] GET /compute/v2.1/os-simple-tenant-usage/6bd2bdad116244d4a2e0f0057e035817?start=2022-10-11T13%3A23%3A39.646957&end=2022-10-13T13%3A23%3A39.646957 => generated 650 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:40.385082 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-29b4323c-855a-4702-a7f8-c888e0177945 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Calling method '.version_select at 0x7f8aa03001f0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:40.404424 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-29b4323c-855a-4702-a7f8-c888e0177945 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:40.407767 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-29b4323c-855a-4702-a7f8-c888e0177945 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:40.408246 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-29b4323c-855a-4702-a7f8-c888e0177945 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:40.454018 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-29b4323c-855a-4702-a7f8-c888e0177945 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:40.458671 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-29b4323c-855a-4702-a7f8-c888e0177945 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:40.460149 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-29b4323c-855a-4702-a7f8-c888e0177945 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:40.480101 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-29b4323c-855a-4702-a7f8-c888e0177945 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/6bd2bdad116244d4a2e0f0057e035817?start=2022-10-11T13%3A23%3A39.646957&end=2022-10-13T13%3A23%3A39.646957" status: 200 len: 694 microversion: 2.1 time: 0.099472 Oct 12 13:23:40.481261 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 267/529] 10.222.0.52 () {58 vars in 1412 bytes} [Wed Oct 12 13:23:40 2022] GET /compute/v2.1/os-simple-tenant-usage/6bd2bdad116244d4a2e0f0057e035817?start=2022-10-11T13%3A23%3A39.646957&end=2022-10-13T13%3A23%3A39.646957 => generated 694 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:23:40.500097 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f5df4d02-4a42-40b2-8a43-601e95c318bf tempest-TenantUsagesTestJSON-1128020237 tempest-TenantUsagesTestJSON-1128020237-project-admin] Calling method '.version_select at 0x7f8a9be5ff70>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:40.511331 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f5df4d02-4a42-40b2-8a43-601e95c318bf tempest-TenantUsagesTestJSON-1128020237 tempest-TenantUsagesTestJSON-1128020237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:40.511826 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f5df4d02-4a42-40b2-8a43-601e95c318bf tempest-TenantUsagesTestJSON-1128020237 tempest-TenantUsagesTestJSON-1128020237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:40.512440 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f5df4d02-4a42-40b2-8a43-601e95c318bf tempest-TenantUsagesTestJSON-1128020237 tempest-TenantUsagesTestJSON-1128020237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:40.556116 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f5df4d02-4a42-40b2-8a43-601e95c318bf tempest-TenantUsagesTestJSON-1128020237 tempest-TenantUsagesTestJSON-1128020237-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:40.558167 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f5df4d02-4a42-40b2-8a43-601e95c318bf tempest-TenantUsagesTestJSON-1128020237 tempest-TenantUsagesTestJSON-1128020237-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:40.559497 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f5df4d02-4a42-40b2-8a43-601e95c318bf tempest-TenantUsagesTestJSON-1128020237 tempest-TenantUsagesTestJSON-1128020237-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:40.591174 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f5df4d02-4a42-40b2-8a43-601e95c318bf tempest-TenantUsagesTestJSON-1128020237 tempest-TenantUsagesTestJSON-1128020237-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-11T13%3A23%3A39.646957&end=2022-10-13T13%3A23%3A39.646957&detailed=1" status: 200 len: 3113 microversion: 2.1 time: 0.095366 Oct 12 13:23:40.592158 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 263/530] 10.222.0.52 () {58 vars in 1335 bytes} [Wed Oct 12 13:23:40 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-11T13%3A23%3A39.646957&end=2022-10-13T13%3A23%3A39.646957&detailed=1 => generated 3113 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:40.609846 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-14865c28-6cee-4afa-8b9e-da2f192666e8 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:40.610545 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-14865c28-6cee-4afa-8b9e-da2f192666e8 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] [instance: 03732e0a-4ecf-4659-a7f2-1fb9519a272d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:40.616798 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-14865c28-6cee-4afa-8b9e-da2f192666e8 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:40.617328 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-14865c28-6cee-4afa-8b9e-da2f192666e8 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:40.617990 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-14865c28-6cee-4afa-8b9e-da2f192666e8 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:40.618842 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-14865c28-6cee-4afa-8b9e-da2f192666e8 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:40.619442 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-14865c28-6cee-4afa-8b9e-da2f192666e8 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:40.620049 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-14865c28-6cee-4afa-8b9e-da2f192666e8 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:40.650617 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-14865c28-6cee-4afa-8b9e-da2f192666e8 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] [instance: 03732e0a-4ecf-4659-a7f2-1fb9519a272d] Going to try to terminate instance {{(pid=120933) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:23:40.732487 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a6513ba4-6bb4-4ee6-ba43-bd29f98ad2e4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:40.733262 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a6513ba4-6bb4-4ee6-ba43-bd29f98ad2e4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:40.742745 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a6513ba4-6bb4-4ee6-ba43-bd29f98ad2e4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:40.748189 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a6513ba4-6bb4-4ee6-ba43-bd29f98ad2e4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:40.748882 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a6513ba4-6bb4-4ee6-ba43-bd29f98ad2e4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:40.749574 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a6513ba4-6bb4-4ee6-ba43-bd29f98ad2e4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:40.750053 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a6513ba4-6bb4-4ee6-ba43-bd29f98ad2e4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:40.750477 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a6513ba4-6bb4-4ee6-ba43-bd29f98ad2e4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:41.047359 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-14865c28-6cee-4afa-8b9e-da2f192666e8 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] 10.222.0.52 "DELETE /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d" status: 204 len: 0 microversion: 2.1 time: 0.441624 Oct 12 13:23:41.053002 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 268/531] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:23:40 2022] DELETE /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:23:41.058501 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-edc01e85-c539-4727-95bf-466911132b92 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:41.062045 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-edc01e85-c539-4727-95bf-466911132b92 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] [instance: 03732e0a-4ecf-4659-a7f2-1fb9519a272d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:41.066515 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-edc01e85-c539-4727-95bf-466911132b92 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:41.067279 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-edc01e85-c539-4727-95bf-466911132b92 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:41.068047 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-edc01e85-c539-4727-95bf-466911132b92 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:41.069061 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-edc01e85-c539-4727-95bf-466911132b92 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:41.069899 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-edc01e85-c539-4727-95bf-466911132b92 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:41.070516 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-edc01e85-c539-4727-95bf-466911132b92 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:41.488684 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-a6513ba4-6bb4-4ee6-ba43-bd29f98ad2e4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:41.506463 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a6513ba4-6bb4-4ee6-ba43-bd29f98ad2e4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 200 len: 1378 microversion: 2.1 time: 0.777923 Oct 12 13:23:41.507367 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 264/532] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:40 2022] GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 1378 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:23:41.525167 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8e488e87-3f51-48f3-aac0-923b08c48d5f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:41.525993 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8e488e87-3f51-48f3-aac0-923b08c48d5f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:41.533005 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8e488e87-3f51-48f3-aac0-923b08c48d5f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:41.539650 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8e488e87-3f51-48f3-aac0-923b08c48d5f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:41.540336 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8e488e87-3f51-48f3-aac0-923b08c48d5f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:41.541266 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8e488e87-3f51-48f3-aac0-923b08c48d5f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:41.541869 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8e488e87-3f51-48f3-aac0-923b08c48d5f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:41.542740 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8e488e87-3f51-48f3-aac0-923b08c48d5f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:41.807726 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-edc01e85-c539-4727-95bf-466911132b92 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259ebdabdff34c40b01cf3545f88aeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd2bdad116244d4a2e0f0057e035817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:41.824845 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-edc01e85-c539-4727-95bf-466911132b92 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] 10.222.0.52 "GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d" status: 200 len: 1469 microversion: 2.1 time: 0.770792 Oct 12 13:23:41.830610 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 269/533] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:41 2022] GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d => generated 1469 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:41.857028 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5457c95d-5b84-49d8-bbe6-31870b73f3d5 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:41.857941 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-5457c95d-5b84-49d8-bbe6-31870b73f3d5 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:41.865457 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5457c95d-5b84-49d8-bbe6-31870b73f3d5 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:41.866207 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5457c95d-5b84-49d8-bbe6-31870b73f3d5 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:41.866649 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5457c95d-5b84-49d8-bbe6-31870b73f3d5 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:41.867363 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5457c95d-5b84-49d8-bbe6-31870b73f3d5 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:41.867817 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5457c95d-5b84-49d8-bbe6-31870b73f3d5 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:41.868247 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5457c95d-5b84-49d8-bbe6-31870b73f3d5 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:41.910961 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8e488e87-3f51-48f3-aac0-923b08c48d5f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:41.919128 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8e488e87-3f51-48f3-aac0-923b08c48d5f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1316 microversion: 2.1 time: 0.409825 Oct 12 13:23:41.919700 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 265/534] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:41 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1316 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:41.926605 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-4a2aad6e-6d33-4e94-a1b9-897d222b6299 req-d8870ece-0fcf-401a-a7b2-cc7edbf6455f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad899a20-368e-4d9b-908d-4081aabc4e96", "name": "network-vif-plugged", "status": "completed", "tag": "5e2de395-46bb-4f74-87a2-7ec1e55f5f38"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:41.955824 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-4a2aad6e-6d33-4e94-a1b9-897d222b6299 req-d8870ece-0fcf-401a-a7b2-cc7edbf6455f service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:41.960327 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-4a2aad6e-6d33-4e94-a1b9-897d222b6299 req-d8870ece-0fcf-401a-a7b2-cc7edbf6455f service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:41.963550 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-4a2aad6e-6d33-4e94-a1b9-897d222b6299 req-d8870ece-0fcf-401a-a7b2-cc7edbf6455f service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:41.979513 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-4a2aad6e-6d33-4e94-a1b9-897d222b6299 req-d8870ece-0fcf-401a-a7b2-cc7edbf6455f service nova] Creating event network-vif-plugged:5e2de395-46bb-4f74-87a2-7ec1e55f5f38 for instance ad899a20-368e-4d9b-908d-4081aabc4e96 on n-h1-861076-2 Oct 12 13:23:41.986527 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-4a2aad6e-6d33-4e94-a1b9-897d222b6299 req-d8870ece-0fcf-401a-a7b2-cc7edbf6455f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063230 Oct 12 13:23:41.987538 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 266/535] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:42.316405 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-5457c95d-5b84-49d8-bbe6-31870b73f3d5 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:42.337301 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-5457c95d-5b84-49d8-bbe6-31870b73f3d5 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:42.338987 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-5457c95d-5b84-49d8-bbe6-31870b73f3d5 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:42.344552 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5457c95d-5b84-49d8-bbe6-31870b73f3d5 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1444 microversion: 2.75 time: 0.512859 Oct 12 13:23:42.349784 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 270/536] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:41 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1444 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:42.542364 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-58111db3-a08d-4c89-a058-cc93c82b87b2 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:42.542364 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-58111db3-a08d-4c89-a058-cc93c82b87b2 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:42.545175 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-58111db3-a08d-4c89-a058-cc93c82b87b2 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:42.546210 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-58111db3-a08d-4c89-a058-cc93c82b87b2 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:42.546645 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-58111db3-a08d-4c89-a058-cc93c82b87b2 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:42.547351 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-58111db3-a08d-4c89-a058-cc93c82b87b2 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:42.556285 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-58111db3-a08d-4c89-a058-cc93c82b87b2 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:42.560268 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-58111db3-a08d-4c89-a058-cc93c82b87b2 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:42.858969 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ebb4322d-1227-416d-a047-9494146221c8 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:42.858969 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-ebb4322d-1227-416d-a047-9494146221c8 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] [instance: 03732e0a-4ecf-4659-a7f2-1fb9519a272d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:42.870720 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebb4322d-1227-416d-a047-9494146221c8 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:42.871290 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebb4322d-1227-416d-a047-9494146221c8 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:42.871803 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebb4322d-1227-416d-a047-9494146221c8 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:42.872672 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebb4322d-1227-416d-a047-9494146221c8 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:42.875629 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebb4322d-1227-416d-a047-9494146221c8 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:42.877043 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebb4322d-1227-416d-a047-9494146221c8 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:43.168569 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-58111db3-a08d-4c89-a058-cc93c82b87b2 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:43.177645 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-58111db3-a08d-4c89-a058-cc93c82b87b2 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 200 len: 1378 microversion: 2.1 time: 0.651416 Oct 12 13:23:43.197868 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 267/537] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:42 2022] GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 1378 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:43.207039 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1621bded-24ec-40e6-8a61-8d5e1634f336 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bd46700>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:43.317573 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1621bded-24ec-40e6-8a61-8d5e1634f336 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/1f48c97b-eeb6-4c70-ba53-cbeab77f18d7" status: 200 len: 661 microversion: 2.1 time: 0.118052 Oct 12 13:23:43.321063 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 268/538] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:23:43 2022] GET /compute/v2.1/images/1f48c97b-eeb6-4c70-ba53-cbeab77f18d7 => generated 661 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:43.331394 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1885b718-e0b7-4bed-a831-943918e13f7f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:43.333620 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1885b718-e0b7-4bed-a831-943918e13f7f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:43.353614 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-ebb4322d-1227-416d-a047-9494146221c8 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259ebdabdff34c40b01cf3545f88aeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd2bdad116244d4a2e0f0057e035817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:43.358881 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1885b718-e0b7-4bed-a831-943918e13f7f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:43.360375 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1885b718-e0b7-4bed-a831-943918e13f7f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:43.361038 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1885b718-e0b7-4bed-a831-943918e13f7f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:43.362142 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1885b718-e0b7-4bed-a831-943918e13f7f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:43.362612 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ebb4322d-1227-416d-a047-9494146221c8 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] 10.222.0.52 "GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d" status: 200 len: 1469 microversion: 2.1 time: 0.509246 Oct 12 13:23:43.364428 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1885b718-e0b7-4bed-a831-943918e13f7f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:43.364958 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1885b718-e0b7-4bed-a831-943918e13f7f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:43.369952 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 271/539] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:42 2022] GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d => generated 1469 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:43.396452 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6991a9a5-0b93-4d22-8f09-791be5cd7548 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa0300550>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:43.450329 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6991a9a5-0b93-4d22-8f09-791be5cd7548 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/1f48c97b-eeb6-4c70-ba53-cbeab77f18d7" status: 200 len: 661 microversion: 2.1 time: 0.068095 Oct 12 13:23:43.451194 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 272/540] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:23:43 2022] GET /compute/v2.1/images/1f48c97b-eeb6-4c70-ba53-cbeab77f18d7 => generated 661 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:43.458716 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e58d6a71-87ad-443c-aecb-92e8544df45a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:43.461596 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-e58d6a71-87ad-443c-aecb-92e8544df45a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:43.481081 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e58d6a71-87ad-443c-aecb-92e8544df45a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:43.482000 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e58d6a71-87ad-443c-aecb-92e8544df45a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:43.483390 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e58d6a71-87ad-443c-aecb-92e8544df45a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:43.486125 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e58d6a71-87ad-443c-aecb-92e8544df45a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:43.486674 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e58d6a71-87ad-443c-aecb-92e8544df45a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:43.489149 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e58d6a71-87ad-443c-aecb-92e8544df45a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:43.537917 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e58d6a71-87ad-443c-aecb-92e8544df45a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:43.538753 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e58d6a71-87ad-443c-aecb-92e8544df45a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:43.539357 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e58d6a71-87ad-443c-aecb-92e8544df45a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:43.540052 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-e58d6a71-87ad-443c-aecb-92e8544df45a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lazy-loading 'fault' on Instance uuid d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:43.731376 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e58d6a71-87ad-443c-aecb-92e8544df45a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:43.744253 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e58d6a71-87ad-443c-aecb-92e8544df45a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:43.748384 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e58d6a71-87ad-443c-aecb-92e8544df45a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5fa5d90baf414f32abdda772daaca4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe783d615584c7d9ea3f9fca3d3a3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:43.765764 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e58d6a71-87ad-443c-aecb-92e8544df45a tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 200 len: 1449 microversion: 2.75 time: 0.313288 Oct 12 13:23:43.766531 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 273/541] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:43 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 1449 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:43.771351 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a763713e-b763-4d7c-a321-1753d1e391e0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-643329977", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:43.860821 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-a763713e-b763-4d7c-a321-1753d1e391e0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] validate_networks() for None {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:23:44.363227 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-1885b718-e0b7-4bed-a831-943918e13f7f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:44.372584 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1885b718-e0b7-4bed-a831-943918e13f7f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1316 microversion: 2.1 time: 1.050408 Oct 12 13:23:44.404213 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 269/542] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:43 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1316 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:44.404213 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-1548e8ac-050c-4d4d-b903-38872eafb974 req-fdd462c3-687a-4aad-8398-61df1cdd6ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9443e943-93c1-4a5f-aad4-da32545368fa", "name": "network-vif-plugged", "status": "completed", "tag": "f9aac7ee-1cd4-40d6-ac7b-0a00f2c6da9b"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:44.412229 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-1548e8ac-050c-4d4d-b903-38872eafb974 req-fdd462c3-687a-4aad-8398-61df1cdd6ddf service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:44.412958 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-1548e8ac-050c-4d4d-b903-38872eafb974 req-fdd462c3-687a-4aad-8398-61df1cdd6ddf service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:44.413575 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-1548e8ac-050c-4d4d-b903-38872eafb974 req-fdd462c3-687a-4aad-8398-61df1cdd6ddf service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:44.428069 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-1548e8ac-050c-4d4d-b903-38872eafb974 req-fdd462c3-687a-4aad-8398-61df1cdd6ddf service nova] Creating event network-vif-plugged:f9aac7ee-1cd4-40d6-ac7b-0a00f2c6da9b for instance 9443e943-93c1-4a5f-aad4-da32545368fa on n-h1-861076-2 Oct 12 13:23:44.434580 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-1548e8ac-050c-4d4d-b903-38872eafb974 req-fdd462c3-687a-4aad-8398-61df1cdd6ddf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039851 Oct 12 13:23:44.437064 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 270/543] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:44.459119 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-842e3564-6b35-493d-9f36-167a1413aee8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:44.460270 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-842e3564-6b35-493d-9f36-167a1413aee8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:44.470973 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-842e3564-6b35-493d-9f36-167a1413aee8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:44.471927 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-842e3564-6b35-493d-9f36-167a1413aee8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:44.473169 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-842e3564-6b35-493d-9f36-167a1413aee8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:44.474102 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-842e3564-6b35-493d-9f36-167a1413aee8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:44.474753 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-842e3564-6b35-493d-9f36-167a1413aee8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:44.475378 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-842e3564-6b35-493d-9f36-167a1413aee8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:44.774397 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-a763713e-b763-4d7c-a321-1753d1e391e0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:23:44.776675 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-a763713e-b763-4d7c-a321-1753d1e391e0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:23:44.780458 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-a763713e-b763-4d7c-a321-1753d1e391e0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:23:44.781216 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-a763713e-b763-4d7c-a321-1753d1e391e0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:23:44.782948 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-a763713e-b763-4d7c-a321-1753d1e391e0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:23:44.807595 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a763713e-b763-4d7c-a321-1753d1e391e0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:44.809185 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a763713e-b763-4d7c-a321-1753d1e391e0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:44.812212 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a763713e-b763-4d7c-a321-1753d1e391e0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:44.814366 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a763713e-b763-4d7c-a321-1753d1e391e0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:44.816626 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a763713e-b763-4d7c-a321-1753d1e391e0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:44.817127 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a763713e-b763-4d7c-a321-1753d1e391e0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:44.865951 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-a763713e-b763-4d7c-a321-1753d1e391e0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Getting quotas for project 85881fdc9e214dae8009054e5cd0bad8. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:23:44.876702 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-a763713e-b763-4d7c-a321-1753d1e391e0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Getting quotas for user 72b6dea3b64b4418b9bf590c4519cda3 and project 85881fdc9e214dae8009054e5cd0bad8. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:23:44.893373 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-842e3564-6b35-493d-9f36-167a1413aee8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:44.910678 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-842e3564-6b35-493d-9f36-167a1413aee8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 200 len: 1528 microversion: 2.1 time: 0.471889 Oct 12 13:23:44.919622 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a763713e-b763-4d7c-a321-1753d1e391e0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Going to run 1 instances... {{(pid=120933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:23:44.922553 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a763713e-b763-4d7c-a321-1753d1e391e0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 14676667-3743-4d37-8ff9-f8d161a483d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:23:44.942620 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 271/544] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:44 2022] GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 1528 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:44.948508 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-36821134-4212-4258-a58d-288d1fc3d328 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:44.950027 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-36821134-4212-4258-a58d-288d1fc3d328 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] [instance: 03732e0a-4ecf-4659-a7f2-1fb9519a272d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:44.962267 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-36821134-4212-4258-a58d-288d1fc3d328 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:44.962949 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-36821134-4212-4258-a58d-288d1fc3d328 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:44.963389 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-36821134-4212-4258-a58d-288d1fc3d328 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:44.964856 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-36821134-4212-4258-a58d-288d1fc3d328 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:44.965499 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-36821134-4212-4258-a58d-288d1fc3d328 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:44.965930 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-36821134-4212-4258-a58d-288d1fc3d328 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:45.066071 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-36821134-4212-4258-a58d-288d1fc3d328 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259ebdabdff34c40b01cf3545f88aeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd2bdad116244d4a2e0f0057e035817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:45.075444 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-36821134-4212-4258-a58d-288d1fc3d328 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] 10.222.0.52 "GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d" status: 200 len: 1427 microversion: 2.1 time: 0.131711 Oct 12 13:23:45.084873 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 272/545] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:44 2022] GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d => generated 1427 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:45.095857 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-90b050c3-a072-4929-af65-3ac88547ded9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:45.096730 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-90b050c3-a072-4929-af65-3ac88547ded9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] [instance: d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:45.104799 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-90b050c3-a072-4929-af65-3ac88547ded9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:45.105604 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-90b050c3-a072-4929-af65-3ac88547ded9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:45.106455 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-90b050c3-a072-4929-af65-3ac88547ded9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:45.107479 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-90b050c3-a072-4929-af65-3ac88547ded9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:45.108200 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-90b050c3-a072-4929-af65-3ac88547ded9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:45.108833 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-90b050c3-a072-4929-af65-3ac88547ded9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:45.115085 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=100 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:45.128424 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-90b050c3-a072-4929-af65-3ac88547ded9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] HTTP exception thrown: Instance d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 could not be found. Oct 12 13:23:45.129054 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a763713e-b763-4d7c-a321-1753d1e391e0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.357923 Oct 12 13:23:45.132188 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-90b050c3-a072-4929-af65-3ac88547ded9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Request method failure captured: Oct 12 13:23:45.132188 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 HTTP/1.1 Oct 12 13:23:45.132188 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:23:45.132188 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:23:45.132188 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:23:45.132188 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:23:45.132188 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:23:45.132188 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:23:45.132188 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:23:45.132188 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:23:45.132188 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr95y7kkd8zl6wyW_SkZJH-lgBsvu0iG1e62-D3qSbmf1Y_e0x44TYWp2qOTp6HqAlG4iLg6wRaGymbnp08VPJWxmTODzP5LQtYIGnNP6F13vJ3T6TH4vGEKyJOGatRp4gYmg5Z64VBOVqn3EaZUi3dvF_0gMD_cZpn2nE0xKwfVfPc Oct 12 13:23:45.132188 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:23:45.132188 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:23:45.132188 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:23:45.132188 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:23:45.132188 n-d-861076-2 devstack@n-api.service[120932]: X-Openstack-Nova-Api-Version: 2.75 Oct 12 13:23:45.132188 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:23:45.132188 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:23:45.132188 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 9fe783d615584c7d9ea3f9fca3d3a3fb Oct 12 13:23:45.132188 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServersAdmin275Test-189728359 Oct 12 13:23:45.132188 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:23:45.132188 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:23:45.133768 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9fe783d615584c7d9ea3f9fca3d3a3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9fe783d615584c7d9ea3f9fca3d3a3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9fe783d615584c7d9ea3f9fca3d3a3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9fe783d615584c7d9ea3f9fca3d3a3fb"}]}] Oct 12 13:23:45.133768 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServersAdmin275Test-189728359 Oct 12 13:23:45.133768 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 9fe783d615584c7d9ea3f9fca3d3a3fb Oct 12 13:23:45.133768 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServersAdmin275Test-189728359 Oct 12 13:23:45.133768 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServersAdmin275Test-189728359-project Oct 12 13:23:45.133768 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:23:45.133768 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:23:45.133768 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 5fa5d90baf414f32abdda772daaca4bd Oct 12 13:23:45.133768 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServersAdmin275Test-189728359-project Oct 12 13:23:45.133768 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:23:45.133768 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 could not be found. Oct 12 13:23:45.133768 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'd1364d1a-6ded-4ad4-adb3-3ba03d91b8f0'} Oct 12 13:23:45.134584 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:23:45.134584 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:45.134584 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:23:45.134584 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:23:45.134584 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:23:45.134584 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:23:45.134584 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:23:45.134584 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:23:45.134584 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:23:45.134584 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:23:45.134584 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 could not be found. Oct 12 13:23:45.134584 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:45.134584 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:23:45.134584 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:45.134584 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:45.134584 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:23:45.134584 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:23:45.134584 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:23:45.134584 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:23:45.134584 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:23:45.135948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:23:45.135948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:23:45.135948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:23:45.135948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:23:45.135948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:23:45.135948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:23:45.135948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:23:45.135948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 could not be found. Oct 12 13:23:45.135948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:45.135948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:23:45.135948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:45.135948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:45.135948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:23:45.135948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:23:45.135948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:23:45.135948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:23:45.135948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 could not be found. Oct 12 13:23:45.135948 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:45.139397 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 274/546] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:23:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 13:23:45.141422 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-90b050c3-a072-4929-af65-3ac88547ded9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] Returning 404 to user: Instance d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:23:45.142313 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-90b050c3-a072-4929-af65-3ac88547ded9 tempest-ServersAdmin275Test-189728359 tempest-ServersAdmin275Test-189728359-project] 10.222.0.52 "GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0" status: 404 len: 111 microversion: 2.75 time: 0.055457 Oct 12 13:23:45.145926 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 273/547] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:45 2022] GET /compute/v2.1/servers/d1364d1a-6ded-4ad4-adb3-3ba03d91b8f0 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:23:45.184101 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d9554a9b-2335-4cab-bad1-5b26cae32dd6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:45.184649 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-d9554a9b-2335-4cab-bad1-5b26cae32dd6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:45.215506 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d9554a9b-2335-4cab-bad1-5b26cae32dd6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:45.216008 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d9554a9b-2335-4cab-bad1-5b26cae32dd6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:45.216456 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d9554a9b-2335-4cab-bad1-5b26cae32dd6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:45.217244 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d9554a9b-2335-4cab-bad1-5b26cae32dd6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:45.223071 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d9554a9b-2335-4cab-bad1-5b26cae32dd6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:45.224811 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d9554a9b-2335-4cab-bad1-5b26cae32dd6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:45.391763 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9da5e3a0-24c5-49f5-a51c-66693feec42b tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1149470409", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:45.502363 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-9da5e3a0-24c5-49f5-a51c-66693feec42b tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] validate_networks() for None {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:23:45.891334 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d9554a9b-2335-4cab-bad1-5b26cae32dd6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:45.904562 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d9554a9b-2335-4cab-bad1-5b26cae32dd6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 200 len: 1528 microversion: 2.1 time: 0.760528 Oct 12 13:23:45.905461 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 275/548] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:45 2022] GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 1528 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:45.915892 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f1a6a197-106a-474f-b036-1fd8f3efd72e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:45.918601 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f1a6a197-106a-474f-b036-1fd8f3efd72e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:45.931408 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1a6a197-106a-474f-b036-1fd8f3efd72e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:45.933795 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1a6a197-106a-474f-b036-1fd8f3efd72e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:45.936152 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1a6a197-106a-474f-b036-1fd8f3efd72e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:45.937370 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1a6a197-106a-474f-b036-1fd8f3efd72e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:45.938156 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1a6a197-106a-474f-b036-1fd8f3efd72e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:45.939488 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1a6a197-106a-474f-b036-1fd8f3efd72e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:46.145746 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-9da5e3a0-24c5-49f5-a51c-66693feec42b tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:23:46.146399 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-9da5e3a0-24c5-49f5-a51c-66693feec42b tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:23:46.147034 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-9da5e3a0-24c5-49f5-a51c-66693feec42b tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:23:46.152936 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-9da5e3a0-24c5-49f5-a51c-66693feec42b tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:23:46.152936 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-9da5e3a0-24c5-49f5-a51c-66693feec42b tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:23:46.187989 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9da5e3a0-24c5-49f5-a51c-66693feec42b tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:46.188435 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9da5e3a0-24c5-49f5-a51c-66693feec42b tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:46.188871 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9da5e3a0-24c5-49f5-a51c-66693feec42b tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:46.196514 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9da5e3a0-24c5-49f5-a51c-66693feec42b tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:46.197312 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9da5e3a0-24c5-49f5-a51c-66693feec42b tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:46.200188 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9da5e3a0-24c5-49f5-a51c-66693feec42b tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:46.246591 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-9da5e3a0-24c5-49f5-a51c-66693feec42b tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Getting quotas for project 85881fdc9e214dae8009054e5cd0bad8. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:23:46.255935 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-9da5e3a0-24c5-49f5-a51c-66693feec42b tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Getting quotas for user 72b6dea3b64b4418b9bf590c4519cda3 and project 85881fdc9e214dae8009054e5cd0bad8. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:23:46.275405 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9da5e3a0-24c5-49f5-a51c-66693feec42b tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:23:46.280702 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9da5e3a0-24c5-49f5-a51c-66693feec42b tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:23:46.338188 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f1a6a197-106a-474f-b036-1fd8f3efd72e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:46.349599 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f1a6a197-106a-474f-b036-1fd8f3efd72e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1316 microversion: 2.1 time: 0.442305 Oct 12 13:23:46.350483 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 276/549] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:45 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1316 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:46.355840 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-2333dd2c-8ad2-4209-93e0-aa2bf30da745 req-e8ae9b2a-7b31-456a-827b-c3ee9221ba6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03732e0a-4ecf-4659-a7f2-1fb9519a272d", "name": "network-vif-deleted", "tag": "d17b79e3-d2ff-4987-9452-de1fc74be819"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:46.369473 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-2333dd2c-8ad2-4209-93e0-aa2bf30da745 req-e8ae9b2a-7b31-456a-827b-c3ee9221ba6e service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:46.370415 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-2333dd2c-8ad2-4209-93e0-aa2bf30da745 req-e8ae9b2a-7b31-456a-827b-c3ee9221ba6e service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:46.371076 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-2333dd2c-8ad2-4209-93e0-aa2bf30da745 req-e8ae9b2a-7b31-456a-827b-c3ee9221ba6e service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:46.384081 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-2333dd2c-8ad2-4209-93e0-aa2bf30da745 req-e8ae9b2a-7b31-456a-827b-c3ee9221ba6e service nova] Creating event network-vif-deleted:d17b79e3-d2ff-4987-9452-de1fc74be819 for instance 03732e0a-4ecf-4659-a7f2-1fb9519a272d on n-h2-861076-2 Oct 12 13:23:46.404554 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-2333dd2c-8ad2-4209-93e0-aa2bf30da745 req-e8ae9b2a-7b31-456a-827b-c3ee9221ba6e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052073 Oct 12 13:23:46.405756 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 277/550] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:46.468155 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9da5e3a0-24c5-49f5-a51c-66693feec42b tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.080732 Oct 12 13:23:46.471269 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 274/551] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:23:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 13:23:46.487128 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-38ef0b0c-62dd-436d-a70c-21e0b1fe2ad3 tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:46.583024 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-38ef0b0c-62dd-436d-a70c-21e0b1fe2ad3 tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/4a656d45-4a60-44fd-90b4-f33e5a6cecd8" status: 202 len: 0 microversion: 2.1 time: 0.110504 Oct 12 13:23:46.588220 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 275/552] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:23:46 2022] DELETE /compute/v2.1/flavors/4a656d45-4a60-44fd-90b4-f33e5a6cecd8 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:23:46.598241 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8fc2f907-8612-413f-b0d5-9cf977a437c3 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:46.598886 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8fc2f907-8612-413f-b0d5-9cf977a437c3 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] [instance: 03732e0a-4ecf-4659-a7f2-1fb9519a272d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:46.617086 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8fc2f907-8612-413f-b0d5-9cf977a437c3 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:46.622517 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8fc2f907-8612-413f-b0d5-9cf977a437c3 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:46.623152 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8fc2f907-8612-413f-b0d5-9cf977a437c3 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:46.624216 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8fc2f907-8612-413f-b0d5-9cf977a437c3 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:46.625704 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8fc2f907-8612-413f-b0d5-9cf977a437c3 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:46.629498 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8fc2f907-8612-413f-b0d5-9cf977a437c3 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:46.714048 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8fc2f907-8612-413f-b0d5-9cf977a437c3 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:46.714709 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8fc2f907-8612-413f-b0d5-9cf977a437c3 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:46.715302 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8fc2f907-8612-413f-b0d5-9cf977a437c3 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:46.716034 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-8fc2f907-8612-413f-b0d5-9cf977a437c3 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lazy-loading 'fault' on Instance uuid 03732e0a-4ecf-4659-a7f2-1fb9519a272d {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:23:46.834875 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-71a08a09-a343-41b7-9683-3c7efc22acd7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1674315671", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:46.926139 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8fc2f907-8612-413f-b0d5-9cf977a437c3 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259ebdabdff34c40b01cf3545f88aeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd2bdad116244d4a2e0f0057e035817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:46.935677 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8fc2f907-8612-413f-b0d5-9cf977a437c3 tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] 10.222.0.52 "GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d" status: 200 len: 1303 microversion: 2.1 time: 0.344547 Oct 12 13:23:46.936631 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-71a08a09-a343-41b7-9683-3c7efc22acd7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] validate_networks() for None {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:23:46.942241 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 276/553] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:46 2022] GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d => generated 1303 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:46.955389 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-15117606-bbc0-456a-b3f5-c93711faa9d1 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:46.960704 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-15117606-bbc0-456a-b3f5-c93711faa9d1 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:47.094915 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-15117606-bbc0-456a-b3f5-c93711faa9d1 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:47.136446 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-15117606-bbc0-456a-b3f5-c93711faa9d1 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 200 len: 1218 microversion: 2.1 time: 0.190075 Oct 12 13:23:47.137840 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 277/554] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:46 2022] GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 1218 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:47.148624 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5fe942c4-67f4-4a27-9941-3bda9eca3ab0 tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:47.191974 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5fe942c4-67f4-4a27-9941-3bda9eca3ab0 tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050866 Oct 12 13:23:47.192559 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 278/555] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:23:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:47.212668 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2e9bc21b-4969-4f1f-a4dc-974619de7939 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:47.216739 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2e9bc21b-4969-4f1f-a4dc-974619de7939 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:47.222343 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:47.224063 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2e9bc21b-4969-4f1f-a4dc-974619de7939 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:47.224752 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2e9bc21b-4969-4f1f-a4dc-974619de7939 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:47.225353 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2e9bc21b-4969-4f1f-a4dc-974619de7939 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:47.226302 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2e9bc21b-4969-4f1f-a4dc-974619de7939 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:47.227154 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2e9bc21b-4969-4f1f-a4dc-974619de7939 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:47.227745 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2e9bc21b-4969-4f1f-a4dc-974619de7939 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:47.289405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-2e9bc21b-4969-4f1f-a4dc-974619de7939 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-388a1066-7e06-471f-b196-52d02faa3351) Oct 12 13:23:47.289405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:47.289405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:23:47.289405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:23:47.289405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:47.289405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:47.289405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 12 13:23:47.289405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 12 13:23:47.289405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 12 13:23:47.289405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 12 13:23:47.289405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 12 13:23:47.289405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 12 13:23:47.289405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 12 13:23:47.289405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 12 13:23:47.290350 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:23:47.290350 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:23:47.290350 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:23:47.290350 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:23:47.290350 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:23:47.290350 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:23:47.290350 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:47.290350 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:47.290350 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:23:47.290350 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:23:47.290350 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:47.290350 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:47.290350 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:23:47.290350 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:23:47.290350 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:47.290350 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:47.290350 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:23:47.290350 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:23:47.291396 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:47.291396 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:47.291396 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:23:47.291396 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:23:47.291396 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:23:47.291396 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:23:47.291396 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:23:47.291396 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:23:47.291396 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:23:47.291396 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:23:47.291396 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:23:47.291396 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:23:47.291396 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:23:47.291396 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:23:47.291396 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:23:47.291396 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:23:47.291396 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:23:47.292403 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:23:47.292403 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:23:47.292403 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:23:47.292403 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:23:47.292403 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:23:47.292403 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:23:47.292403 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:23:47.292403 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:23:47.292403 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:23:47.292403 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:23:47.292403 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:23:47.292403 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-388a1066-7e06-471f-b196-52d02faa3351) Oct 12 13:23:47.292403 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:47.307573 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-2e9bc21b-4969-4f1f-a4dc-974619de7939 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:47.307573 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:23:47.311196 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2e9bc21b-4969-4f1f-a4dc-974619de7939 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Request method failure captured: Oct 12 13:23:47.311196 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96/action HTTP/1.1 Oct 12 13:23:47.311196 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:23:47.311196 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:23:47.311196 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:23:47.311196 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 32 Oct 12 13:23:47.311196 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:23:47.311196 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:23:47.311196 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:23:47.311196 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:23:47.311196 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr-Uy7R0-vO84LNBAwxPsssPvLLJJvDLLoKGFa8vBBM7F1Mf1vlFFzFToaRgPGnPKfPfeQQEWDVwjA-kXG2ItKpreMCd93oSqbLTmiWoKKoCe0M_BbZ4_liwNDN0-6wBzZaO_Moy7e6iBmO_tj-vMYydnf_VGtaHbljYhF2p-bsDVq4 Oct 12 13:23:47.311196 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:23:47.311196 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:23:47.311196 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:23:47.311196 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:23:47.311196 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:23:47.311196 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:23:47.311196 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: b92cdc745c654b538146a4a64f5f4b6f Oct 12 13:23:47.311196 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-MigrationsAdminTest-933851851 Oct 12 13:23:47.311196 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:23:47.311196 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:23:47.312782 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b92cdc745c654b538146a4a64f5f4b6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b92cdc745c654b538146a4a64f5f4b6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b92cdc745c654b538146a4a64f5f4b6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b92cdc745c654b538146a4a64f5f4b6f"}]}] Oct 12 13:23:47.312782 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-MigrationsAdminTest-933851851 Oct 12 13:23:47.312782 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: b92cdc745c654b538146a4a64f5f4b6f Oct 12 13:23:47.312782 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-MigrationsAdminTest-933851851 Oct 12 13:23:47.312782 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-MigrationsAdminTest-933851851-project Oct 12 13:23:47.312782 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:23:47.312782 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:23:47.312782 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 0df255f194e54dfb8781b982c2c60a98 Oct 12 13:23:47.312782 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-MigrationsAdminTest-933851851-project Oct 12 13:23:47.312782 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:23:47.312782 n-d-861076-2 devstack@n-api.service[120932]: {"resize": {"flavorRef": "451"}} Oct 12 13:23:47.312782 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:23:47.312782 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:47.323331 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:23:47.323331 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'ad899a20-368e-4d9b-908d-4081aabc4e96', 'body': {'resize': {'flavorRef': '451'}}} Oct 12 13:23:47.323331 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:23:47.323331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:47.323331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:23:47.323331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:23:47.323331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:23:47.323331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:23:47.323331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 12 13:23:47.323331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 12 13:23:47.323331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 12 13:23:47.323331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 12 13:23:47.323331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 12 13:23:47.323331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 12 13:23:47.323331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 12 13:23:47.323331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 12 13:23:47.323331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:23:47.323331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:23:47.323331 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:23:47.325088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:23:47.325088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:23:47.325088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:23:47.325088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:47.325088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:47.325088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:23:47.325088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:23:47.325088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:47.325088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:47.325088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:23:47.325088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:23:47.325088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:47.325088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:47.325088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:23:47.325088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:23:47.325088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:23:47.325088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:23:47.325088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:23:47.330309 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:23:47.330309 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:23:47.330309 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:23:47.330309 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:23:47.330309 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:23:47.330309 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:23:47.330309 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:23:47.330309 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:23:47.330309 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:23:47.330309 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:23:47.330309 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:23:47.330309 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:23:47.330309 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:23:47.330309 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:23:47.330309 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:23:47.330309 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:23:47.330309 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:23:47.332346 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:23:47.332346 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:23:47.332346 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:23:47.332346 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:23:47.332346 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:23:47.332346 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:23:47.332346 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:23:47.332346 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:23:47.332346 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-388a1066-7e06-471f-b196-52d02faa3351) Oct 12 13:23:47.332346 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:47.332346 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:23:47.332346 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:47.332346 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:47.332346 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:23:47.332346 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:23:47.332346 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:23:47.332346 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:23:47.334371 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:23:47.334371 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:23:47.334371 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:47.334371 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:47.334371 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:47.334371 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:23:47.334371 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:47.334371 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:47.334371 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:23:47.334371 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:23:47.334371 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:23:47.334371 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:23:47.334371 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:47.334371 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:47.334371 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:47.336245 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-71a08a09-a343-41b7-9683-3c7efc22acd7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:23:47.336245 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-71a08a09-a343-41b7-9683-3c7efc22acd7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:23:47.336245 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-71a08a09-a343-41b7-9683-3c7efc22acd7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:23:47.336245 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-71a08a09-a343-41b7-9683-3c7efc22acd7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:23:47.336245 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-71a08a09-a343-41b7-9683-3c7efc22acd7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:23:47.336875 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2e9bc21b-4969-4f1f-a4dc-974619de7939 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:23:47.336875 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:23:47.336875 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2e9bc21b-4969-4f1f-a4dc-974619de7939 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "POST /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96/action" status: 500 len: 214 microversion: 2.1 time: 0.115052 Oct 12 13:23:47.336875 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 279/556] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:23:47 2022] POST /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96/action => generated 214 bytes in 118 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 12 13:23:47.336875 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6863069c-4ca3-4a8d-889a-f864936b6f4a tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:47.344575 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-6863069c-4ca3-4a8d-889a-f864936b6f4a tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] HTTP exception thrown: Flavor 4a656d45-4a60-44fd-90b4-f33e5a6cecd8 could not be found. Oct 12 13:23:47.351044 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6863069c-4ca3-4a8d-889a-f864936b6f4a tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Request method failure captured: Oct 12 13:23:47.351044 n-d-861076-2 devstack@n-api.service[120932]: request: DELETE /compute/v2.1/flavors/4a656d45-4a60-44fd-90b4-f33e5a6cecd8 HTTP/1.1 Oct 12 13:23:47.351044 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:23:47.351044 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:23:47.351044 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:23:47.351044 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:23:47.351044 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:23:47.351044 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:23:47.351044 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:23:47.351044 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:23:47.351044 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr-X9s6OnMePnTkPdpdpXuH5wy46cOe9GRya0mAbV1EHPGS4giy7zHykGQ0hAqQmeHuyseLok3sv3L76_swYqSY77owooCQIk27k4UBy44jI7NX2E5DeEN5U3Ww6datBEcPl214U-rUvk_4jvgQkZsvQQqrDmZmuru2fHkEUj2Bi2LQ Oct 12 13:23:47.351044 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:23:47.351044 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:23:47.351044 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:23:47.351044 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:23:47.351044 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:23:47.351044 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:23:47.351044 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: a597640040eb4f28afccca47c7c4e4be Oct 12 13:23:47.351044 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-MigrationsAdminTest-1144872436 Oct 12 13:23:47.351044 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,admin,reader Oct 12 13:23:47.351044 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,admin,reader Oct 12 13:23:47.352471 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a597640040eb4f28afccca47c7c4e4be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a597640040eb4f28afccca47c7c4e4be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a597640040eb4f28afccca47c7c4e4be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a597640040eb4f28afccca47c7c4e4be"}]}] Oct 12 13:23:47.352471 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-MigrationsAdminTest-1144872436 Oct 12 13:23:47.352471 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: a597640040eb4f28afccca47c7c4e4be Oct 12 13:23:47.352471 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-MigrationsAdminTest-1144872436 Oct 12 13:23:47.352471 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-MigrationsAdminTest-1144872436-project-admin Oct 12 13:23:47.352471 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:23:47.352471 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:23:47.352471 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 24b53bc4b5a24e57918a421065edd233 Oct 12 13:23:47.352471 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-MigrationsAdminTest-1144872436-project-admin Oct 12 13:23:47.352471 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:23:47.352471 n-d-861076-2 devstack@n-api.service[120932]: exception: Flavor 4a656d45-4a60-44fd-90b4-f33e5a6cecd8 could not be found. Oct 12 13:23:47.352471 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '4a656d45-4a60-44fd-90b4-f33e5a6cecd8'} Oct 12 13:23:47.353251 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:23:47.353251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:47.353251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 12 13:23:47.353251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 12 13:23:47.353251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 13:23:47.353251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 13:23:47.353251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 12 13:23:47.353251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 12 13:23:47.353251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 12 13:23:47.353251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 12 13:23:47.353251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:23:47.353251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:23:47.353251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 12 13:23:47.353251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 12 13:23:47.353251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 4a656d45-4a60-44fd-90b4-f33e5a6cecd8 could not be found. Oct 12 13:23:47.353251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:47.353251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:23:47.353251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:47.353251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:47.353251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:23:47.354501 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:23:47.354501 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:23:47.354501 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:23:47.354501 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:23:47.354501 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:23:47.354501 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 12 13:23:47.354501 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:23:47.354501 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 4a656d45-4a60-44fd-90b4-f33e5a6cecd8 could not be found. Oct 12 13:23:47.354501 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:47.354501 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:23:47.354501 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:47.354501 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:47.354501 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:23:47.354501 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:23:47.354501 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:23:47.354501 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:23:47.354501 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 4a656d45-4a60-44fd-90b4-f33e5a6cecd8 could not be found. Oct 12 13:23:47.354501 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:23:47.355568 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6863069c-4ca3-4a8d-889a-f864936b6f4a tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Returning 404 to user: Flavor 4a656d45-4a60-44fd-90b4-f33e5a6cecd8 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:23:47.355568 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6863069c-4ca3-4a8d-889a-f864936b6f4a tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/4a656d45-4a60-44fd-90b4-f33e5a6cecd8" status: 404 len: 109 microversion: 2.1 time: 0.018365 Oct 12 13:23:47.355568 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 280/557] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:23:47 2022] DELETE /compute/v2.1/flavors/4a656d45-4a60-44fd-90b4-f33e5a6cecd8 => generated 109 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:23:47.355767 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-71a08a09-a343-41b7-9683-3c7efc22acd7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:47.355767 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-71a08a09-a343-41b7-9683-3c7efc22acd7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:47.371971 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-71a08a09-a343-41b7-9683-3c7efc22acd7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:47.377161 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8d72bc12-a14a-4366-a1ae-4ffddd937881 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:47.379335 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-71a08a09-a343-41b7-9683-3c7efc22acd7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:47.385557 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-71a08a09-a343-41b7-9683-3c7efc22acd7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:47.385557 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-71a08a09-a343-41b7-9683-3c7efc22acd7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:47.396432 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8d72bc12-a14a-4366-a1ae-4ffddd937881 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:47.419108 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8d72bc12-a14a-4366-a1ae-4ffddd937881 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:47.420177 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8d72bc12-a14a-4366-a1ae-4ffddd937881 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:47.420612 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8d72bc12-a14a-4366-a1ae-4ffddd937881 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:47.421355 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8d72bc12-a14a-4366-a1ae-4ffddd937881 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:47.421803 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8d72bc12-a14a-4366-a1ae-4ffddd937881 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:47.422224 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8d72bc12-a14a-4366-a1ae-4ffddd937881 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:47.468960 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-71a08a09-a343-41b7-9683-3c7efc22acd7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Getting quotas for project 8a6244b389164297b219fa7356b46ffe. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:23:47.481217 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-71a08a09-a343-41b7-9683-3c7efc22acd7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Getting quotas for user 685195d760b9401685e9017725fe9d0a and project 8a6244b389164297b219fa7356b46ffe. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:23:47.516106 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-71a08a09-a343-41b7-9683-3c7efc22acd7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Going to run 1 instances... {{(pid=120933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:23:47.527932 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-71a08a09-a343-41b7-9683-3c7efc22acd7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:23:47.546779 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:47.723001 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-71a08a09-a343-41b7-9683-3c7efc22acd7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.311466 Oct 12 13:23:47.723001 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 278/558] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:23:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 13:23:47.736097 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7dd1509b-10ca-4043-8249-de2a284c4a91 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1645885268", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:47.783817 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8d72bc12-a14a-4366-a1ae-4ffddd937881 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:47.792769 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8d72bc12-a14a-4366-a1ae-4ffddd937881 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1466 microversion: 2.1 time: 0.421486 Oct 12 13:23:47.804942 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 281/559] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:47 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1466 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:47.807127 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6879fc81-de4f-4feb-84d7-9450bf9b8a93 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:47.807938 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6879fc81-de4f-4feb-84d7-9450bf9b8a93 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:47.877393 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-7dd1509b-10ca-4043-8249-de2a284c4a91 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] validate_networks() for None {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:23:47.987521 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-6879fc81-de4f-4feb-84d7-9450bf9b8a93 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:47.999977 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6879fc81-de4f-4feb-84d7-9450bf9b8a93 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 200 len: 1220 microversion: 2.1 time: 0.202851 Oct 12 13:23:48.001251 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 282/560] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:47 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 1220 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:48.439500 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b2669221-eaf4-4a11-be3a-3bd4e3ec0929 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:48.440667 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b2669221-eaf4-4a11-be3a-3bd4e3ec0929 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:48.449970 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b2669221-eaf4-4a11-be3a-3bd4e3ec0929 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:48.450508 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b2669221-eaf4-4a11-be3a-3bd4e3ec0929 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:48.450944 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b2669221-eaf4-4a11-be3a-3bd4e3ec0929 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:48.451637 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b2669221-eaf4-4a11-be3a-3bd4e3ec0929 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:48.452093 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b2669221-eaf4-4a11-be3a-3bd4e3ec0929 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:48.455295 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b2669221-eaf4-4a11-be3a-3bd4e3ec0929 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:48.806899 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-7dd1509b-10ca-4043-8249-de2a284c4a91 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:23:48.807482 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-7dd1509b-10ca-4043-8249-de2a284c4a91 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:23:48.808124 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-7dd1509b-10ca-4043-8249-de2a284c4a91 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:23:48.808545 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-7dd1509b-10ca-4043-8249-de2a284c4a91 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:23:48.809187 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-7dd1509b-10ca-4043-8249-de2a284c4a91 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:23:48.837470 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7dd1509b-10ca-4043-8249-de2a284c4a91 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:48.837860 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7dd1509b-10ca-4043-8249-de2a284c4a91 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:48.838300 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7dd1509b-10ca-4043-8249-de2a284c4a91 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:48.843983 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7dd1509b-10ca-4043-8249-de2a284c4a91 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:48.845373 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7dd1509b-10ca-4043-8249-de2a284c4a91 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:48.846290 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7dd1509b-10ca-4043-8249-de2a284c4a91 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:48.915531 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-7dd1509b-10ca-4043-8249-de2a284c4a91 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Getting quotas for project b92cdc745c654b538146a4a64f5f4b6f. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:23:48.928726 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-7dd1509b-10ca-4043-8249-de2a284c4a91 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Getting quotas for user 0df255f194e54dfb8781b982c2c60a98 and project b92cdc745c654b538146a4a64f5f4b6f. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:23:48.967345 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7dd1509b-10ca-4043-8249-de2a284c4a91 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Going to run 1 instances... {{(pid=120933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:23:48.975975 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7dd1509b-10ca-4043-8249-de2a284c4a91 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:23:49.226880 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-7dd1509b-10ca-4043-8249-de2a284c4a91 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.503780 Oct 12 13:23:49.228085 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 279/561] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:23:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 13:23:49.243563 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7be34df5-861a-4610-9859-a346bbcfca8b tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:49.248658 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7be34df5-861a-4610-9859-a346bbcfca8b tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] [instance: 03732e0a-4ecf-4659-a7f2-1fb9519a272d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:49.269397 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7be34df5-861a-4610-9859-a346bbcfca8b tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:49.285668 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7be34df5-861a-4610-9859-a346bbcfca8b tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:49.288117 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7be34df5-861a-4610-9859-a346bbcfca8b tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:49.294230 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7be34df5-861a-4610-9859-a346bbcfca8b tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:49.295963 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7be34df5-861a-4610-9859-a346bbcfca8b tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:49.297223 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7be34df5-861a-4610-9859-a346bbcfca8b tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:49.372652 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-7be34df5-861a-4610-9859-a346bbcfca8b tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] HTTP exception thrown: Instance 03732e0a-4ecf-4659-a7f2-1fb9519a272d could not be found. Oct 12 13:23:49.386616 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7be34df5-861a-4610-9859-a346bbcfca8b tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Request method failure captured: Oct 12 13:23:49.386616 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d HTTP/1.1 Oct 12 13:23:49.386616 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:23:49.386616 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:23:49.386616 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:23:49.386616 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:23:49.386616 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:23:49.386616 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:23:49.386616 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:23:49.386616 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:23:49.386616 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr--Ri3qtAgwGa3kdUgqUSYrarqKMf5FhmkwUmvUL1J8TcHqNsHDuJCShji2vi-9mpbGcEJ-WZcxPlpoqQfFXTBeiVFQGtq1wCdpoxSAEOFkl4v2ZtOYPuy-h4V4zX4ILfmtTH-6o5ZWhrGzHeD7r6bhh4cyX4ZmUWqzpC2to_Pd1f4 Oct 12 13:23:49.386616 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:23:49.386616 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:23:49.386616 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:23:49.386616 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:23:49.386616 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:23:49.386616 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:23:49.386616 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 6bd2bdad116244d4a2e0f0057e035817 Oct 12 13:23:49.386616 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-TenantUsagesTestJSON-551184268 Oct 12 13:23:49.386616 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:23:49.386616 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:23:49.389045 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6bd2bdad116244d4a2e0f0057e035817"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6bd2bdad116244d4a2e0f0057e035817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bd2bdad116244d4a2e0f0057e035817"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bd2bdad116244d4a2e0f0057e035817"}]}] Oct 12 13:23:49.389045 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-TenantUsagesTestJSON-551184268 Oct 12 13:23:49.389045 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 6bd2bdad116244d4a2e0f0057e035817 Oct 12 13:23:49.389045 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-TenantUsagesTestJSON-551184268 Oct 12 13:23:49.389045 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-TenantUsagesTestJSON-551184268-project Oct 12 13:23:49.389045 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:23:49.389045 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:23:49.389045 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 259ebdabdff34c40b01cf3545f88aeeb Oct 12 13:23:49.389045 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-TenantUsagesTestJSON-551184268-project Oct 12 13:23:49.389045 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:23:49.389045 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance 03732e0a-4ecf-4659-a7f2-1fb9519a272d could not be found. Oct 12 13:23:49.389045 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '03732e0a-4ecf-4659-a7f2-1fb9519a272d'} Oct 12 13:23:49.390040 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:23:49.390040 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:49.390040 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:23:49.390040 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:23:49.390040 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:23:49.390040 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:23:49.390040 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:23:49.390040 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:23:49.390040 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:23:49.390040 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:23:49.390040 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03732e0a-4ecf-4659-a7f2-1fb9519a272d could not be found. Oct 12 13:23:49.390040 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:23:49.390040 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:23:49.390040 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:23:49.390040 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:49.390040 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:23:49.390040 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:23:49.390040 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:23:49.390040 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:23:49.390040 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:23:49.391402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:23:49.391402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:23:49.391402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:23:49.391402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:23:49.391402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:23:49.391402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:23:49.391402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:23:49.391402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03732e0a-4ecf-4659-a7f2-1fb9519a272d could not be found. Oct 12 13:23:49.391402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:23:49.391402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:23:49.391402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:23:49.391402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:23:49.391402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:23:49.391402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:23:49.391402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:23:49.391402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:23:49.391402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03732e0a-4ecf-4659-a7f2-1fb9519a272d could not be found. Oct 12 13:23:49.391402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:23:49.392657 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7be34df5-861a-4610-9859-a346bbcfca8b tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] Returning 404 to user: Instance 03732e0a-4ecf-4659-a7f2-1fb9519a272d could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:23:49.392657 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-7be34df5-861a-4610-9859-a346bbcfca8b tempest-TenantUsagesTestJSON-551184268 tempest-TenantUsagesTestJSON-551184268-project] 10.222.0.52 "GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d" status: 404 len: 111 microversion: 2.1 time: 0.154122 Oct 12 13:23:49.398012 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 280/562] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:49 2022] GET /compute/v2.1/servers/03732e0a-4ecf-4659-a7f2-1fb9519a272d => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:23:49.413216 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2810ac80-4cdd-4de6-9c82-363efcbc1130 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:49.414099 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-2810ac80-4cdd-4de6-9c82-363efcbc1130 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:49.432075 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2810ac80-4cdd-4de6-9c82-363efcbc1130 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:49.436088 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2810ac80-4cdd-4de6-9c82-363efcbc1130 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:49.436778 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2810ac80-4cdd-4de6-9c82-363efcbc1130 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:49.439492 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2810ac80-4cdd-4de6-9c82-363efcbc1130 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:49.440099 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2810ac80-4cdd-4de6-9c82-363efcbc1130 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:49.443722 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2810ac80-4cdd-4de6-9c82-363efcbc1130 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:49.684261 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-2810ac80-4cdd-4de6-9c82-363efcbc1130 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:49.699758 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2810ac80-4cdd-4de6-9c82-363efcbc1130 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 200 len: 1270 microversion: 2.1 time: 0.300406 Oct 12 13:23:49.701584 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 281/563] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:49 2022] GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 1270 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:49.719289 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2c4a9b4e-9250-45d5-9052-b550c28e44e7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:49.720158 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-2c4a9b4e-9250-45d5-9052-b550c28e44e7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:49.733154 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2c4a9b4e-9250-45d5-9052-b550c28e44e7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:49.733903 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2c4a9b4e-9250-45d5-9052-b550c28e44e7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:49.734495 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2c4a9b4e-9250-45d5-9052-b550c28e44e7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:49.739029 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2c4a9b4e-9250-45d5-9052-b550c28e44e7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:49.739834 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2c4a9b4e-9250-45d5-9052-b550c28e44e7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:49.740496 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2c4a9b4e-9250-45d5-9052-b550c28e44e7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:49.906582 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-2c4a9b4e-9250-45d5-9052-b550c28e44e7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:49.921391 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2c4a9b4e-9250-45d5-9052-b550c28e44e7 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 200 len: 1224 microversion: 2.1 time: 0.217182 Oct 12 13:23:49.922445 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 282/564] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:49 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 1224 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:49.936793 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0d5d4a2f-8845-44f1-a316-b09bdb343ee7 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:49.937691 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-0d5d4a2f-8845-44f1-a316-b09bdb343ee7 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:50.075008 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-0d5d4a2f-8845-44f1-a316-b09bdb343ee7 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:50.107715 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0d5d4a2f-8845-44f1-a316-b09bdb343ee7 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 200 len: 1213 microversion: 2.1 time: 0.180162 Oct 12 13:23:50.116526 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 283/565] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:49 2022] GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 1213 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:50.319801 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b2669221-eaf4-4a11-be3a-3bd4e3ec0929 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1617 microversion: 2.1 time: 2.312149 Oct 12 13:23:50.322395 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 283/566] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:48 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1617 bytes in 2320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:50.352982 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9db1eb11-f32c-447f-b510-1eca4fb47d16 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Action: 'create', calling method: .version_select at 0x7f8aa049ad30>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-792182253", "policies": ["affinity"]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:50.433859 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-9db1eb11-f32c-447f-b510-1eca4fb47d16 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_groups'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:23:50.461693 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-9db1eb11-f32c-447f-b510-1eca4fb47d16 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for user a0fd9458bb2842829a1e13ac93fade30 and project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_groups'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:23:50.682069 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-9db1eb11-f32c-447f-b510-1eca4fb47d16 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_groups'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:23:50.705353 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-9db1eb11-f32c-447f-b510-1eca4fb47d16 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for user a0fd9458bb2842829a1e13ac93fade30 and project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_groups'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:23:50.733920 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f680bf3a-1d6e-444c-8a7c-d32f05d9f8cf tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:50.734536 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f680bf3a-1d6e-444c-8a7c-d32f05d9f8cf tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:50.763116 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9db1eb11-f32c-447f-b510-1eca4fb47d16 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.421127 Oct 12 13:23:50.765190 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f680bf3a-1d6e-444c-8a7c-d32f05d9f8cf tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:50.767401 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f680bf3a-1d6e-444c-8a7c-d32f05d9f8cf tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:50.768390 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f680bf3a-1d6e-444c-8a7c-d32f05d9f8cf tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:50.781775 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f680bf3a-1d6e-444c-8a7c-d32f05d9f8cf tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:50.784073 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f680bf3a-1d6e-444c-8a7c-d32f05d9f8cf tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:50.784723 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 284/567] 10.222.0.52 () {60 vars in 1174 bytes} [Wed Oct 12 13:23:50 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:50.788553 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f680bf3a-1d6e-444c-8a7c-d32f05d9f8cf tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:50.954698 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1d30cb01-58d7-4557-88ff-b3b2a985f853 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:50.955933 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-1d30cb01-58d7-4557-88ff-b3b2a985f853 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:50.969679 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d30cb01-58d7-4557-88ff-b3b2a985f853 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:50.971288 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d30cb01-58d7-4557-88ff-b3b2a985f853 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:50.973655 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d30cb01-58d7-4557-88ff-b3b2a985f853 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:50.974571 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d30cb01-58d7-4557-88ff-b3b2a985f853 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:50.975982 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d30cb01-58d7-4557-88ff-b3b2a985f853 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:50.977532 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d30cb01-58d7-4557-88ff-b3b2a985f853 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:51.213064 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-1d30cb01-58d7-4557-88ff-b3b2a985f853 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:51.216118 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f680bf3a-1d6e-444c-8a7c-d32f05d9f8cf tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:51.222147 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1d30cb01-58d7-4557-88ff-b3b2a985f853 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 200 len: 1272 microversion: 2.1 time: 0.274555 Oct 12 13:23:51.223317 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 285/568] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:50 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 1272 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:23:51.226715 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f680bf3a-1d6e-444c-8a7c-d32f05d9f8cf tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 200 len: 1288 microversion: 2.1 time: 0.498574 Oct 12 13:23:51.238066 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 284/569] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:50 2022] GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 1288 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:23:51.244937 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-6075098", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "b7df70df-24c1-41ad-9d28-be4f73ece55a"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:51.249738 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fe3245d0-8d40-4042-b69d-dd19170d9d97 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:51.250359 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fe3245d0-8d40-4042-b69d-dd19170d9d97 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:51.268618 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe3245d0-8d40-4042-b69d-dd19170d9d97 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:51.269142 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe3245d0-8d40-4042-b69d-dd19170d9d97 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:51.271099 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe3245d0-8d40-4042-b69d-dd19170d9d97 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:51.271858 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe3245d0-8d40-4042-b69d-dd19170d9d97 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:51.281466 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe3245d0-8d40-4042-b69d-dd19170d9d97 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:51.282009 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe3245d0-8d40-4042-b69d-dd19170d9d97 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:51.368237 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] validate_networks() for None {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:23:51.646578 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-fe3245d0-8d40-4042-b69d-dd19170d9d97 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:51.654810 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fe3245d0-8d40-4042-b69d-dd19170d9d97 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 200 len: 1217 microversion: 2.1 time: 0.424049 Oct 12 13:23:51.661227 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 285/570] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:51 2022] GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 1217 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:52.257776 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4256046d-c121-41fa-8c52-b6374a722608 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:52.261421 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-4256046d-c121-41fa-8c52-b6374a722608 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:52.285218 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4256046d-c121-41fa-8c52-b6374a722608 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:52.285815 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4256046d-c121-41fa-8c52-b6374a722608 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:52.286474 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4256046d-c121-41fa-8c52-b6374a722608 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:52.287386 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4256046d-c121-41fa-8c52-b6374a722608 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:52.288117 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4256046d-c121-41fa-8c52-b6374a722608 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:52.289056 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4256046d-c121-41fa-8c52-b6374a722608 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:52.305537 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:23:52.305975 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:23:52.306680 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:23:52.307098 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:23:52.307513 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:23:52.383746 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:52.384242 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:52.384685 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:52.385447 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:52.385905 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:52.389971 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:52.416256 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for project be50900be6b246aa9289de6ec5d366f9. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:23:52.428950 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for user a0fd9458bb2842829a1e13ac93fade30 and project be50900be6b246aa9289de6ec5d366f9. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:23:52.453780 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Going to run 2 instances... {{(pid=120933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:23:52.459667 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fc77e94c-e9f8-4717-aecf-f5f222647117] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:23:52.654276 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120933) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 12 13:23:52.692323 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_group_members'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:23:52.703444 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for user a0fd9458bb2842829a1e13ac93fade30 and project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_group_members'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:23:52.925882 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_group_members'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:23:52.951264 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for user a0fd9458bb2842829a1e13ac93fade30 and project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_group_members'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:23:52.990767 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:INSERT=11,nova_api:SELECT=89 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:53.010853 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=fc77e94c-e9f8-4717-aecf-f5f222647117,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:23:53.041268 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-4256046d-c121-41fa-8c52-b6374a722608 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:53.053767 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4256046d-c121-41fa-8c52-b6374a722608 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 200 len: 1278 microversion: 2.1 time: 0.808274 Oct 12 13:23:53.067138 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 286/571] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:52 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 1278 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:53.081236 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-26376054-30ed-42b7-9d77-820aab784fbb tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:53.083551 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-26376054-30ed-42b7-9d77-820aab784fbb tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:53.102026 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-26376054-30ed-42b7-9d77-820aab784fbb tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:53.103582 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-26376054-30ed-42b7-9d77-820aab784fbb tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:53.106768 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-26376054-30ed-42b7-9d77-820aab784fbb tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:53.108146 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-26376054-30ed-42b7-9d77-820aab784fbb tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:53.110275 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-26376054-30ed-42b7-9d77-820aab784fbb tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:53.110872 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-26376054-30ed-42b7-9d77-820aab784fbb tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:53.242512 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_group_members'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:23:53.264333 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for user a0fd9458bb2842829a1e13ac93fade30 and project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_group_members'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:23:53.309848 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-26376054-30ed-42b7-9d77-820aab784fbb tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:53.320193 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-26376054-30ed-42b7-9d77-820aab784fbb tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 200 len: 1276 microversion: 2.1 time: 0.251340 Oct 12 13:23:53.320780 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 287/572] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:53 2022] GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 1276 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:53.326576 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-74989f54-662e-48a2-960e-816866f80d65 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:53.327685 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-74989f54-662e-48a2-960e-816866f80d65 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:53.335757 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74989f54-662e-48a2-960e-816866f80d65 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:53.336418 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74989f54-662e-48a2-960e-816866f80d65 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:53.336858 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74989f54-662e-48a2-960e-816866f80d65 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:53.337768 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74989f54-662e-48a2-960e-816866f80d65 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:53.338327 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74989f54-662e-48a2-960e-816866f80d65 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:53.338756 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74989f54-662e-48a2-960e-816866f80d65 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:53.403449 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_group_members'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:23:53.410298 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for user a0fd9458bb2842829a1e13ac93fade30 and project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_group_members'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:23:53.492209 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-aa01f30c-79a4-47a5-91bf-024aa95d0afc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.267266 Oct 12 13:23:53.493274 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-74989f54-662e-48a2-960e-816866f80d65 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:53.500918 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 286/573] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:23:51 2022] POST /compute/v2.1/servers => generated 32 bytes in 2275 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 12 13:23:53.504891 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-660bac04-815d-4424-9114-41a4ccba1ce9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:53.506408 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-74989f54-662e-48a2-960e-816866f80d65 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 200 len: 1283 microversion: 2.1 time: 0.183799 Oct 12 13:23:53.507592 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 288/574] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:53 2022] GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 1283 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:53.519798 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-660bac04-815d-4424-9114-41a4ccba1ce9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:53.520540 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-660bac04-815d-4424-9114-41a4ccba1ce9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Searching by: {'deleted': False, 'project_id': 'be50900be6b246aa9289de6ec5d366f9'} {{(pid=120933) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 13:23:53.565089 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-660bac04-815d-4424-9114-41a4ccba1ce9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:53.565598 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-660bac04-815d-4424-9114-41a4ccba1ce9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:53.566034 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-660bac04-815d-4424-9114-41a4ccba1ce9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:53.566927 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-660bac04-815d-4424-9114-41a4ccba1ce9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:53.567395 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-660bac04-815d-4424-9114-41a4ccba1ce9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:53.567829 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-660bac04-815d-4424-9114-41a4ccba1ce9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:53.787561 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.multi_cell_list [None req-660bac04-815d-4424-9114-41a4ccba1ce9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120933) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 13:23:53.830923 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:54.039091 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-660bac04-815d-4424-9114-41a4ccba1ce9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 997 microversion: 2.1 time: 0.537446 Oct 12 13:23:54.039091 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 287/575] 10.222.0.52 () {58 vars in 1125 bytes} [Wed Oct 12 13:23:53 2022] GET /compute/v2.1/servers => generated 997 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:54.051929 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-87ab1896-9f93-42e2-8442-9bac7e49f0de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:54.053857 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-87ab1896-9f93-42e2-8442-9bac7e49f0de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:54.151460 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-87ab1896-9f93-42e2-8442-9bac7e49f0de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:54.162488 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-87ab1896-9f93-42e2-8442-9bac7e49f0de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17" status: 200 len: 1216 microversion: 2.1 time: 0.114208 Oct 12 13:23:54.164396 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 288/576] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:54 2022] GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 => generated 1216 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:54.181589 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-37e9a31b-b524-4ce4-9434-e7093f312162 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:54.184197 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-37e9a31b-b524-4ce4-9434-e7093f312162 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:54.192152 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-37e9a31b-b524-4ce4-9434-e7093f312162 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:54.192891 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-37e9a31b-b524-4ce4-9434-e7093f312162 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:54.193642 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-37e9a31b-b524-4ce4-9434-e7093f312162 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:54.194593 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-37e9a31b-b524-4ce4-9434-e7093f312162 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:54.195565 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-37e9a31b-b524-4ce4-9434-e7093f312162 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:54.196213 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-37e9a31b-b524-4ce4-9434-e7093f312162 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:54.456468 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-37e9a31b-b524-4ce4-9434-e7093f312162 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:54.472821 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-37e9a31b-b524-4ce4-9434-e7093f312162 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 200 len: 1278 microversion: 2.1 time: 0.306852 Oct 12 13:23:54.474297 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 289/577] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:54 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 1278 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:54.481164 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e7ab2411-e911-49ea-8146-79c456e2be64 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:54.482277 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-e7ab2411-e911-49ea-8146-79c456e2be64 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:54.489456 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e7ab2411-e911-49ea-8146-79c456e2be64 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:54.492409 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e7ab2411-e911-49ea-8146-79c456e2be64 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:54.492409 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e7ab2411-e911-49ea-8146-79c456e2be64 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:54.492409 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e7ab2411-e911-49ea-8146-79c456e2be64 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:54.492409 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e7ab2411-e911-49ea-8146-79c456e2be64 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:54.493315 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e7ab2411-e911-49ea-8146-79c456e2be64 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:54.689038 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d7d9b7bc-36f8-41cd-b9e9-b6c05487bc26 tempest-FloatingIPDetailsTestJSON-312440971 tempest-FloatingIPDetailsTestJSON-312440971-project] Action: 'create', calling method: .version_select at 0x7f8a9bc96e50>, body: {"pool": null} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:55.281138 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e7ab2411-e911-49ea-8146-79c456e2be64 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:55.288982 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e7ab2411-e911-49ea-8146-79c456e2be64 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 200 len: 1318 microversion: 2.1 time: 0.813060 Oct 12 13:23:55.289565 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 290/578] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:54 2022] GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 1318 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:55.303401 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-18758757-377e-47d1-914e-cde40dcf8761 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:55.304024 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-18758757-377e-47d1-914e-cde40dcf8761 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:55.325759 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-18758757-377e-47d1-914e-cde40dcf8761 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:55.328134 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-18758757-377e-47d1-914e-cde40dcf8761 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:55.328747 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-18758757-377e-47d1-914e-cde40dcf8761 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:55.329657 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-18758757-377e-47d1-914e-cde40dcf8761 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:55.330270 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-18758757-377e-47d1-914e-cde40dcf8761 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:55.330851 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-18758757-377e-47d1-914e-cde40dcf8761 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:55.533750 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-18758757-377e-47d1-914e-cde40dcf8761 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:55.549241 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-18758757-377e-47d1-914e-cde40dcf8761 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 200 len: 1271 microversion: 2.1 time: 0.257466 Oct 12 13:23:55.554073 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 291/579] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:55 2022] GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 1271 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:56.043141 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0470fbc7-0d51-4c8c-a3d9-355628d2980a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-498503724", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": "none"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:56.185187 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-0470fbc7-0d51-4c8c-a3d9-355628d2980a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:23:56.186577 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-0470fbc7-0d51-4c8c-a3d9-355628d2980a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:23:56.189877 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-0470fbc7-0d51-4c8c-a3d9-355628d2980a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:23:56.190431 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-0470fbc7-0d51-4c8c-a3d9-355628d2980a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:23:56.190988 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-0470fbc7-0d51-4c8c-a3d9-355628d2980a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:23:56.217605 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0470fbc7-0d51-4c8c-a3d9-355628d2980a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:56.218373 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0470fbc7-0d51-4c8c-a3d9-355628d2980a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:56.218891 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0470fbc7-0d51-4c8c-a3d9-355628d2980a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:56.224246 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0470fbc7-0d51-4c8c-a3d9-355628d2980a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:56.224246 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0470fbc7-0d51-4c8c-a3d9-355628d2980a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:56.224246 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0470fbc7-0d51-4c8c-a3d9-355628d2980a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:56.232436 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=6 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:56.251323 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-0470fbc7-0d51-4c8c-a3d9-355628d2980a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Getting quotas for project 5273399261154672b801633e535ee5e7. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:23:56.259285 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-0470fbc7-0d51-4c8c-a3d9-355628d2980a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Getting quotas for user 71c81ca6d9a04eceaf753a9e5bfcbb84 and project 5273399261154672b801633e535ee5e7. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:23:56.275222 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-0470fbc7-0d51-4c8c-a3d9-355628d2980a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Going to run 1 instances... {{(pid=120933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:23:56.278352 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-0470fbc7-0d51-4c8c-a3d9-355628d2980a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:23:56.479925 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0470fbc7-0d51-4c8c-a3d9-355628d2980a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.918875 Oct 12 13:23:56.482411 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 292/580] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 12 13:23:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 13:23:56.503943 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f8237686-21de-407d-9c78-064b4922f19d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:56.508719 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f8237686-21de-407d-9c78-064b4922f19d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:56.530655 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f8237686-21de-407d-9c78-064b4922f19d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:56.532244 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f8237686-21de-407d-9c78-064b4922f19d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:56.533877 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f8237686-21de-407d-9c78-064b4922f19d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:56.537012 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f8237686-21de-407d-9c78-064b4922f19d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:56.539532 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f8237686-21de-407d-9c78-064b4922f19d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:56.540164 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f8237686-21de-407d-9c78-064b4922f19d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:56.673461 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f8237686-21de-407d-9c78-064b4922f19d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:56.685400 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f8237686-21de-407d-9c78-064b4922f19d tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17" status: 200 len: 1212 microversion: 2.1 time: 0.199812 Oct 12 13:23:56.688047 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 293/581] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:56 2022] GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 => generated 1212 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:56.700203 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-42e6206a-a247-435f-8ab2-81966b5d5f1f tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:56.701685 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-42e6206a-a247-435f-8ab2-81966b5d5f1f tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:56.717961 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42e6206a-a247-435f-8ab2-81966b5d5f1f tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:56.719820 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42e6206a-a247-435f-8ab2-81966b5d5f1f tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:56.720569 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42e6206a-a247-435f-8ab2-81966b5d5f1f tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:56.722580 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42e6206a-a247-435f-8ab2-81966b5d5f1f tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:56.724367 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42e6206a-a247-435f-8ab2-81966b5d5f1f tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:56.726454 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42e6206a-a247-435f-8ab2-81966b5d5f1f tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:56.910212 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-42e6206a-a247-435f-8ab2-81966b5d5f1f tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:56.920129 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-42e6206a-a247-435f-8ab2-81966b5d5f1f tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 200 len: 1278 microversion: 2.1 time: 0.230587 Oct 12 13:23:56.924076 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 294/582] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:56 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 1278 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:56.934826 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-100106ce-3d7f-4d92-8ba2-9dc0a3da50f6 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:56.935435 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-100106ce-3d7f-4d92-8ba2-9dc0a3da50f6 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:56.950733 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-100106ce-3d7f-4d92-8ba2-9dc0a3da50f6 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:56.951226 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-100106ce-3d7f-4d92-8ba2-9dc0a3da50f6 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:56.951662 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-100106ce-3d7f-4d92-8ba2-9dc0a3da50f6 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:56.952370 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-100106ce-3d7f-4d92-8ba2-9dc0a3da50f6 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:56.952831 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-100106ce-3d7f-4d92-8ba2-9dc0a3da50f6 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:56.953282 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-100106ce-3d7f-4d92-8ba2-9dc0a3da50f6 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:57.391360 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-100106ce-3d7f-4d92-8ba2-9dc0a3da50f6 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:57.408122 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-100106ce-3d7f-4d92-8ba2-9dc0a3da50f6 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 200 len: 1318 microversion: 2.1 time: 0.482940 Oct 12 13:23:57.421432 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 295/583] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:56 2022] GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 1318 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:57.433548 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a2828430-39e9-4cd1-8155-038d87cfcdb3 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:57.434404 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a2828430-39e9-4cd1-8155-038d87cfcdb3 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:57.581938 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a2828430-39e9-4cd1-8155-038d87cfcdb3 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:57.598737 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a2828430-39e9-4cd1-8155-038d87cfcdb3 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:57.605465 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a2828430-39e9-4cd1-8155-038d87cfcdb3 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:57.619818 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a2828430-39e9-4cd1-8155-038d87cfcdb3 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1452 microversion: 2.91 time: 0.196424 Oct 12 13:23:57.634131 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 296/584] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:23:57 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1452 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:23:57.655942 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-89c6df97-19e8-4976-a478-6317ea7603a1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:57.656560 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-89c6df97-19e8-4976-a478-6317ea7603a1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:57.676229 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-89c6df97-19e8-4976-a478-6317ea7603a1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:57.677053 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-89c6df97-19e8-4976-a478-6317ea7603a1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:57.680883 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-89c6df97-19e8-4976-a478-6317ea7603a1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:57.683765 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-89c6df97-19e8-4976-a478-6317ea7603a1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:57.683765 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-89c6df97-19e8-4976-a478-6317ea7603a1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:57.684178 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-89c6df97-19e8-4976-a478-6317ea7603a1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:57.994251 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=10 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:23:58.702120 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-89c6df97-19e8-4976-a478-6317ea7603a1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:58.713860 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-89c6df97-19e8-4976-a478-6317ea7603a1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 200 len: 1271 microversion: 2.1 time: 1.076729 Oct 12 13:23:58.716224 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 297/585] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:57 2022] GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 1271 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:59.081572 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-77fb7ba6-a2a1-4535-b644-8cc8a5774dbf tempest-FlavorsV2NegativeTest-887167490 tempest-FlavorsV2NegativeTest-887167490-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:59.099874 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-77fb7ba6-a2a1-4535-b644-8cc8a5774dbf tempest-FlavorsV2NegativeTest-887167490 tempest-FlavorsV2NegativeTest-887167490-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.367101 Oct 12 13:23:59.101133 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 298/586] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:23:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:59.117169 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-281519a3-b2af-42b2-8d4a-599095e091c9 req-e80bee9e-a2e5-41f9-9bfe-cbe1fc260e61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14676667-3743-4d37-8ff9-f8d161a483d4", "tag": "5170297d-0d3f-4e69-aa8a-6c0e40750532"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:23:59.139689 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-281519a3-b2af-42b2-8d4a-599095e091c9 req-e80bee9e-a2e5-41f9-9bfe-cbe1fc260e61 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:59.141001 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-281519a3-b2af-42b2-8d4a-599095e091c9 req-e80bee9e-a2e5-41f9-9bfe-cbe1fc260e61 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:59.142930 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-281519a3-b2af-42b2-8d4a-599095e091c9 req-e80bee9e-a2e5-41f9-9bfe-cbe1fc260e61 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:59.194281 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-281519a3-b2af-42b2-8d4a-599095e091c9 req-e80bee9e-a2e5-41f9-9bfe-cbe1fc260e61 service nova] Creating event network-changed:5170297d-0d3f-4e69-aa8a-6c0e40750532 for instance 14676667-3743-4d37-8ff9-f8d161a483d4 on n-h2-861076-2 Oct 12 13:23:59.202445 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-281519a3-b2af-42b2-8d4a-599095e091c9 req-e80bee9e-a2e5-41f9-9bfe-cbe1fc260e61 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099396 Oct 12 13:23:59.204172 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 299/587] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:23:59.209623 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8665f2d9-4f41-4d89-8f07-7b4111ef943f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:59.218336 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-8665f2d9-4f41-4d89-8f07-7b4111ef943f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:59.239976 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8665f2d9-4f41-4d89-8f07-7b4111ef943f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:59.241064 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8665f2d9-4f41-4d89-8f07-7b4111ef943f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:59.241716 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8665f2d9-4f41-4d89-8f07-7b4111ef943f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:59.242669 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8665f2d9-4f41-4d89-8f07-7b4111ef943f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:59.243307 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8665f2d9-4f41-4d89-8f07-7b4111ef943f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:59.243939 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8665f2d9-4f41-4d89-8f07-7b4111ef943f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:59.684594 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-8665f2d9-4f41-4d89-8f07-7b4111ef943f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:23:59.693997 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-8665f2d9-4f41-4d89-8f07-7b4111ef943f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17" status: 200 len: 1274 microversion: 2.1 time: 0.488327 Oct 12 13:23:59.706008 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 300/588] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:59 2022] GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 => generated 1274 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:23:59.711377 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c2479e59-2c7f-4fbe-ae11-3c4b6c9f4051 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:23:59.712226 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c2479e59-2c7f-4fbe-ae11-3c4b6c9f4051 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:23:59.729260 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2479e59-2c7f-4fbe-ae11-3c4b6c9f4051 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:59.737297 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2479e59-2c7f-4fbe-ae11-3c4b6c9f4051 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:59.738212 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2479e59-2c7f-4fbe-ae11-3c4b6c9f4051 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:23:59.751948 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2479e59-2c7f-4fbe-ae11-3c4b6c9f4051 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:23:59.769140 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2479e59-2c7f-4fbe-ae11-3c4b6c9f4051 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:23:59.769140 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2479e59-2c7f-4fbe-ae11-3c4b6c9f4051 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:00.409103 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-c2479e59-2c7f-4fbe-ae11-3c4b6c9f4051 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:00.425685 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c2479e59-2c7f-4fbe-ae11-3c4b6c9f4051 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 200 len: 1320 microversion: 2.1 time: 0.717886 Oct 12 13:24:00.426608 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 301/589] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:23:59 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 1320 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:00.431310 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a125339d-fb82-4669-8025-e773be484ced tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:00.431917 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a125339d-fb82-4669-8025-e773be484ced tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:00.450658 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a125339d-fb82-4669-8025-e773be484ced tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:00.451186 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a125339d-fb82-4669-8025-e773be484ced tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:00.451642 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a125339d-fb82-4669-8025-e773be484ced tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:00.452415 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a125339d-fb82-4669-8025-e773be484ced tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:00.453101 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a125339d-fb82-4669-8025-e773be484ced tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:00.453688 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a125339d-fb82-4669-8025-e773be484ced tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:01.007875 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a125339d-fb82-4669-8025-e773be484ced tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:01.024110 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a125339d-fb82-4669-8025-e773be484ced tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 200 len: 1318 microversion: 2.1 time: 0.595832 Oct 12 13:24:01.026641 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 302/590] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:00 2022] GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 1318 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:01.037166 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-515525b1-a6c2-46f6-82ad-5c153cb2caed tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:01.038447 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-515525b1-a6c2-46f6-82ad-5c153cb2caed tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:01.045575 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-515525b1-a6c2-46f6-82ad-5c153cb2caed tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:01.046484 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-515525b1-a6c2-46f6-82ad-5c153cb2caed tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:01.047224 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-515525b1-a6c2-46f6-82ad-5c153cb2caed tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:01.049539 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-515525b1-a6c2-46f6-82ad-5c153cb2caed tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:01.050239 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-515525b1-a6c2-46f6-82ad-5c153cb2caed tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:01.050882 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-515525b1-a6c2-46f6-82ad-5c153cb2caed tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:01.080531 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d7d9b7bc-36f8-41cd-b9e9-b6c05487bc26 tempest-FloatingIPDetailsTestJSON-312440971 tempest-FloatingIPDetailsTestJSON-312440971-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.044422 Oct 12 13:24:01.081842 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 289/591] 10.222.0.52 () {60 vars in 1170 bytes} [Wed Oct 12 13:23:54 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:01.088266 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1f15a0d0-89f7-4d6e-aa86-b4a9d10f3b3e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:01.089318 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1f15a0d0-89f7-4d6e-aa86-b4a9d10f3b3e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:01.099563 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1f15a0d0-89f7-4d6e-aa86-b4a9d10f3b3e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:01.101340 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1f15a0d0-89f7-4d6e-aa86-b4a9d10f3b3e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:01.102006 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1f15a0d0-89f7-4d6e-aa86-b4a9d10f3b3e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:01.103475 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1f15a0d0-89f7-4d6e-aa86-b4a9d10f3b3e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:01.104138 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1f15a0d0-89f7-4d6e-aa86-b4a9d10f3b3e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:01.106564 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1f15a0d0-89f7-4d6e-aa86-b4a9d10f3b3e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:01.176658 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-515525b1-a6c2-46f6-82ad-5c153cb2caed tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:01.195629 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-515525b1-a6c2-46f6-82ad-5c153cb2caed tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:01.197831 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-515525b1-a6c2-46f6-82ad-5c153cb2caed tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:01.206018 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-515525b1-a6c2-46f6-82ad-5c153cb2caed tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1510 microversion: 2.91 time: 0.174760 Oct 12 13:24:01.207608 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 303/592] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:01 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:01.214334 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1779e564-151e-4b91-9316-44a94050416c tempest-FlavorsV2NegativeTest-887167490 tempest-FlavorsV2NegativeTest-887167490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1765613065", "imageRef": "38ff3b0e-c206-46fa-93db-2fea87a41dad", "flavorRef": "452"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:01.307352 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-1779e564-151e-4b91-9316-44a94050416c tempest-FlavorsV2NegativeTest-887167490 tempest-FlavorsV2NegativeTest-887167490-project] validate_networks() for None {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:24:01.783919 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-1f15a0d0-89f7-4d6e-aa86-b4a9d10f3b3e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:01.798187 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1f15a0d0-89f7-4d6e-aa86-b4a9d10f3b3e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 200 len: 1313 microversion: 2.1 time: 0.714983 Oct 12 13:24:01.808620 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 290/593] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:01 2022] GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 1313 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:01.808620 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-caa0494c-9df3-424f-9d71-2df82d02d5cb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:01.808620 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-caa0494c-9df3-424f-9d71-2df82d02d5cb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:01.814112 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-caa0494c-9df3-424f-9d71-2df82d02d5cb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:01.814802 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-caa0494c-9df3-424f-9d71-2df82d02d5cb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:01.815429 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-caa0494c-9df3-424f-9d71-2df82d02d5cb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:01.816296 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-caa0494c-9df3-424f-9d71-2df82d02d5cb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:01.816926 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-caa0494c-9df3-424f-9d71-2df82d02d5cb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:01.817505 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-caa0494c-9df3-424f-9d71-2df82d02d5cb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:01.925298 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-caa0494c-9df3-424f-9d71-2df82d02d5cb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:01.937061 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-caa0494c-9df3-424f-9d71-2df82d02d5cb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17" status: 200 len: 1274 microversion: 2.1 time: 0.133491 Oct 12 13:24:01.937061 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 291/594] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:01 2022] GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 => generated 1274 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:01.952512 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5d28f3be-2cb9-4813-a208-1f0e1daaa7b4 tempest-FloatingIPDetailsTestJSON-312440971 tempest-FloatingIPDetailsTestJSON-312440971-project] Action: 'create', calling method: .version_select at 0x7f8a9bc96670>, body: {"pool": null} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:02.030929 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-1779e564-151e-4b91-9316-44a94050416c tempest-FlavorsV2NegativeTest-887167490 tempest-FlavorsV2NegativeTest-887167490-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 12 13:24:02.037938 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1779e564-151e-4b91-9316-44a94050416c tempest-FlavorsV2NegativeTest-887167490 tempest-FlavorsV2NegativeTest-887167490-project] Request method failure captured: Oct 12 13:24:02.037938 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:24:02.037938 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:24:02.037938 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:24:02.037938 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:24:02.037938 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 143 Oct 12 13:24:02.037938 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:24:02.037938 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:24:02.037938 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:24:02.037938 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:24:02.037938 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr_tYjxB07q7nSdUoruqXzxKFlOLaYEJFFevoTUkbQjgXKpIYz7olRhj-gONRiUhlNTlIxasfHXdbvyyM7selVWYSvMXIjTiVnn28tUIk2j8_wJrrkA_bzCehlmUT9-GYjdp30L7BAmeZ17kWiatUGpAtmlEmH5fsIa3dh0KDr9tHYg Oct 12 13:24:02.037938 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:24:02.037938 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:24:02.037938 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:24:02.037938 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:24:02.037938 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:24:02.037938 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:24:02.037938 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 81e85b0fa1b64df591630b7b4fe53cc9 Oct 12 13:24:02.037938 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-FlavorsV2NegativeTest-887167490 Oct 12 13:24:02.037938 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:24:02.037938 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:24:02.039792 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/81e85b0fa1b64df591630b7b4fe53cc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_81e85b0fa1b64df591630b7b4fe53cc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/81e85b0fa1b64df591630b7b4fe53cc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/81e85b0fa1b64df591630b7b4fe53cc9"}]}] Oct 12 13:24:02.039792 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-FlavorsV2NegativeTest-887167490 Oct 12 13:24:02.039792 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 81e85b0fa1b64df591630b7b4fe53cc9 Oct 12 13:24:02.039792 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-887167490 Oct 12 13:24:02.039792 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-FlavorsV2NegativeTest-887167490-project Oct 12 13:24:02.039792 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:24:02.039792 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:24:02.039792 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 0b797827ebc54310b497ec05c31c0802 Oct 12 13:24:02.039792 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-FlavorsV2NegativeTest-887167490-project Oct 12 13:24:02.039792 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:24:02.039792 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1765613065", "imageRef": "38ff3b0e-c206-46fa-93db-2fea87a41dad", "flavorRef": "452"}} Oct 12 13:24:02.039792 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:24:02.040695 n-d-861076-2 devstack@n-api.service[120933]: exception: Flavor's memory is too small for requested image. Oct 12 13:24:02.040695 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1765613065', 'imageRef': '38ff3b0e-c206-46fa-93db-2fea87a41dad', 'flavorRef': '452'}}} Oct 12 13:24:02.040695 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:24:02.040695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:02.040695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:24:02.040695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:24:02.040695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:24:02.040695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:24:02.040695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 12 13:24:02.040695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 12 13:24:02.040695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 12 13:24:02.040695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 12 13:24:02.040695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 12 13:24:02.040695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 12 13:24:02.040695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 12 13:24:02.040695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 12 13:24:02.040695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 12 13:24:02.040695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:02.040695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:24:02.040695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:02.044235 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:02.044235 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:24:02.044235 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:24:02.044235 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:24:02.044235 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:24:02.044235 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:24:02.044235 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:24:02.044235 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:24:02.044235 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:24:02.044235 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:24:02.044235 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:24:02.044235 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:24:02.044235 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:24:02.044235 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:24:02.044235 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 12 13:24:02.044235 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 12 13:24:02.044235 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 12 13:24:02.044235 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:02.044235 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:24:02.044235 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:02.044235 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:02.047266 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:24:02.047266 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:24:02.047266 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:24:02.047266 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:24:02.047266 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 12 13:24:02.047266 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:02.047266 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1779e564-151e-4b91-9316-44a94050416c tempest-FlavorsV2NegativeTest-887167490 tempest-FlavorsV2NegativeTest-887167490-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:24:02.047266 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1779e564-151e-4b91-9316-44a94050416c tempest-FlavorsV2NegativeTest-887167490 tempest-FlavorsV2NegativeTest-887167490-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.827008 Oct 12 13:24:02.051292 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 304/595] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:24:01 2022] POST /compute/v2.1/servers => generated 93 bytes in 843 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 13:24:02.057595 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-47b44802-bc04-4f98-8243-0b88d2cb61dc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:02.058430 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-47b44802-bc04-4f98-8243-0b88d2cb61dc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:02.095667 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-47b44802-bc04-4f98-8243-0b88d2cb61dc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:02.097106 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-47b44802-bc04-4f98-8243-0b88d2cb61dc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:02.114978 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-47b44802-bc04-4f98-8243-0b88d2cb61dc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:02.115867 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-47b44802-bc04-4f98-8243-0b88d2cb61dc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:02.116359 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-47b44802-bc04-4f98-8243-0b88d2cb61dc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:02.123526 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-47b44802-bc04-4f98-8243-0b88d2cb61dc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:02.437480 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-47b44802-bc04-4f98-8243-0b88d2cb61dc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:02.455765 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-47b44802-bc04-4f98-8243-0b88d2cb61dc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 200 len: 1320 microversion: 2.1 time: 0.402045 Oct 12 13:24:02.457225 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 305/596] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:02 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 1320 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:02.573802 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-39a2ded8-6032-4310-add8-2a1fd0076b46 req-f73fedf2-56d9-4a03-a471-036147529895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "551f2f8d-4679-4647-a8dd-ece2be8eac33", "tag": "8a9663e4-375c-4ed5-af37-d960c893ee70"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:02.599055 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-39a2ded8-6032-4310-add8-2a1fd0076b46 req-f73fedf2-56d9-4a03-a471-036147529895 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:02.602596 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-39a2ded8-6032-4310-add8-2a1fd0076b46 req-f73fedf2-56d9-4a03-a471-036147529895 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:02.603243 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-39a2ded8-6032-4310-add8-2a1fd0076b46 req-f73fedf2-56d9-4a03-a471-036147529895 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:02.628943 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-39a2ded8-6032-4310-add8-2a1fd0076b46 req-f73fedf2-56d9-4a03-a471-036147529895 service nova] Creating event network-changed:8a9663e4-375c-4ed5-af37-d960c893ee70 for instance 551f2f8d-4679-4647-a8dd-ece2be8eac33 on n-h2-861076-2 Oct 12 13:24:02.652002 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-39a2ded8-6032-4310-add8-2a1fd0076b46 req-f73fedf2-56d9-4a03-a471-036147529895 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193119 Oct 12 13:24:02.656874 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 306/597] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:02.664416 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-107bcdaf-347f-46c5-b36f-9ea7095b2cec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:02.671812 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-107bcdaf-347f-46c5-b36f-9ea7095b2cec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:02.686422 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-107bcdaf-347f-46c5-b36f-9ea7095b2cec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:02.687196 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-107bcdaf-347f-46c5-b36f-9ea7095b2cec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:02.687847 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-107bcdaf-347f-46c5-b36f-9ea7095b2cec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:02.688773 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-107bcdaf-347f-46c5-b36f-9ea7095b2cec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:02.689422 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-107bcdaf-347f-46c5-b36f-9ea7095b2cec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:02.691151 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-107bcdaf-347f-46c5-b36f-9ea7095b2cec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:03.371661 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-107bcdaf-347f-46c5-b36f-9ea7095b2cec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:03.384155 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-107bcdaf-347f-46c5-b36f-9ea7095b2cec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 200 len: 1318 microversion: 2.1 time: 0.725711 Oct 12 13:24:03.384777 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 307/598] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:02 2022] GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 1318 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:03.406478 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-c4ea3007-fc8c-44f0-bce9-abb5acc8d50d req-4aa75247-98b2-4ac5-8407-4f2d30538950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fb212be-202b-4e4d-993a-80dfa753aa9d", "tag": "59a191b0-d550-4432-be96-95cccb474ded"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:03.417534 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-c4ea3007-fc8c-44f0-bce9-abb5acc8d50d req-4aa75247-98b2-4ac5-8407-4f2d30538950 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:03.420183 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-c4ea3007-fc8c-44f0-bce9-abb5acc8d50d req-4aa75247-98b2-4ac5-8407-4f2d30538950 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:03.423276 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-c4ea3007-fc8c-44f0-bce9-abb5acc8d50d req-4aa75247-98b2-4ac5-8407-4f2d30538950 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:03.439307 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-c4ea3007-fc8c-44f0-bce9-abb5acc8d50d req-4aa75247-98b2-4ac5-8407-4f2d30538950 service nova] Creating event network-changed:59a191b0-d550-4432-be96-95cccb474ded for instance 5fb212be-202b-4e4d-993a-80dfa753aa9d on n-h2-861076-2 Oct 12 13:24:03.455228 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-c4ea3007-fc8c-44f0-bce9-abb5acc8d50d req-4aa75247-98b2-4ac5-8407-4f2d30538950 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066672 Oct 12 13:24:03.456605 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 308/599] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:03.462246 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-258bbd2b-76b1-4fe4-b260-ad12ebef8c34 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:03.463211 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-258bbd2b-76b1-4fe4-b260-ad12ebef8c34 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:03.486154 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-258bbd2b-76b1-4fe4-b260-ad12ebef8c34 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:03.487070 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-258bbd2b-76b1-4fe4-b260-ad12ebef8c34 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:03.488163 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-258bbd2b-76b1-4fe4-b260-ad12ebef8c34 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:03.489384 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-258bbd2b-76b1-4fe4-b260-ad12ebef8c34 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:03.490046 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-258bbd2b-76b1-4fe4-b260-ad12ebef8c34 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:03.495887 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-258bbd2b-76b1-4fe4-b260-ad12ebef8c34 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:03.742398 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-258bbd2b-76b1-4fe4-b260-ad12ebef8c34 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:03.756102 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-258bbd2b-76b1-4fe4-b260-ad12ebef8c34 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:03.766329 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-258bbd2b-76b1-4fe4-b260-ad12ebef8c34 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:03.800069 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-258bbd2b-76b1-4fe4-b260-ad12ebef8c34 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1531 microversion: 2.91 time: 0.338743 Oct 12 13:24:03.802368 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 309/600] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:03 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1531 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:03.820863 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cf48bf57-ebf5-4bc4-be6c-11d095529272 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:03.822994 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-cf48bf57-ebf5-4bc4-be6c-11d095529272 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:03.837058 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:03.840974 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cf48bf57-ebf5-4bc4-be6c-11d095529272 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:03.841481 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cf48bf57-ebf5-4bc4-be6c-11d095529272 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:03.842463 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cf48bf57-ebf5-4bc4-be6c-11d095529272 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:03.849533 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cf48bf57-ebf5-4bc4-be6c-11d095529272 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:03.850173 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cf48bf57-ebf5-4bc4-be6c-11d095529272 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:03.851314 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cf48bf57-ebf5-4bc4-be6c-11d095529272 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:04.786594 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-cf48bf57-ebf5-4bc4-be6c-11d095529272 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:04.788728 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=100 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:04.805363 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-cf48bf57-ebf5-4bc4-be6c-11d095529272 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 200 len: 1313 microversion: 2.1 time: 1.001408 Oct 12 13:24:04.806971 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 310/601] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:03 2022] GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 1313 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:04.811114 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f91c05b3-df08-47e6-b1fa-ee983cb2e6ed tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:04.812489 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f91c05b3-df08-47e6-b1fa-ee983cb2e6ed tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:04.828961 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f91c05b3-df08-47e6-b1fa-ee983cb2e6ed tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:04.829437 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f91c05b3-df08-47e6-b1fa-ee983cb2e6ed tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:04.830051 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f91c05b3-df08-47e6-b1fa-ee983cb2e6ed tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:04.830978 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f91c05b3-df08-47e6-b1fa-ee983cb2e6ed tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:04.831603 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f91c05b3-df08-47e6-b1fa-ee983cb2e6ed tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:04.832302 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f91c05b3-df08-47e6-b1fa-ee983cb2e6ed tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:05.075517 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f91c05b3-df08-47e6-b1fa-ee983cb2e6ed tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:05.130077 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f91c05b3-df08-47e6-b1fa-ee983cb2e6ed tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17" status: 200 len: 1274 microversion: 2.1 time: 0.322061 Oct 12 13:24:05.138954 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 311/602] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:04 2022] GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 => generated 1274 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:05.159732 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7fc89bd5-3bf1-488f-bbb2-0b2e62ae2455 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:05.163478 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7fc89bd5-3bf1-488f-bbb2-0b2e62ae2455 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:05.187775 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7fc89bd5-3bf1-488f-bbb2-0b2e62ae2455 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:05.192863 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7fc89bd5-3bf1-488f-bbb2-0b2e62ae2455 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:05.192863 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7fc89bd5-3bf1-488f-bbb2-0b2e62ae2455 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:05.197357 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7fc89bd5-3bf1-488f-bbb2-0b2e62ae2455 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:05.198113 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7fc89bd5-3bf1-488f-bbb2-0b2e62ae2455 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:05.202706 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7fc89bd5-3bf1-488f-bbb2-0b2e62ae2455 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:06.074316 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-7fc89bd5-3bf1-488f-bbb2-0b2e62ae2455 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:06.085200 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-7fc89bd5-3bf1-488f-bbb2-0b2e62ae2455 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 200 len: 1320 microversion: 2.1 time: 0.944701 Oct 12 13:24:06.092262 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 312/603] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:05 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 1320 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:06.241372 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=14 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:06.631287 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-038f82a3-3da9-401c-9772-6193d18a7358 tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:06.631287 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-038f82a3-3da9-401c-9772-6193d18a7358 tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:06.641670 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-038f82a3-3da9-401c-9772-6193d18a7358 tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:06.642907 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-038f82a3-3da9-401c-9772-6193d18a7358 tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:06.643648 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-038f82a3-3da9-401c-9772-6193d18a7358 tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:06.644638 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-038f82a3-3da9-401c-9772-6193d18a7358 tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:06.645523 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-038f82a3-3da9-401c-9772-6193d18a7358 tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:06.646609 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-038f82a3-3da9-401c-9772-6193d18a7358 tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:06.837958 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-038f82a3-3da9-401c-9772-6193d18a7358 tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Lazy-loading 'services' on Instance uuid 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:24:06.858464 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-038f82a3-3da9-401c-9772-6193d18a7358 tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1936 microversion: 2.91 time: 0.764852 Oct 12 13:24:06.862349 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 313/604] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:06 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1936 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:06.864751 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0aeb6f26-418f-4f04-b9d8-c44d5c0a77c0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:06.865622 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-0aeb6f26-418f-4f04-b9d8-c44d5c0a77c0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:06.871753 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0aeb6f26-418f-4f04-b9d8-c44d5c0a77c0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:06.872239 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0aeb6f26-418f-4f04-b9d8-c44d5c0a77c0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:06.872676 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0aeb6f26-418f-4f04-b9d8-c44d5c0a77c0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:06.873519 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0aeb6f26-418f-4f04-b9d8-c44d5c0a77c0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:06.873978 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0aeb6f26-418f-4f04-b9d8-c44d5c0a77c0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:06.874465 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0aeb6f26-418f-4f04-b9d8-c44d5c0a77c0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:07.366793 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-0aeb6f26-418f-4f04-b9d8-c44d5c0a77c0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:07.381644 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0aeb6f26-418f-4f04-b9d8-c44d5c0a77c0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 200 len: 1318 microversion: 2.1 time: 0.518166 Oct 12 13:24:07.383535 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 314/605] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:06 2022] GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 1318 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:07.398143 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-4afc93b8-9e40-435e-83fd-a39b366fa973 req-1b6fbf85-5d9f-4bf9-928b-eef1affda441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d88ccd8b-e58a-432a-9276-29cb5fa800af", "tag": "e1de3787-e3fa-4432-b69e-b1340e341a8b"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:07.421944 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-4afc93b8-9e40-435e-83fd-a39b366fa973 req-1b6fbf85-5d9f-4bf9-928b-eef1affda441 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:07.423813 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-4afc93b8-9e40-435e-83fd-a39b366fa973 req-1b6fbf85-5d9f-4bf9-928b-eef1affda441 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:07.424272 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-4afc93b8-9e40-435e-83fd-a39b366fa973 req-1b6fbf85-5d9f-4bf9-928b-eef1affda441 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:07.445472 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-4afc93b8-9e40-435e-83fd-a39b366fa973 req-1b6fbf85-5d9f-4bf9-928b-eef1affda441 service nova] Creating event network-changed:e1de3787-e3fa-4432-b69e-b1340e341a8b for instance d88ccd8b-e58a-432a-9276-29cb5fa800af on n-h2-861076-2 Oct 12 13:24:07.450513 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-4afc93b8-9e40-435e-83fd-a39b366fa973 req-1b6fbf85-5d9f-4bf9-928b-eef1affda441 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064190 Oct 12 13:24:07.451890 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 315/606] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:07.466087 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-f5594e11-92ec-432b-9c5d-89f9722874a2 req-49026442-c6b4-4282-a9ed-3dd38235e17c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14676667-3743-4d37-8ff9-f8d161a483d4", "name": "network-vif-plugged", "status": "completed", "tag": "5170297d-0d3f-4e69-aa8a-6c0e40750532"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:07.478454 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-f5594e11-92ec-432b-9c5d-89f9722874a2 req-49026442-c6b4-4282-a9ed-3dd38235e17c service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:07.479512 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-f5594e11-92ec-432b-9c5d-89f9722874a2 req-49026442-c6b4-4282-a9ed-3dd38235e17c service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:07.481499 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-f5594e11-92ec-432b-9c5d-89f9722874a2 req-49026442-c6b4-4282-a9ed-3dd38235e17c service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:07.499926 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-f5594e11-92ec-432b-9c5d-89f9722874a2 req-49026442-c6b4-4282-a9ed-3dd38235e17c service nova] Creating event network-vif-plugged:5170297d-0d3f-4e69-aa8a-6c0e40750532 for instance 14676667-3743-4d37-8ff9-f8d161a483d4 on n-h2-861076-2 Oct 12 13:24:07.508530 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-f5594e11-92ec-432b-9c5d-89f9722874a2 req-49026442-c6b4-4282-a9ed-3dd38235e17c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054359 Oct 12 13:24:07.510768 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 316/607] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:07.518186 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b4633207-046e-4e05-a59e-bc5d26e37620 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:07.519656 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-b4633207-046e-4e05-a59e-bc5d26e37620 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:07.528507 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4633207-046e-4e05-a59e-bc5d26e37620 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:07.530588 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4633207-046e-4e05-a59e-bc5d26e37620 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:07.530588 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4633207-046e-4e05-a59e-bc5d26e37620 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:07.531170 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4633207-046e-4e05-a59e-bc5d26e37620 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:07.531951 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4633207-046e-4e05-a59e-bc5d26e37620 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:07.532631 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4633207-046e-4e05-a59e-bc5d26e37620 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:07.607215 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=60 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:08.308702 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5d28f3be-2cb9-4813-a208-1f0e1daaa7b4 tempest-FloatingIPDetailsTestJSON-312440971 tempest-FloatingIPDetailsTestJSON-312440971-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.369661 Oct 12 13:24:08.310308 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 292/608] 10.222.0.52 () {60 vars in 1170 bytes} [Wed Oct 12 13:24:01 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:08.317109 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f06d5eaa-750b-415b-97db-1884e0ed1e2a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:08.318663 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f06d5eaa-750b-415b-97db-1884e0ed1e2a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:08.326586 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f06d5eaa-750b-415b-97db-1884e0ed1e2a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:08.332951 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f06d5eaa-750b-415b-97db-1884e0ed1e2a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:08.332951 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f06d5eaa-750b-415b-97db-1884e0ed1e2a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:08.332951 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f06d5eaa-750b-415b-97db-1884e0ed1e2a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:08.332951 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f06d5eaa-750b-415b-97db-1884e0ed1e2a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:08.333322 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f06d5eaa-750b-415b-97db-1884e0ed1e2a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:08.379706 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b4633207-046e-4e05-a59e-bc5d26e37620 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:08.389346 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b4633207-046e-4e05-a59e-bc5d26e37620 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 200 len: 1313 microversion: 2.1 time: 0.876915 Oct 12 13:24:08.408353 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 317/609] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:07 2022] GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 1313 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:08.413688 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-400a5911-2936-4453-9203-27e1a8fe13db tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:08.414939 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-400a5911-2936-4453-9203-27e1a8fe13db tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:08.422739 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-400a5911-2936-4453-9203-27e1a8fe13db tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:08.423616 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-400a5911-2936-4453-9203-27e1a8fe13db tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:08.424264 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-400a5911-2936-4453-9203-27e1a8fe13db tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:08.425207 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-400a5911-2936-4453-9203-27e1a8fe13db tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:08.425805 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-400a5911-2936-4453-9203-27e1a8fe13db tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:08.426425 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-400a5911-2936-4453-9203-27e1a8fe13db tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:08.608739 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-400a5911-2936-4453-9203-27e1a8fe13db tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Lazy-loading 'services' on Instance uuid 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:24:08.657037 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-400a5911-2936-4453-9203-27e1a8fe13db tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1936 microversion: 2.91 time: 0.247251 Oct 12 13:24:08.668931 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 318/610] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:08 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1936 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:08.668931 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-16aec559-b9af-4db4-b1ac-fb5814f9d51d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:08.668931 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-16aec559-b9af-4db4-b1ac-fb5814f9d51d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:08.677485 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-16aec559-b9af-4db4-b1ac-fb5814f9d51d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:08.677485 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-16aec559-b9af-4db4-b1ac-fb5814f9d51d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:08.677485 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-16aec559-b9af-4db4-b1ac-fb5814f9d51d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:08.677485 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-16aec559-b9af-4db4-b1ac-fb5814f9d51d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:08.677779 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-16aec559-b9af-4db4-b1ac-fb5814f9d51d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:08.677779 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-16aec559-b9af-4db4-b1ac-fb5814f9d51d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:08.716657 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f06d5eaa-750b-415b-97db-1884e0ed1e2a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:08.724749 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f06d5eaa-750b-415b-97db-1884e0ed1e2a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17" status: 200 len: 1316 microversion: 2.1 time: 0.413176 Oct 12 13:24:08.725944 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 293/611] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:08 2022] GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 => generated 1316 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:08.880268 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-43097c14-6e23-4717-be03-83ced0d4adf6 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Action: 'create', calling method: .version_select at 0x7f8a9be708b0>, body: {"keypair": {"name": "tempest-keypair-1050976536", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYdqmsjfF1zuc6spily9q012kKgJNTOX/dpRgn7gV54nyBzHlpeoecOosXfiNt+P9aOGnOQcYhxQtA4MZfaQdkG8tCTj91Lsh4lgHXAYzU6IeMb55O18SBK1/1+gCl6YA=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:08.896687 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-43097c14-6e23-4717-be03-83ced0d4adf6 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Getting quotas for project 24bf52715e8a4e14b6b1c231b91bd6ff. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:24:08.902653 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-43097c14-6e23-4717-be03-83ced0d4adf6 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Getting quotas for user 72f7ad67006b420c90eb37f8044dfb17 and project 24bf52715e8a4e14b6b1c231b91bd6ff. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:24:09.022908 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-43097c14-6e23-4717-be03-83ced0d4adf6 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.296333 Oct 12 13:24:09.039751 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 294/612] 10.222.0.52 () {62 vars in 1199 bytes} [Wed Oct 12 13:24:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 298 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 12 13:24:09.039751 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-98e888fd-1747-4e7c-81f7-35c38d9ee76d req-2e4687c1-db30-44f3-a9f1-bcd0b43c7d8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc77e94c-e9f8-4717-aecf-f5f222647117", "tag": "75bb8e1c-5674-4e19-963a-de9d1d18befe"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:09.039751 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-98e888fd-1747-4e7c-81f7-35c38d9ee76d req-2e4687c1-db30-44f3-a9f1-bcd0b43c7d8d service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:09.040117 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-98e888fd-1747-4e7c-81f7-35c38d9ee76d req-2e4687c1-db30-44f3-a9f1-bcd0b43c7d8d service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:09.040466 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-98e888fd-1747-4e7c-81f7-35c38d9ee76d req-2e4687c1-db30-44f3-a9f1-bcd0b43c7d8d service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:09.051272 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-98e888fd-1747-4e7c-81f7-35c38d9ee76d req-2e4687c1-db30-44f3-a9f1-bcd0b43c7d8d service nova] Creating event network-changed:75bb8e1c-5674-4e19-963a-de9d1d18befe for instance fc77e94c-e9f8-4717-aecf-f5f222647117 on n-h1-861076-2 Oct 12 13:24:09.056611 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-98e888fd-1747-4e7c-81f7-35c38d9ee76d req-2e4687c1-db30-44f3-a9f1-bcd0b43c7d8d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031584 Oct 12 13:24:09.057251 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 295/613] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:09.062489 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-06bc6ce0-9c4e-42d7-8c28-e4c66a94c02c tempest-FloatingIPDetailsTestJSON-312440971 tempest-FloatingIPDetailsTestJSON-312440971-project] Action: 'create', calling method: .version_select at 0x7f8a9bdb10d0>, body: {"pool": null} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:09.162933 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-16aec559-b9af-4db4-b1ac-fb5814f9d51d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:09.172373 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-16aec559-b9af-4db4-b1ac-fb5814f9d51d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 200 len: 1320 microversion: 2.1 time: 0.512499 Oct 12 13:24:09.173537 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 319/614] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:08 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 1320 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:09.186598 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c4ab96e9-71ea-4fa8-b7f7-d4e1f99c8d47 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:09.187872 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c4ab96e9-71ea-4fa8-b7f7-d4e1f99c8d47 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:09.194925 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c4ab96e9-71ea-4fa8-b7f7-d4e1f99c8d47 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:09.195595 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c4ab96e9-71ea-4fa8-b7f7-d4e1f99c8d47 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:09.196029 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c4ab96e9-71ea-4fa8-b7f7-d4e1f99c8d47 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:09.196729 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c4ab96e9-71ea-4fa8-b7f7-d4e1f99c8d47 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:09.197231 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c4ab96e9-71ea-4fa8-b7f7-d4e1f99c8d47 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:09.197667 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c4ab96e9-71ea-4fa8-b7f7-d4e1f99c8d47 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:09.666257 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-c4ab96e9-71ea-4fa8-b7f7-d4e1f99c8d47 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:09.674205 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c4ab96e9-71ea-4fa8-b7f7-d4e1f99c8d47 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 200 len: 1318 microversion: 2.1 time: 0.498520 Oct 12 13:24:09.674962 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 320/615] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:09 2022] GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:09.697360 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a1f7586d-586a-4e1f-8314-9a5542868c4e tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:09.702005 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a1f7586d-586a-4e1f-8314-9a5542868c4e tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:09.702656 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a1f7586d-586a-4e1f-8314-9a5542868c4e tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:09.703272 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a1f7586d-586a-4e1f-8314-9a5542868c4e tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:09.704164 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a1f7586d-586a-4e1f-8314-9a5542868c4e tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:09.704770 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a1f7586d-586a-4e1f-8314-9a5542868c4e tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:09.705225 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a1f7586d-586a-4e1f-8314-9a5542868c4e tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:09.734977 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a1f7586d-586a-4e1f-8314-9a5542868c4e tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.056389 Oct 12 13:24:09.734977 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 321/616] 10.222.0.52 () {60 vars in 1217 bytes} [Wed Oct 12 13:24:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:24:09.739572 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-09d57514-df02-4a41-bb2f-77cf5bcb9fae tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Calling method '.version_select at 0x7f8aa0142f70>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:09.748977 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-09d57514-df02-4a41-bb2f-77cf5bcb9fae tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-1050976536" status: 200 len: 512 microversion: 2.2 time: 0.013142 Oct 12 13:24:09.749538 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 322/617] 10.222.0.52 () {60 vars in 1258 bytes} [Wed Oct 12 13:24:09 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1050976536 => generated 512 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:09.762944 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5f0847a0-4d78-4a92-bc05-92186e84bbd9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:09.763570 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-5f0847a0-4d78-4a92-bc05-92186e84bbd9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:09.771682 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5f0847a0-4d78-4a92-bc05-92186e84bbd9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:09.772180 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5f0847a0-4d78-4a92-bc05-92186e84bbd9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:09.773784 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5f0847a0-4d78-4a92-bc05-92186e84bbd9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:09.773922 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5f0847a0-4d78-4a92-bc05-92186e84bbd9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:09.774281 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5f0847a0-4d78-4a92-bc05-92186e84bbd9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:09.774726 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5f0847a0-4d78-4a92-bc05-92186e84bbd9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:10.385051 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-5f0847a0-4d78-4a92-bc05-92186e84bbd9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:10.393173 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5f0847a0-4d78-4a92-bc05-92186e84bbd9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 200 len: 1313 microversion: 2.1 time: 0.635117 Oct 12 13:24:10.393749 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 323/618] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:09 2022] GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 1313 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:10.398578 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3e4a924e-7bef-4b8b-9af3-1ad7fe14f149 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:10.399302 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-3e4a924e-7bef-4b8b-9af3-1ad7fe14f149 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:10.405996 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e4a924e-7bef-4b8b-9af3-1ad7fe14f149 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:10.405996 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e4a924e-7bef-4b8b-9af3-1ad7fe14f149 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:10.406435 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e4a924e-7bef-4b8b-9af3-1ad7fe14f149 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:10.406843 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e4a924e-7bef-4b8b-9af3-1ad7fe14f149 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:10.407306 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e4a924e-7bef-4b8b-9af3-1ad7fe14f149 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:10.407742 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e4a924e-7bef-4b8b-9af3-1ad7fe14f149 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:10.431936 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-3e4a924e-7bef-4b8b-9af3-1ad7fe14f149 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lazy-loading 'flavor' on Instance uuid 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:24:10.950002 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3e4a924e-7bef-4b8b-9af3-1ad7fe14f149 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "POST /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b/action" status: 202 len: 0 microversion: 2.91 time: 0.554665 Oct 12 13:24:10.950613 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 324/619] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Oct 12 13:24:10 2022] POST /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b/action => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:24:10.956111 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b15ee153-7c0a-46dc-900a-f0afe42964ef tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:10.957621 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-b15ee153-7c0a-46dc-900a-f0afe42964ef tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:10.965352 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b15ee153-7c0a-46dc-900a-f0afe42964ef tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:10.966081 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b15ee153-7c0a-46dc-900a-f0afe42964ef tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:10.966698 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b15ee153-7c0a-46dc-900a-f0afe42964ef tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:10.968504 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b15ee153-7c0a-46dc-900a-f0afe42964ef tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:10.968504 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b15ee153-7c0a-46dc-900a-f0afe42964ef tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:10.968504 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b15ee153-7c0a-46dc-900a-f0afe42964ef tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:11.435413 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b15ee153-7c0a-46dc-900a-f0afe42964ef tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:11.448640 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b15ee153-7c0a-46dc-900a-f0afe42964ef tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17" status: 200 len: 1316 microversion: 2.1 time: 0.496752 Oct 12 13:24:11.465787 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 325/620] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:10 2022] GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 => generated 1316 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:11.471868 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ea54ec1e-d256-41e3-8215-d1be90f1c8ab tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Calling method '.version_select at 0x7f8aa0045dc0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:11.590013 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ea54ec1e-d256-41e3-8215-d1be90f1c8ab tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1050976536" status: 204 len: 0 microversion: 2.2 time: 0.122757 Oct 12 13:24:11.590604 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 326/621] 10.222.0.52 () {60 vars in 1261 bytes} [Wed Oct 12 13:24:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1050976536 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:24:11.595465 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7e1094f8-4d98-4a40-abb5-49453a6b8234 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:11.596005 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7e1094f8-4d98-4a40-abb5-49453a6b8234 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:11.603151 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7e1094f8-4d98-4a40-abb5-49453a6b8234 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:11.603632 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7e1094f8-4d98-4a40-abb5-49453a6b8234 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:11.604062 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7e1094f8-4d98-4a40-abb5-49453a6b8234 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:11.604751 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7e1094f8-4d98-4a40-abb5-49453a6b8234 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:11.605227 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7e1094f8-4d98-4a40-abb5-49453a6b8234 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:11.605662 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7e1094f8-4d98-4a40-abb5-49453a6b8234 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:12.421650 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-7e1094f8-4d98-4a40-abb5-49453a6b8234 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:12.434752 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-7e1094f8-4d98-4a40-abb5-49453a6b8234 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 200 len: 1320 microversion: 2.1 time: 0.842989 Oct 12 13:24:12.435486 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 327/622] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:11 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 1320 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:12.442851 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-337b9dd1-3ff4-4b4d-bd68-22c56d054b59 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:12.442851 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-337b9dd1-3ff4-4b4d-bd68-22c56d054b59 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:12.448133 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-337b9dd1-3ff4-4b4d-bd68-22c56d054b59 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:12.448840 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-337b9dd1-3ff4-4b4d-bd68-22c56d054b59 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:12.449586 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-337b9dd1-3ff4-4b4d-bd68-22c56d054b59 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:12.450493 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-337b9dd1-3ff4-4b4d-bd68-22c56d054b59 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:12.451162 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-337b9dd1-3ff4-4b4d-bd68-22c56d054b59 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:12.451805 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-337b9dd1-3ff4-4b4d-bd68-22c56d054b59 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:12.850831 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-337b9dd1-3ff4-4b4d-bd68-22c56d054b59 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:12.856780 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:12.859484 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-337b9dd1-3ff4-4b4d-bd68-22c56d054b59 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 200 len: 1318 microversion: 2.1 time: 0.422828 Oct 12 13:24:12.860258 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 328/623] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:12 2022] GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:12.879751 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6dc1bae4-89e0-4b63-9f95-dfc6447b57b2 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:12.888806 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-6dc1bae4-89e0-4b63-9f95-dfc6447b57b2 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:12.888806 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6dc1bae4-89e0-4b63-9f95-dfc6447b57b2 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:12.888806 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6dc1bae4-89e0-4b63-9f95-dfc6447b57b2 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:12.888806 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6dc1bae4-89e0-4b63-9f95-dfc6447b57b2 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:12.889307 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6dc1bae4-89e0-4b63-9f95-dfc6447b57b2 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:12.889693 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6dc1bae4-89e0-4b63-9f95-dfc6447b57b2 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:12.890134 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6dc1bae4-89e0-4b63-9f95-dfc6447b57b2 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:12.988343 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-6dc1bae4-89e0-4b63-9f95-dfc6447b57b2 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:12.996527 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-6dc1bae4-89e0-4b63-9f95-dfc6447b57b2 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:12.998020 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-6dc1bae4-89e0-4b63-9f95-dfc6447b57b2 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:13.003024 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6dc1bae4-89e0-4b63-9f95-dfc6447b57b2 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1537 microversion: 2.91 time: 0.127224 Oct 12 13:24:13.003603 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 329/624] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:12 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1537 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:13.007995 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-9a59a1b6-21cc-48c9-b68c-4f5591ca72d4 req-aeaecd67-0cf6-416d-875b-e2c1e7667f89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36dbc389-96b0-4e73-8fa4-c2f58e5a7b17", "tag": "453d09e8-2e47-4808-8698-8d0d4d8de8e9"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:13.017579 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-9a59a1b6-21cc-48c9-b68c-4f5591ca72d4 req-aeaecd67-0cf6-416d-875b-e2c1e7667f89 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:13.018065 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-9a59a1b6-21cc-48c9-b68c-4f5591ca72d4 req-aeaecd67-0cf6-416d-875b-e2c1e7667f89 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:13.018501 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-9a59a1b6-21cc-48c9-b68c-4f5591ca72d4 req-aeaecd67-0cf6-416d-875b-e2c1e7667f89 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:13.029770 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-9a59a1b6-21cc-48c9-b68c-4f5591ca72d4 req-aeaecd67-0cf6-416d-875b-e2c1e7667f89 service nova] Creating event network-changed:453d09e8-2e47-4808-8698-8d0d4d8de8e9 for instance 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 on n-h1-861076-2 Oct 12 13:24:13.034589 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-9a59a1b6-21cc-48c9-b68c-4f5591ca72d4 req-aeaecd67-0cf6-416d-875b-e2c1e7667f89 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029876 Oct 12 13:24:13.035173 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 330/625] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:13.040874 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1ad5f15d-eb75-4d3a-aacb-d9e09d420c53 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:13.043849 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-1ad5f15d-eb75-4d3a-aacb-d9e09d420c53 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:13.047989 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1ad5f15d-eb75-4d3a-aacb-d9e09d420c53 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:13.048483 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1ad5f15d-eb75-4d3a-aacb-d9e09d420c53 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:13.048938 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1ad5f15d-eb75-4d3a-aacb-d9e09d420c53 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:13.049644 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1ad5f15d-eb75-4d3a-aacb-d9e09d420c53 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:13.050107 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1ad5f15d-eb75-4d3a-aacb-d9e09d420c53 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:13.050536 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1ad5f15d-eb75-4d3a-aacb-d9e09d420c53 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:13.337577 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-06bc6ce0-9c4e-42d7-8c28-e4c66a94c02c tempest-FloatingIPDetailsTestJSON-312440971 tempest-FloatingIPDetailsTestJSON-312440971-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.278924 Oct 12 13:24:13.338381 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 296/626] 10.222.0.52 () {60 vars in 1170 bytes} [Wed Oct 12 13:24:09 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:13.349440 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-96514ecd-f3cc-4d27-b25e-77a5d0d548bc req-799ec459-f868-46a0-9027-ea0cf7d2fc9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb212be-202b-4e4d-993a-80dfa753aa9d", "name": "network-vif-plugged", "status": "completed", "tag": "59a191b0-d550-4432-be96-95cccb474ded"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:13.360834 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-96514ecd-f3cc-4d27-b25e-77a5d0d548bc req-799ec459-f868-46a0-9027-ea0cf7d2fc9d service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:13.361609 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-96514ecd-f3cc-4d27-b25e-77a5d0d548bc req-799ec459-f868-46a0-9027-ea0cf7d2fc9d service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:13.362200 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-96514ecd-f3cc-4d27-b25e-77a5d0d548bc req-799ec459-f868-46a0-9027-ea0cf7d2fc9d service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:13.378834 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-96514ecd-f3cc-4d27-b25e-77a5d0d548bc req-799ec459-f868-46a0-9027-ea0cf7d2fc9d service nova] Creating event network-vif-plugged:59a191b0-d550-4432-be96-95cccb474ded for instance 5fb212be-202b-4e4d-993a-80dfa753aa9d on n-h2-861076-2 Oct 12 13:24:13.384512 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-96514ecd-f3cc-4d27-b25e-77a5d0d548bc req-799ec459-f868-46a0-9027-ea0cf7d2fc9d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044700 Oct 12 13:24:13.385705 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 297/627] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:13.395458 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c4c2bc55-fa93-4430-9c4c-c843d2cbd950 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Action: 'create', calling method: .version_select at 0x7f8a9bd59ca0>, body: {"keypair": {"name": "tempest-keypair-1920082925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFziKwAxNmP1Vg5YSLTKBfEX+A9gCPLVt3RipHgSrwCdbl4REgPcchsMUnpB8h6b15ogQO7L/iXhsrvZzs1Rpc1nlrcLxXM4DT8jumyYm9Z7psoGLWDvvzo1Tr6kmlSRWw=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:13.413506 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-c4c2bc55-fa93-4430-9c4c-c843d2cbd950 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Getting quotas for project 24bf52715e8a4e14b6b1c231b91bd6ff. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:24:13.421117 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-c4c2bc55-fa93-4430-9c4c-c843d2cbd950 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Getting quotas for user 72f7ad67006b420c90eb37f8044dfb17 and project 24bf52715e8a4e14b6b1c231b91bd6ff. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:24:13.441314 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-1ad5f15d-eb75-4d3a-aacb-d9e09d420c53 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:13.458823 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1ad5f15d-eb75-4d3a-aacb-d9e09d420c53 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 200 len: 1313 microversion: 2.1 time: 0.421865 Oct 12 13:24:13.460345 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 331/628] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:13 2022] GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:13.467356 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7b3b8794-8716-4ab5-a8d2-0bfbfc10efd2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:13.468208 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7b3b8794-8716-4ab5-a8d2-0bfbfc10efd2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:13.476652 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7b3b8794-8716-4ab5-a8d2-0bfbfc10efd2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:13.477311 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7b3b8794-8716-4ab5-a8d2-0bfbfc10efd2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:13.477846 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7b3b8794-8716-4ab5-a8d2-0bfbfc10efd2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:13.478968 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7b3b8794-8716-4ab5-a8d2-0bfbfc10efd2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:13.479520 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7b3b8794-8716-4ab5-a8d2-0bfbfc10efd2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:13.480000 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7b3b8794-8716-4ab5-a8d2-0bfbfc10efd2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:13.535088 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c4c2bc55-fa93-4430-9c4c-c843d2cbd950 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.147696 Oct 12 13:24:13.535708 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 298/629] 10.222.0.52 () {62 vars in 1199 bytes} [Wed Oct 12 13:24:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 149 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 12 13:24:13.540943 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bc4d50bc-d6d9-4edd-ae7e-0027493152e9 tempest-FloatingIPDetailsTestJSON-312440971 tempest-FloatingIPDetailsTestJSON-312440971-project] Action: 'create', calling method: .version_select at 0x7f8a9bc98af0>, body: {"pool": null} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:14.088575 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-7b3b8794-8716-4ab5-a8d2-0bfbfc10efd2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:14.098022 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-7b3b8794-8716-4ab5-a8d2-0bfbfc10efd2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17" status: 200 len: 1316 microversion: 2.1 time: 0.635637 Oct 12 13:24:14.115127 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 332/630] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:13 2022] GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 => generated 1316 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:14.121166 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-67c48442-02dd-4c40-b7f1-e581b8ad8957 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:14.122035 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-67c48442-02dd-4c40-b7f1-e581b8ad8957 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:14.130527 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-67c48442-02dd-4c40-b7f1-e581b8ad8957 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:14.131931 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-67c48442-02dd-4c40-b7f1-e581b8ad8957 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:14.133331 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-67c48442-02dd-4c40-b7f1-e581b8ad8957 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:14.136414 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-67c48442-02dd-4c40-b7f1-e581b8ad8957 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:14.136414 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-67c48442-02dd-4c40-b7f1-e581b8ad8957 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:14.136414 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-67c48442-02dd-4c40-b7f1-e581b8ad8957 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:14.815257 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-67c48442-02dd-4c40-b7f1-e581b8ad8957 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:14.823544 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-67c48442-02dd-4c40-b7f1-e581b8ad8957 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 200 len: 1320 microversion: 2.1 time: 0.707235 Oct 12 13:24:14.824127 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 333/631] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:14 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 1320 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:14.828688 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9ff4d5fa-1da4-4a21-aff6-eb9cfa02124c tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Calling method '.version_select at 0x7f8aa0060160>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:14.935209 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9ff4d5fa-1da4-4a21-aff6-eb9cfa02124c tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1920082925" status: 204 len: 0 microversion: 2.2 time: 0.110033 Oct 12 13:24:14.941017 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 334/632] 10.222.0.52 () {60 vars in 1261 bytes} [Wed Oct 12 13:24:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1920082925 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:24:14.947040 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5a33b760-c425-4680-ba24-6e32d2abcc18 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:14.947662 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-5a33b760-c425-4680-ba24-6e32d2abcc18 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:14.954571 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5a33b760-c425-4680-ba24-6e32d2abcc18 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:14.954973 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5a33b760-c425-4680-ba24-6e32d2abcc18 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:14.955468 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5a33b760-c425-4680-ba24-6e32d2abcc18 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:14.956244 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5a33b760-c425-4680-ba24-6e32d2abcc18 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:14.956712 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5a33b760-c425-4680-ba24-6e32d2abcc18 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:14.957230 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5a33b760-c425-4680-ba24-6e32d2abcc18 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:15.367610 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-5a33b760-c425-4680-ba24-6e32d2abcc18 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:15.377438 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5a33b760-c425-4680-ba24-6e32d2abcc18 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 200 len: 1318 microversion: 2.1 time: 0.435016 Oct 12 13:24:15.378108 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 335/633] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:14 2022] GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:15.400521 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-605d4761-d30e-4ded-a7ee-6d9e296f28f7 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:15.401471 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-605d4761-d30e-4ded-a7ee-6d9e296f28f7 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:15.409402 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-605d4761-d30e-4ded-a7ee-6d9e296f28f7 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:15.409888 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-605d4761-d30e-4ded-a7ee-6d9e296f28f7 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:15.410319 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-605d4761-d30e-4ded-a7ee-6d9e296f28f7 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:15.411333 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-605d4761-d30e-4ded-a7ee-6d9e296f28f7 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:15.411892 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-605d4761-d30e-4ded-a7ee-6d9e296f28f7 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:15.412197 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-605d4761-d30e-4ded-a7ee-6d9e296f28f7 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:15.512965 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-605d4761-d30e-4ded-a7ee-6d9e296f28f7 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:15.523561 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-605d4761-d30e-4ded-a7ee-6d9e296f28f7 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:15.525909 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-605d4761-d30e-4ded-a7ee-6d9e296f28f7 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:15.536305 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-605d4761-d30e-4ded-a7ee-6d9e296f28f7 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1537 microversion: 2.91 time: 0.145686 Oct 12 13:24:15.553138 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 336/634] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:15 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1537 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:15.557644 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a1ef3604-8c26-4173-aa06-817df27123ed tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:15.558246 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a1ef3604-8c26-4173-aa06-817df27123ed tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:15.565043 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a1ef3604-8c26-4173-aa06-817df27123ed tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:15.566811 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a1ef3604-8c26-4173-aa06-817df27123ed tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:15.567454 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a1ef3604-8c26-4173-aa06-817df27123ed tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:15.568237 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a1ef3604-8c26-4173-aa06-817df27123ed tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:15.569274 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a1ef3604-8c26-4173-aa06-817df27123ed tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:15.570055 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a1ef3604-8c26-4173-aa06-817df27123ed tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:15.855070 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a1ef3604-8c26-4173-aa06-817df27123ed tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:15.898910 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a1ef3604-8c26-4173-aa06-817df27123ed tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 200 len: 1313 microversion: 2.1 time: 0.360539 Oct 12 13:24:15.899675 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 337/635] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:15 2022] GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:15.911797 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3417d3e9-9f5e-4908-9ff8-84c969b1aab9 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Action: 'create', calling method: .version_select at 0x7f8aa0142700>, body: {"keypair": {"name": "tempest-keypair-1864009055", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:15.950904 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-3417d3e9-9f5e-4908-9ff8-84c969b1aab9 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Getting quotas for project 24bf52715e8a4e14b6b1c231b91bd6ff. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:24:15.959864 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-3417d3e9-9f5e-4908-9ff8-84c969b1aab9 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Getting quotas for user 72f7ad67006b420c90eb37f8044dfb17 and project 24bf52715e8a4e14b6b1c231b91bd6ff. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:24:16.074092 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3417d3e9-9f5e-4908-9ff8-84c969b1aab9 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.172502 Oct 12 13:24:16.075701 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 338/636] 10.222.0.52 () {62 vars in 1199 bytes} [Wed Oct 12 13:24:15 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 174 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 12 13:24:16.081756 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9487401a-76c5-4308-8f4e-02a0094f96fe tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:16.082585 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-9487401a-76c5-4308-8f4e-02a0094f96fe tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:16.091173 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9487401a-76c5-4308-8f4e-02a0094f96fe tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:16.091865 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9487401a-76c5-4308-8f4e-02a0094f96fe tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:16.093112 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9487401a-76c5-4308-8f4e-02a0094f96fe tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:16.107641 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9487401a-76c5-4308-8f4e-02a0094f96fe tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:16.107641 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9487401a-76c5-4308-8f4e-02a0094f96fe tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:16.107641 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9487401a-76c5-4308-8f4e-02a0094f96fe tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:16.366345 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9487401a-76c5-4308-8f4e-02a0094f96fe tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:16.374400 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9487401a-76c5-4308-8f4e-02a0094f96fe tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17" status: 200 len: 1316 microversion: 2.1 time: 0.296912 Oct 12 13:24:16.374975 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 339/637] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:16 2022] GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:16.383339 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-0d6e1248-3dbf-4538-898f-c8c63f167f66 req-a490c31d-cca2-4aa3-b392-a80559303e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc77e94c-e9f8-4717-aecf-f5f222647117", "name": "network-vif-plugged", "status": "completed", "tag": "75bb8e1c-5674-4e19-963a-de9d1d18befe"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:16.406444 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-0d6e1248-3dbf-4538-898f-c8c63f167f66 req-a490c31d-cca2-4aa3-b392-a80559303e09 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:16.407149 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-0d6e1248-3dbf-4538-898f-c8c63f167f66 req-a490c31d-cca2-4aa3-b392-a80559303e09 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:16.407761 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-0d6e1248-3dbf-4538-898f-c8c63f167f66 req-a490c31d-cca2-4aa3-b392-a80559303e09 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:16.421417 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-0d6e1248-3dbf-4538-898f-c8c63f167f66 req-a490c31d-cca2-4aa3-b392-a80559303e09 service nova] Creating event network-vif-plugged:75bb8e1c-5674-4e19-963a-de9d1d18befe for instance fc77e94c-e9f8-4717-aecf-f5f222647117 on n-h1-861076-2 Oct 12 13:24:16.427072 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-0d6e1248-3dbf-4538-898f-c8c63f167f66 req-a490c31d-cca2-4aa3-b392-a80559303e09 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047763 Oct 12 13:24:16.427849 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 340/638] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:16.433342 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e166d565-a0a6-4ab8-938b-6ffccf333957 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:16.434771 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-e166d565-a0a6-4ab8-938b-6ffccf333957 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:16.442764 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e166d565-a0a6-4ab8-938b-6ffccf333957 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:16.443485 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e166d565-a0a6-4ab8-938b-6ffccf333957 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:16.444072 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e166d565-a0a6-4ab8-938b-6ffccf333957 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:16.445573 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e166d565-a0a6-4ab8-938b-6ffccf333957 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:16.446380 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e166d565-a0a6-4ab8-938b-6ffccf333957 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:16.447096 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e166d565-a0a6-4ab8-938b-6ffccf333957 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:16.755572 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e166d565-a0a6-4ab8-938b-6ffccf333957 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:16.766021 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e166d565-a0a6-4ab8-938b-6ffccf333957 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 200 len: 1320 microversion: 2.1 time: 0.336419 Oct 12 13:24:16.767237 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 341/639] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:16 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 1320 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:16.771520 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-339bd367-c814-4334-a7f6-0a6aafeb1963 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Calling method '.version_select at 0x7f8aa0045b80>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:16.850185 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-339bd367-c814-4334-a7f6-0a6aafeb1963 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1864009055" status: 204 len: 0 microversion: 2.2 time: 0.080744 Oct 12 13:24:16.857379 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 342/640] 10.222.0.52 () {60 vars in 1261 bytes} [Wed Oct 12 13:24:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1864009055 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:24:16.868856 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-86d7cf54-5fc4-47db-a038-91d62262db1a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:16.870633 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-86d7cf54-5fc4-47db-a038-91d62262db1a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:16.883559 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-86d7cf54-5fc4-47db-a038-91d62262db1a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:16.884730 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-86d7cf54-5fc4-47db-a038-91d62262db1a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:16.885275 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-86d7cf54-5fc4-47db-a038-91d62262db1a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:16.886534 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-86d7cf54-5fc4-47db-a038-91d62262db1a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:16.887193 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-86d7cf54-5fc4-47db-a038-91d62262db1a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:16.889888 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-86d7cf54-5fc4-47db-a038-91d62262db1a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:16.996650 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bc4d50bc-d6d9-4edd-ae7e-0027493152e9 tempest-FloatingIPDetailsTestJSON-312440971 tempest-FloatingIPDetailsTestJSON-312440971-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.459169 Oct 12 13:24:17.004700 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 299/641] 10.222.0.52 () {60 vars in 1170 bytes} [Wed Oct 12 13:24:13 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:17.004700 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7237b729-3c06-45e7-88ba-e1f18a868f6a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:17.004700 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7237b729-3c06-45e7-88ba-e1f18a868f6a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:17.010913 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7237b729-3c06-45e7-88ba-e1f18a868f6a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:17.011401 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7237b729-3c06-45e7-88ba-e1f18a868f6a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:17.011840 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7237b729-3c06-45e7-88ba-e1f18a868f6a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:17.012600 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7237b729-3c06-45e7-88ba-e1f18a868f6a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:17.013087 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7237b729-3c06-45e7-88ba-e1f18a868f6a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:17.018317 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7237b729-3c06-45e7-88ba-e1f18a868f6a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:17.018317 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=80 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:17.081756 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-86d7cf54-5fc4-47db-a038-91d62262db1a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:17.090078 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-86d7cf54-5fc4-47db-a038-91d62262db1a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 200 len: 1468 microversion: 2.1 time: 0.230856 Oct 12 13:24:17.102173 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 343/642] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:16 2022] GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 1468 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:17.106789 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-7237b729-3c06-45e7-88ba-e1f18a868f6a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:17.114105 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-92d1924b-1917-40d7-a85b-a943f3ccc5e2 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Action: 'create', calling method: .version_select at 0x7f8a9bfe3af0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-498910482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFe2e9Fk8E9IZhDD3J31v7NEwrIdRp05rhqB0aOG1YGJkSitQQf4WOJQleDNZK0NhRL27Ano2p8PhXANxIfAh453Ugjyee1zmqG1QpCAmy4+qB6+Hdw5pvLRIkhazVdf1Q=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:17.114895 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-7237b729-3c06-45e7-88ba-e1f18a868f6a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:17.116327 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-7237b729-3c06-45e7-88ba-e1f18a868f6a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:17.121812 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7237b729-3c06-45e7-88ba-e1f18a868f6a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1537 microversion: 2.91 time: 0.123398 Oct 12 13:24:17.122381 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 300/643] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:16 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1537 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:17.128044 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-544a8200-ce75-410b-835e-658fac4267b6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:17.128810 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-544a8200-ce75-410b-835e-658fac4267b6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:17.130988 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-92d1924b-1917-40d7-a85b-a943f3ccc5e2 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Getting quotas for project 24bf52715e8a4e14b6b1c231b91bd6ff. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:24:17.134770 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-544a8200-ce75-410b-835e-658fac4267b6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:17.135243 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-544a8200-ce75-410b-835e-658fac4267b6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:17.135753 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-544a8200-ce75-410b-835e-658fac4267b6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:17.136353 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-544a8200-ce75-410b-835e-658fac4267b6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:17.136552 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-92d1924b-1917-40d7-a85b-a943f3ccc5e2 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Getting quotas for user 72f7ad67006b420c90eb37f8044dfb17 and project 24bf52715e8a4e14b6b1c231b91bd6ff. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:24:17.136803 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-544a8200-ce75-410b-835e-658fac4267b6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:17.137251 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-544a8200-ce75-410b-835e-658fac4267b6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:17.139009 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:17.223344 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-92d1924b-1917-40d7-a85b-a943f3ccc5e2 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.119985 Oct 12 13:24:17.234987 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 344/644] 10.222.0.52 () {62 vars in 1199 bytes} [Wed Oct 12 13:24:17 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 12 13:24:17.234987 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2aa1044a-708b-442f-bc7a-e0514290395e tempest-FloatingIPDetailsTestJSON-312440971 tempest-FloatingIPDetailsTestJSON-312440971-project] Calling method '.version_select at 0x7f8aa01d6af0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:17.347270 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-544a8200-ce75-410b-835e-658fac4267b6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:17.355707 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-544a8200-ce75-410b-835e-658fac4267b6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 200 len: 1313 microversion: 2.1 time: 0.231063 Oct 12 13:24:17.366379 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 301/645] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:17 2022] GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:17.366379 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d8692530-01b5-42bf-b80d-496d1cb8e685 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:17.366379 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d8692530-01b5-42bf-b80d-496d1cb8e685 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 14676667-3743-4d37-8ff9-f8d161a483d4] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:17.371658 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8692530-01b5-42bf-b80d-496d1cb8e685 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:17.372326 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8692530-01b5-42bf-b80d-496d1cb8e685 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:17.373018 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8692530-01b5-42bf-b80d-496d1cb8e685 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:17.373720 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8692530-01b5-42bf-b80d-496d1cb8e685 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:17.374174 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8692530-01b5-42bf-b80d-496d1cb8e685 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:17.374595 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8692530-01b5-42bf-b80d-496d1cb8e685 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:17.505496 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2aa1044a-708b-442f-bc7a-e0514290395e tempest-FloatingIPDetailsTestJSON-312440971 tempest-FloatingIPDetailsTestJSON-312440971-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/d216358c-d0f5-4714-9cc1-7b535f383061" status: 200 len: 142 microversion: 2.1 time: 0.278939 Oct 12 13:24:17.506167 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 345/646] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 12 13:24:17 2022] GET /compute/v2.1/os-floating-ips/d216358c-d0f5-4714-9cc1-7b535f383061 => generated 142 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:17.512733 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ba745763-a856-4e49-be14-fa4e7e7f4504 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Action: 'create', calling method: .version_select at 0x7f8a9bf560d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1906908807", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwi+pjdj78qQFsvdb80JYn91YukTEy/MxgpxA4/72PNwx3rJOaTJJ2mVpu5fn9SR56HG+MeS9+ckm5Mj8M8sNSxo1wMODJWEQ0J+o4bzOAsiVEeoJK7FcZyjbHN2kjeuw=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:17.532587 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-ba745763-a856-4e49-be14-fa4e7e7f4504 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Getting quotas for project 24bf52715e8a4e14b6b1c231b91bd6ff. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:24:17.537977 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-ba745763-a856-4e49-be14-fa4e7e7f4504 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Getting quotas for user 72f7ad67006b420c90eb37f8044dfb17 and project 24bf52715e8a4e14b6b1c231b91bd6ff. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:24:17.543806 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d8692530-01b5-42bf-b80d-496d1cb8e685 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:17.558694 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d8692530-01b5-42bf-b80d-496d1cb8e685 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4" status: 200 len: 1466 microversion: 2.1 time: 0.200609 Oct 12 13:24:17.560290 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 302/647] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:17 2022] GET /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4 => generated 1466 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:17.566468 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c0277cef-161c-49dc-a119-76a56fd4c7f8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:17.567153 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c0277cef-161c-49dc-a119-76a56fd4c7f8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:17.575473 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c0277cef-161c-49dc-a119-76a56fd4c7f8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:17.576053 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c0277cef-161c-49dc-a119-76a56fd4c7f8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:17.576565 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c0277cef-161c-49dc-a119-76a56fd4c7f8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:17.577392 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c0277cef-161c-49dc-a119-76a56fd4c7f8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:17.577975 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c0277cef-161c-49dc-a119-76a56fd4c7f8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:17.578415 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c0277cef-161c-49dc-a119-76a56fd4c7f8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:17.640231 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ba745763-a856-4e49-be14-fa4e7e7f4504 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.131822 Oct 12 13:24:17.640828 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 346/648] 10.222.0.52 () {62 vars in 1199 bytes} [Wed Oct 12 13:24:17 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 133 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 12 13:24:17.646322 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-910db834-ddee-4753-997a-a3a18e9d6701 tempest-FloatingIPDetailsTestJSON-312440971 tempest-FloatingIPDetailsTestJSON-312440971-project] Calling method '.version_select at 0x7f8aa054fca0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:17.797695 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c0277cef-161c-49dc-a119-76a56fd4c7f8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:17.806441 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c0277cef-161c-49dc-a119-76a56fd4c7f8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17" status: 200 len: 1316 microversion: 2.1 time: 0.244295 Oct 12 13:24:17.807646 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 303/649] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:17 2022] GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 => generated 1316 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:17.813048 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5d0fcf96-5f97-405c-a99a-4d2600e07e20 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-118807777"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:17.815410 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5d0fcf96-5f97-405c-a99a-4d2600e07e20 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 14676667-3743-4d37-8ff9-f8d161a483d4] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:17.822203 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d0fcf96-5f97-405c-a99a-4d2600e07e20 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:17.822885 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d0fcf96-5f97-405c-a99a-4d2600e07e20 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:17.823323 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d0fcf96-5f97-405c-a99a-4d2600e07e20 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:17.824187 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d0fcf96-5f97-405c-a99a-4d2600e07e20 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:17.825008 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d0fcf96-5f97-405c-a99a-4d2600e07e20 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:17.825376 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d0fcf96-5f97-405c-a99a-4d2600e07e20 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:18.356382 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5d0fcf96-5f97-405c-a99a-4d2600e07e20 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "POST /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4/action" status: 202 len: 0 microversion: 2.1 time: 0.547157 Oct 12 13:24:18.358167 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 304/650] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:24:17 2022] POST /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 13:24:18.364208 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b3470b15-13aa-43eb-92e4-e8f0b8a61ad5 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Action: 'create', calling method: .version_select at 0x7f8a9bd05ca0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-775021152", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFL4JtY3hFlRDW2Ti4HgnfHBSI5wAcy5/SLgjijxhx5KhYyic6VGNb0yCGaRAkFuiw1t10EiVs3wSnvArODtH7c8oIyoipto8GXKMSia0r+rLQgYpxR5awD2Y3fRDgW4g=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:18.386474 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-b3470b15-13aa-43eb-92e4-e8f0b8a61ad5 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Getting quotas for project 24bf52715e8a4e14b6b1c231b91bd6ff. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:24:18.390546 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-b3470b15-13aa-43eb-92e4-e8f0b8a61ad5 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Getting quotas for user 72f7ad67006b420c90eb37f8044dfb17 and project 24bf52715e8a4e14b6b1c231b91bd6ff. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:24:18.475701 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b3470b15-13aa-43eb-92e4-e8f0b8a61ad5 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.115876 Oct 12 13:24:18.482330 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 305/651] 10.222.0.52 () {62 vars in 1199 bytes} [Wed Oct 12 13:24:18 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 12 13:24:18.482330 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fba4660b-485f-4e99-8af3-bef115a1b397 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:18.483699 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fba4660b-485f-4e99-8af3-bef115a1b397 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:18.490924 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fba4660b-485f-4e99-8af3-bef115a1b397 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:18.491255 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fba4660b-485f-4e99-8af3-bef115a1b397 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:18.492105 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fba4660b-485f-4e99-8af3-bef115a1b397 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:18.494138 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fba4660b-485f-4e99-8af3-bef115a1b397 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:18.494760 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fba4660b-485f-4e99-8af3-bef115a1b397 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:18.495217 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fba4660b-485f-4e99-8af3-bef115a1b397 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:18.837839 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-910db834-ddee-4753-997a-a3a18e9d6701 tempest-FloatingIPDetailsTestJSON-312440971 tempest-FloatingIPDetailsTestJSON-312440971-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/d216358c-d0f5-4714-9cc1-7b535f383061" status: 202 len: 0 microversion: 2.1 time: 1.195501 Oct 12 13:24:18.838483 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 347/652] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 12 13:24:17 2022] DELETE /compute/v2.1/os-floating-ips/d216358c-d0f5-4714-9cc1-7b535f383061 => generated 0 bytes in 1197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:24:18.845317 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2cee2e39-ecdd-4001-9529-97612d71b37f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:18.846102 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-2cee2e39-ecdd-4001-9529-97612d71b37f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:18.853740 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2cee2e39-ecdd-4001-9529-97612d71b37f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:18.854235 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2cee2e39-ecdd-4001-9529-97612d71b37f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:18.854676 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2cee2e39-ecdd-4001-9529-97612d71b37f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:18.855382 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2cee2e39-ecdd-4001-9529-97612d71b37f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:18.855997 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2cee2e39-ecdd-4001-9529-97612d71b37f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:18.856584 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2cee2e39-ecdd-4001-9529-97612d71b37f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:18.898525 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-fba4660b-485f-4e99-8af3-bef115a1b397 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:18.907021 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fba4660b-485f-4e99-8af3-bef115a1b397 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 200 len: 1320 microversion: 2.1 time: 0.429367 Oct 12 13:24:18.907836 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 306/653] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:18 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 1320 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:18.927326 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-2cee2e39-ecdd-4001-9529-97612d71b37f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:18.929348 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d832e619-1124-40bf-8150-d7498329ca25 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bdb1550>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:18.936000 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-2cee2e39-ecdd-4001-9529-97612d71b37f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:18.937513 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-2cee2e39-ecdd-4001-9529-97612d71b37f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:18.942821 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2cee2e39-ecdd-4001-9529-97612d71b37f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1537 microversion: 2.91 time: 0.103209 Oct 12 13:24:18.943471 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 348/654] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:18 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1537 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:18.948704 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3e77f2a0-2fa2-42b4-907f-ae3ddf3dfcf5 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:18.949502 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-3e77f2a0-2fa2-42b4-907f-ae3ddf3dfcf5 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:18.959635 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e77f2a0-2fa2-42b4-907f-ae3ddf3dfcf5 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:18.960360 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e77f2a0-2fa2-42b4-907f-ae3ddf3dfcf5 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:18.961010 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e77f2a0-2fa2-42b4-907f-ae3ddf3dfcf5 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:18.962038 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e77f2a0-2fa2-42b4-907f-ae3ddf3dfcf5 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:18.968562 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e77f2a0-2fa2-42b4-907f-ae3ddf3dfcf5 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:18.968562 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e77f2a0-2fa2-42b4-907f-ae3ddf3dfcf5 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:18.977978 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d832e619-1124-40bf-8150-d7498329ca25 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9" status: 200 len: 1454 microversion: 2.1 time: 0.055124 Oct 12 13:24:18.984388 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 307/655] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:18 2022] GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9 => generated 1454 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:18.992463 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-ede9bedc-22b0-41d7-bc25-f48292c2794a req-d4cb03cd-d6f4-464e-a228-c094ac162e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "551f2f8d-4679-4647-a8dd-ece2be8eac33", "name": "network-vif-plugged", "status": "completed", "tag": "8a9663e4-375c-4ed5-af37-d960c893ee70"}, {"server_uuid": "36dbc389-96b0-4e73-8fa4-c2f58e5a7b17", "name": "network-vif-plugged", "status": "completed", "tag": "453d09e8-2e47-4808-8698-8d0d4d8de8e9"}, {"server_uuid": "d88ccd8b-e58a-432a-9276-29cb5fa800af", "name": "network-vif-plugged", "status": "completed", "tag": "e1de3787-e3fa-4432-b69e-b1340e341a8b"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:19.005108 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ede9bedc-22b0-41d7-bc25-f48292c2794a req-d4cb03cd-d6f4-464e-a228-c094ac162e9e service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:19.005582 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ede9bedc-22b0-41d7-bc25-f48292c2794a req-d4cb03cd-d6f4-464e-a228-c094ac162e9e service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:19.006021 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ede9bedc-22b0-41d7-bc25-f48292c2794a req-d4cb03cd-d6f4-464e-a228-c094ac162e9e service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:19.020711 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-ede9bedc-22b0-41d7-bc25-f48292c2794a req-d4cb03cd-d6f4-464e-a228-c094ac162e9e service nova] Creating event network-vif-plugged:8a9663e4-375c-4ed5-af37-d960c893ee70 for instance 551f2f8d-4679-4647-a8dd-ece2be8eac33 on n-h2-861076-2 Oct 12 13:24:19.021322 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-ede9bedc-22b0-41d7-bc25-f48292c2794a req-d4cb03cd-d6f4-464e-a228-c094ac162e9e service nova] Creating event network-vif-plugged:453d09e8-2e47-4808-8698-8d0d4d8de8e9 for instance 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 on n-h1-861076-2 Oct 12 13:24:19.021893 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-ede9bedc-22b0-41d7-bc25-f48292c2794a req-d4cb03cd-d6f4-464e-a228-c094ac162e9e service nova] Creating event network-vif-plugged:e1de3787-e3fa-4432-b69e-b1340e341a8b for instance d88ccd8b-e58a-432a-9276-29cb5fa800af on n-h2-861076-2 Oct 12 13:24:19.031498 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-ede9bedc-22b0-41d7-bc25-f48292c2794a req-d4cb03cd-d6f4-464e-a228-c094ac162e9e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.046220 Oct 12 13:24:19.036887 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 308/656] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:19.037583 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5dfd3481-1e2e-41a2-ac4c-b6e03a3169fb tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Calling method '.version_select at 0x7f8aa0429e50>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:19.041252 n-d-861076-2 devstack@n-api.service[120932]: WARNING oslo_db.sqlalchemy.utils [None req-5dfd3481-1e2e-41a2-ac4c-b6e03a3169fb tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 13:24:19.046881 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5dfd3481-1e2e-41a2-ac4c-b6e03a3169fb tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.013543 Oct 12 13:24:19.052181 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 309/657] 10.222.0.52 () {60 vars in 1177 bytes} [Wed Oct 12 13:24:19 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:19.052568 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ffb64170-3304-48f0-839a-22bd82c52146 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:19.053210 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ffb64170-3304-48f0-839a-22bd82c52146 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:19.060345 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ffb64170-3304-48f0-839a-22bd82c52146 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:19.060880 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ffb64170-3304-48f0-839a-22bd82c52146 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:19.061345 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ffb64170-3304-48f0-839a-22bd82c52146 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:19.062039 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ffb64170-3304-48f0-839a-22bd82c52146 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:19.062486 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ffb64170-3304-48f0-839a-22bd82c52146 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:19.065589 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ffb64170-3304-48f0-839a-22bd82c52146 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:19.148478 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-3e77f2a0-2fa2-42b4-907f-ae3ddf3dfcf5 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:19.172990 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3e77f2a0-2fa2-42b4-907f-ae3ddf3dfcf5 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 200 len: 1313 microversion: 2.1 time: 0.214950 Oct 12 13:24:19.172990 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 349/658] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:18 2022] GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:19.175814 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0249d7c4-fad5-43aa-836a-00bf0c5084be tempest-FloatingIPDetailsTestJSON-312440971 tempest-FloatingIPDetailsTestJSON-312440971-project] Calling method '.version_select at 0x7f8a9bf560d0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:19.533185 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-ffb64170-3304-48f0-839a-22bd82c52146 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:19.543285 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ffb64170-3304-48f0-839a-22bd82c52146 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17" status: 200 len: 1316 microversion: 2.1 time: 0.492460 Oct 12 13:24:19.544260 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 310/659] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:19 2022] GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 => generated 1316 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:19.553292 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e641f266-1350-45f8-83dd-b3f177be92d9 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Calling method '.version_select at 0x7f8a9be5f790>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:19.630948 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0249d7c4-fad5-43aa-836a-00bf0c5084be tempest-FloatingIPDetailsTestJSON-312440971 tempest-FloatingIPDetailsTestJSON-312440971-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.469613 Oct 12 13:24:19.631607 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 350/660] 10.222.0.52 () {58 vars in 1164 bytes} [Wed Oct 12 13:24:19 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:24:19.642117 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e641f266-1350-45f8-83dd-b3f177be92d9 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-775021152" status: 204 len: 0 microversion: 2.2 time: 0.096256 Oct 12 13:24:19.643484 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 311/661] 10.222.0.52 () {60 vars in 1318 bytes} [Wed Oct 12 13:24:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-775021152 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:24:19.644326 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-96ded496-9ea5-4362-8c20-dca1dfe3c9c7 tempest-FloatingIPDetailsTestJSON-312440971 tempest-FloatingIPDetailsTestJSON-312440971-project] Calling method '.version_select at 0x7f8aa01d64c0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:19.656632 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6af4da13-2567-4847-838d-157e0121c749 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Calling method '.version_select at 0x7f8a9bc87af0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:19.713758 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:19.790347 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6af4da13-2567-4847-838d-157e0121c749 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1906908807" status: 204 len: 0 microversion: 2.2 time: 0.138027 Oct 12 13:24:19.790951 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 312/662] 10.222.0.52 () {60 vars in 1321 bytes} [Wed Oct 12 13:24:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1906908807 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 13:24:19.808463 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c0361b3d-8af8-4ecd-b690-167eb58283fe tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Calling method '.version_select at 0x7f8a9bc96f70>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:19.858254 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-96ded496-9ea5-4362-8c20-dca1dfe3c9c7 tempest-FloatingIPDetailsTestJSON-312440971 tempest-FloatingIPDetailsTestJSON-312440971-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.218784 Oct 12 13:24:19.858837 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 351/663] 10.222.0.52 () {58 vars in 1149 bytes} [Wed Oct 12 13:24:19 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:19.872629 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e0d881af-0c2f-45f7-be00-303a353179fa tempest-FloatingIPDetailsTestJSON-312440971 tempest-FloatingIPDetailsTestJSON-312440971-project] Calling method '.version_select at 0x7f8aa0060700>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:19.915369 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c0361b3d-8af8-4ecd-b690-167eb58283fe tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-498910482" status: 204 len: 0 microversion: 2.2 time: 0.111424 Oct 12 13:24:19.916098 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 313/664] 10.222.0.52 () {60 vars in 1318 bytes} [Wed Oct 12 13:24:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-498910482 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:24:19.928171 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-34ecfa17-2e01-4d86-88c8-2c326b37bacc tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Action: 'create', calling method: .version_select at 0x7f8a9bcabee0>, body: {"keypair": {"name": "tempest-keypair-835128043", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDs+wlQOTkSi9r4K3YQwHj0bbHCbxZ1UKy+feuhVkmw7vqkzcMrdGuCZw91PUXsyZdVOHOR6MDsahDrPf7N5zkfjjY2jw16D2/28FUIOGLIxM6hYd0VVKqr+tF2qpNK7zA=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:19.935935 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:19.950890 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-34ecfa17-2e01-4d86-88c8-2c326b37bacc tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Getting quotas for project 24bf52715e8a4e14b6b1c231b91bd6ff. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:24:19.957558 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-34ecfa17-2e01-4d86-88c8-2c326b37bacc tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Getting quotas for user 72f7ad67006b420c90eb37f8044dfb17 and project 24bf52715e8a4e14b6b1c231b91bd6ff. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:24:20.030801 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-34ecfa17-2e01-4d86-88c8-2c326b37bacc tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.106663 Oct 12 13:24:20.037945 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 314/665] 10.222.0.52 () {62 vars in 1199 bytes} [Wed Oct 12 13:24:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 12 13:24:20.049666 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-404c1920-a34e-415e-a6fc-d529ada08544 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:20.049666 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-404c1920-a34e-415e-a6fc-d529ada08544 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:20.051378 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-404c1920-a34e-415e-a6fc-d529ada08544 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:20.052047 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-404c1920-a34e-415e-a6fc-d529ada08544 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:20.052670 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-404c1920-a34e-415e-a6fc-d529ada08544 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:20.053569 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-404c1920-a34e-415e-a6fc-d529ada08544 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:20.054191 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-404c1920-a34e-415e-a6fc-d529ada08544 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:20.054627 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-404c1920-a34e-415e-a6fc-d529ada08544 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:20.314761 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-404c1920-a34e-415e-a6fc-d529ada08544 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:20.325401 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-404c1920-a34e-415e-a6fc-d529ada08544 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 200 len: 1320 microversion: 2.1 time: 0.286405 Oct 12 13:24:20.326324 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 315/666] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:20 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 1320 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:20.333068 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b7ba57c8-1618-4ab2-93a4-374d94403758 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:20.334048 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b7ba57c8-1618-4ab2-93a4-374d94403758 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:20.342097 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7ba57c8-1618-4ab2-93a4-374d94403758 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:20.342583 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7ba57c8-1618-4ab2-93a4-374d94403758 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:20.343022 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7ba57c8-1618-4ab2-93a4-374d94403758 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:20.343765 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7ba57c8-1618-4ab2-93a4-374d94403758 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:20.344376 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7ba57c8-1618-4ab2-93a4-374d94403758 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:20.348736 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7ba57c8-1618-4ab2-93a4-374d94403758 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:20.421640 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-b7ba57c8-1618-4ab2-93a4-374d94403758 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:20.429923 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-b7ba57c8-1618-4ab2-93a4-374d94403758 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:20.431473 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-b7ba57c8-1618-4ab2-93a4-374d94403758 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:20.436420 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b7ba57c8-1618-4ab2-93a4-374d94403758 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1537 microversion: 2.91 time: 0.108849 Oct 12 13:24:20.437109 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 316/667] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:20 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1537 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:20.452715 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f26bed92-b44c-4c48-bbde-dabb6a901168 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bcabca0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:20.501312 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f26bed92-b44c-4c48-bbde-dabb6a901168 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9" status: 200 len: 1454 microversion: 2.1 time: 0.058831 Oct 12 13:24:20.501874 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 317/668] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:20 2022] GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9 => generated 1454 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:20.506578 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-aa83bb2a-8a4e-419b-893d-da0a83d59bc8 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Calling method '.version_select at 0x7f8a9bc98b80>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:20.515670 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-aa83bb2a-8a4e-419b-893d-da0a83d59bc8 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-835128043" status: 200 len: 512 microversion: 2.2 time: 0.012640 Oct 12 13:24:20.516225 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 318/669] 10.222.0.52 () {60 vars in 1255 bytes} [Wed Oct 12 13:24:20 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-835128043 => generated 512 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:20.522384 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-74c2ea4d-ad61-42cb-b446-91808f7535c9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:20.523173 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-74c2ea4d-ad61-42cb-b446-91808f7535c9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:20.534160 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74c2ea4d-ad61-42cb-b446-91808f7535c9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:20.534781 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74c2ea4d-ad61-42cb-b446-91808f7535c9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:20.535367 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74c2ea4d-ad61-42cb-b446-91808f7535c9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:20.536516 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74c2ea4d-ad61-42cb-b446-91808f7535c9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:20.536516 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74c2ea4d-ad61-42cb-b446-91808f7535c9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:20.536863 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74c2ea4d-ad61-42cb-b446-91808f7535c9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:20.694388 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-74c2ea4d-ad61-42cb-b446-91808f7535c9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:20.703175 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-74c2ea4d-ad61-42cb-b446-91808f7535c9 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 200 len: 1313 microversion: 2.1 time: 0.184271 Oct 12 13:24:20.703776 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 319/670] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:20 2022] GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:20.708163 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d632e10b-0d22-4e4c-a8c5-3846d2a2f4fd tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Calling method '.version_select at 0x7f8a9bdb1940>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:20.711934 n-d-861076-2 devstack@n-api.service[120932]: WARNING oslo_db.sqlalchemy.utils [None req-d632e10b-0d22-4e4c-a8c5-3846d2a2f4fd tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 13:24:20.724328 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d632e10b-0d22-4e4c-a8c5-3846d2a2f4fd tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.012940 Oct 12 13:24:20.724328 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 320/671] 10.222.0.52 () {60 vars in 1177 bytes} [Wed Oct 12 13:24:20 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:20.724328 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-847901b9-8882-4a7d-ac1b-f7f78212b320 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:20.724328 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-847901b9-8882-4a7d-ac1b-f7f78212b320 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:20.730205 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-847901b9-8882-4a7d-ac1b-f7f78212b320 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:20.731116 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-847901b9-8882-4a7d-ac1b-f7f78212b320 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:20.731428 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-847901b9-8882-4a7d-ac1b-f7f78212b320 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:20.732102 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-847901b9-8882-4a7d-ac1b-f7f78212b320 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:20.732553 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-847901b9-8882-4a7d-ac1b-f7f78212b320 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:20.733011 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-847901b9-8882-4a7d-ac1b-f7f78212b320 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:20.941726 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e0d881af-0c2f-45f7-be00-303a353179fa tempest-FloatingIPDetailsTestJSON-312440971 tempest-FloatingIPDetailsTestJSON-312440971-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/ef0abf0d-f638-4fe8-9b96-2dd32c6108e5" status: 202 len: 0 microversion: 2.1 time: 1.072884 Oct 12 13:24:20.944559 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 352/672] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 12 13:24:19 2022] DELETE /compute/v2.1/os-floating-ips/ef0abf0d-f638-4fe8-9b96-2dd32c6108e5 => generated 0 bytes in 1075 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 13:24:20.946591 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-847901b9-8882-4a7d-ac1b-f7f78212b320 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:20.950873 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-597945d3-3e78-437e-a92d-a831150e10f7 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Calling method '.version_select at 0x7f8aa0142670>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:20.954835 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-847901b9-8882-4a7d-ac1b-f7f78212b320 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17" status: 200 len: 1316 microversion: 2.1 time: 0.235461 Oct 12 13:24:20.956451 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 321/673] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:20 2022] GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 => generated 1316 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:20.962996 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c85265a1-2eae-4d54-bbc3-cce43d9338ab tempest-FloatingIPDetailsTestJSON-312440971 tempest-FloatingIPDetailsTestJSON-312440971-project] Calling method '.version_select at 0x7f8a9be5ff70>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:21.048346 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-597945d3-3e78-437e-a92d-a831150e10f7 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-835128043" status: 204 len: 0 microversion: 2.2 time: 0.101156 Oct 12 13:24:21.049137 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 353/674] 10.222.0.52 () {60 vars in 1258 bytes} [Wed Oct 12 13:24:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-835128043 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:24:21.058144 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6e524ea6-25ac-4379-b4cd-623159764490 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Action: 'create', calling method: .version_select at 0x7f8a9bfe3dc0>, body: {"keypair": {"name": "tempest-keypair-948803412", "type": "x509"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:21.080170 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-6e524ea6-25ac-4379-b4cd-623159764490 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Getting quotas for project 24bf52715e8a4e14b6b1c231b91bd6ff. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:24:21.085730 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-6e524ea6-25ac-4379-b4cd-623159764490 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Getting quotas for user 72f7ad67006b420c90eb37f8044dfb17 and project 24bf52715e8a4e14b6b1c231b91bd6ff. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:24:21.105945 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.processutils [None req-6e524ea6-25ac-4379-b4cd-623159764490 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp1idg790i/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp1idg790i/temp.key -subj /CN=72f7ad67006b420c90eb37f8044dfb17 -extensions v3_req_client {{(pid=120933) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 12 13:24:21.238950 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.processutils [None req-6e524ea6-25ac-4379-b4cd-623159764490 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp1idg790i/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp1idg790i/temp.key -subj /CN=72f7ad67006b420c90eb37f8044dfb17 -extensions v3_req_client" returned: 0 in 0.132s {{(pid=120933) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 12 13:24:21.240969 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.processutils [None req-6e524ea6-25ac-4379-b4cd-623159764490 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp1idg790i/temp.key -password pass: {{(pid=120933) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 12 13:24:21.276425 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.processutils [None req-6e524ea6-25ac-4379-b4cd-623159764490 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp1idg790i/temp.key -password pass:" returned: 0 in 0.035s {{(pid=120933) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 12 13:24:21.425072 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-6e524ea6-25ac-4379-b4cd-623159764490 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Getting quotas for project 24bf52715e8a4e14b6b1c231b91bd6ff. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:24:21.430837 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-6e524ea6-25ac-4379-b4cd-623159764490 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Getting quotas for user 72f7ad67006b420c90eb37f8044dfb17 and project 24bf52715e8a4e14b6b1c231b91bd6ff. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:24:21.449249 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6e524ea6-25ac-4379-b4cd-623159764490 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.394256 Oct 12 13:24:21.450287 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 354/675] 10.222.0.52 () {62 vars in 1198 bytes} [Wed Oct 12 13:24:21 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 397 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Oct 12 13:24:21.460456 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c910ca03-1e21-4f45-9f56-e24d4984fc75 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:21.461326 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c910ca03-1e21-4f45-9f56-e24d4984fc75 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:21.468348 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c910ca03-1e21-4f45-9f56-e24d4984fc75 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:21.468982 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c910ca03-1e21-4f45-9f56-e24d4984fc75 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:21.469498 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c910ca03-1e21-4f45-9f56-e24d4984fc75 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:21.470398 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c910ca03-1e21-4f45-9f56-e24d4984fc75 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:21.470927 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c910ca03-1e21-4f45-9f56-e24d4984fc75 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:21.471422 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c910ca03-1e21-4f45-9f56-e24d4984fc75 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:21.664666 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-c910ca03-1e21-4f45-9f56-e24d4984fc75 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:21.673407 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c910ca03-1e21-4f45-9f56-e24d4984fc75 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 200 len: 1320 microversion: 2.1 time: 0.221736 Oct 12 13:24:21.673990 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 355/676] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:21 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 1320 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:21.679387 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6d70eecd-6073-437a-9a8f-f1113d1d4c29 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Calling method '.version_select at 0x7f8aa0060700>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:21.689460 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6d70eecd-6073-437a-9a8f-f1113d1d4c29 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-948803412" status: 200 len: 1533 microversion: 2.2 time: 0.014494 Oct 12 13:24:21.690333 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 356/677] 10.222.0.52 () {60 vars in 1255 bytes} [Wed Oct 12 13:24:21 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-948803412 => generated 1533 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:21.701652 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-bbfb94c6-e670-4bf6-be7b-2c1d703b28f6 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:21.702266 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-bbfb94c6-e670-4bf6-be7b-2c1d703b28f6 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:21.708127 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bbfb94c6-e670-4bf6-be7b-2c1d703b28f6 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:21.708609 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bbfb94c6-e670-4bf6-be7b-2c1d703b28f6 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:21.709084 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bbfb94c6-e670-4bf6-be7b-2c1d703b28f6 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:21.709776 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bbfb94c6-e670-4bf6-be7b-2c1d703b28f6 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:21.710223 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bbfb94c6-e670-4bf6-be7b-2c1d703b28f6 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:21.710638 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bbfb94c6-e670-4bf6-be7b-2c1d703b28f6 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:21.778690 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-bbfb94c6-e670-4bf6-be7b-2c1d703b28f6 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:21.786941 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-bbfb94c6-e670-4bf6-be7b-2c1d703b28f6 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:21.788371 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-bbfb94c6-e670-4bf6-be7b-2c1d703b28f6 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:21.794002 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-bbfb94c6-e670-4bf6-be7b-2c1d703b28f6 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1537 microversion: 2.91 time: 0.096241 Oct 12 13:24:21.794561 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 357/678] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:21 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1537 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:21.901061 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c85265a1-2eae-4d54-bbc3-cce43d9338ab tempest-FloatingIPDetailsTestJSON-312440971 tempest-FloatingIPDetailsTestJSON-312440971-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/bce6efc4-332f-4799-83c3-2e057de77727" status: 202 len: 0 microversion: 2.1 time: 0.943378 Oct 12 13:24:21.901711 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 322/679] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 12 13:24:20 2022] DELETE /compute/v2.1/os-floating-ips/bce6efc4-332f-4799-83c3-2e057de77727 => generated 0 bytes in 945 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:24:21.906850 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5d758a8f-45c6-4677-aadc-cf22508ac78a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bcab0d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:21.931746 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e8a79bc6-e24b-4d82-a051-b060fd9c2651 tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Action: 'update', calling method: .version_select at 0x7f8aa002aa60>, body: {"quota_set": {"ram": "5120"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:21.966098 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5d758a8f-45c6-4677-aadc-cf22508ac78a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9" status: 200 len: 1454 microversion: 2.1 time: 0.063357 Oct 12 13:24:21.966659 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 323/680] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:21 2022] GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9 => generated 1454 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:21.972494 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-726e0ea3-44c3-4cb6-8bab-485d42bfcab0 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Calling method '.version_select at 0x7f8a9bd05ca0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:21.978285 n-d-861076-2 devstack@n-api.service[120932]: WARNING oslo_db.sqlalchemy.utils [None req-726e0ea3-44c3-4cb6-8bab-485d42bfcab0 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 13:24:21.987238 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-726e0ea3-44c3-4cb6-8bab-485d42bfcab0 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.019195 Oct 12 13:24:21.988584 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 324/681] 10.222.0.52 () {60 vars in 1177 bytes} [Wed Oct 12 13:24:21 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:21.996163 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1a2bbc3d-9c87-4759-bf68-6e816abafc4e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:21.996786 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1a2bbc3d-9c87-4759-bf68-6e816abafc4e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:22.003590 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1a2bbc3d-9c87-4759-bf68-6e816abafc4e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:22.003590 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1a2bbc3d-9c87-4759-bf68-6e816abafc4e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:22.004247 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1a2bbc3d-9c87-4759-bf68-6e816abafc4e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:22.004586 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1a2bbc3d-9c87-4759-bf68-6e816abafc4e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:22.005074 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1a2bbc3d-9c87-4759-bf68-6e816abafc4e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:22.009336 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1a2bbc3d-9c87-4759-bf68-6e816abafc4e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:22.021681 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e8a79bc6-e24b-4d82-a051-b060fd9c2651 tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:22.022437 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e8a79bc6-e24b-4d82-a051-b060fd9c2651 tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:22.022949 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e8a79bc6-e24b-4d82-a051-b060fd9c2651 tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:22.023757 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e8a79bc6-e24b-4d82-a051-b060fd9c2651 tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:22.024288 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e8a79bc6-e24b-4d82-a051-b060fd9c2651 tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:22.024863 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e8a79bc6-e24b-4d82-a051-b060fd9c2651 tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:22.148749 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-1a2bbc3d-9c87-4759-bf68-6e816abafc4e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:22.156966 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e8a79bc6-e24b-4d82-a051-b060fd9c2651 tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/53fa447d1c5b4c35ba1d5e994265d0b2" status: 200 len: 148 microversion: 2.57 time: 0.361340 Oct 12 13:24:22.157114 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1a2bbc3d-9c87-4759-bf68-6e816abafc4e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 200 len: 1313 microversion: 2.1 time: 0.167086 Oct 12 13:24:22.157590 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 358/682] 10.222.0.52 () {62 vars in 1303 bytes} [Wed Oct 12 13:24:21 2022] PUT /compute/v2.1/os-quota-sets/53fa447d1c5b4c35ba1d5e994265d0b2 => generated 148 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:24:22.157764 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 325/683] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:21 2022] GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:22.162401 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0eaf813d-12d1-4d80-b359-4bbbbd5f1011 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:22.163015 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-0eaf813d-12d1-4d80-b359-4bbbbd5f1011 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:22.166773 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7d3f97ba-235a-47e2-aac0-ce22030eeee9 tempest-FloatingIPDetailsTestJSON-312440971 tempest-FloatingIPDetailsTestJSON-312440971-project] Calling method '.version_select at 0x7f8a9be70ee0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:22.169725 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0eaf813d-12d1-4d80-b359-4bbbbd5f1011 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:22.170408 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0eaf813d-12d1-4d80-b359-4bbbbd5f1011 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:22.171021 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0eaf813d-12d1-4d80-b359-4bbbbd5f1011 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:22.171722 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0eaf813d-12d1-4d80-b359-4bbbbd5f1011 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:22.172209 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0eaf813d-12d1-4d80-b359-4bbbbd5f1011 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:22.172591 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0eaf813d-12d1-4d80-b359-4bbbbd5f1011 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:22.388019 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-0eaf813d-12d1-4d80-b359-4bbbbd5f1011 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:22.397061 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0eaf813d-12d1-4d80-b359-4bbbbd5f1011 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17" status: 200 len: 1465 microversion: 2.1 time: 0.238104 Oct 12 13:24:22.397648 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 359/684] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:22 2022] GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 => generated 1465 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:22.412877 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e73f197c-8fb6-41eb-9a1e-f1cf74bee467 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] Calling method '.version_select at 0x7f8aa0321a60>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:22.506084 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e73f197c-8fb6-41eb-9a1e-f1cf74bee467 tempest-KeyPairsV22TestJSON-1749105209 tempest-KeyPairsV22TestJSON-1749105209-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-948803412" status: 204 len: 0 microversion: 2.2 time: 0.107405 Oct 12 13:24:22.506856 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 360/685] 10.222.0.52 () {60 vars in 1258 bytes} [Wed Oct 12 13:24:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-948803412 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:24:22.511526 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c49b8b67-3870-4dd4-98d3-5e7be1031aae tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Calling method '.version_select at 0x7f8a9bf56dc0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:22.590784 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c49b8b67-3870-4dd4-98d3-5e7be1031aae tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:22.591474 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c49b8b67-3870-4dd4-98d3-5e7be1031aae tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:22.591813 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c49b8b67-3870-4dd4-98d3-5e7be1031aae tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:22.592552 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c49b8b67-3870-4dd4-98d3-5e7be1031aae tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:22.593120 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c49b8b67-3870-4dd4-98d3-5e7be1031aae tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:22.593717 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c49b8b67-3870-4dd4-98d3-5e7be1031aae tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:22.614730 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c49b8b67-3870-4dd4-98d3-5e7be1031aae tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/53fa447d1c5b4c35ba1d5e994265d0b2/detail" status: 200 len: 463 microversion: 2.57 time: 0.106832 Oct 12 13:24:22.615686 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 361/686] 10.222.0.52 () {60 vars in 1304 bytes} [Wed Oct 12 13:24:22 2022] GET /compute/v2.1/os-quota-sets/53fa447d1c5b4c35ba1d5e994265d0b2/detail => generated 463 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:24:22.628887 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e75a4f48-5b3c-4408-b0b5-4150bafeb050 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:22.629597 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-e75a4f48-5b3c-4408-b0b5-4150bafeb050 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fc77e94c-e9f8-4717-aecf-f5f222647117] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:22.637454 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e75a4f48-5b3c-4408-b0b5-4150bafeb050 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:22.638021 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e75a4f48-5b3c-4408-b0b5-4150bafeb050 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:22.638941 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e75a4f48-5b3c-4408-b0b5-4150bafeb050 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:22.640781 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e75a4f48-5b3c-4408-b0b5-4150bafeb050 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:22.641461 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e75a4f48-5b3c-4408-b0b5-4150bafeb050 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:22.642045 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e75a4f48-5b3c-4408-b0b5-4150bafeb050 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:22.647135 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=100 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:22.869694 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e75a4f48-5b3c-4408-b0b5-4150bafeb050 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:22.879410 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e75a4f48-5b3c-4408-b0b5-4150bafeb050 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fc77e94c-e9f8-4717-aecf-f5f222647117" status: 200 len: 1465 microversion: 2.1 time: 0.262308 Oct 12 13:24:22.880338 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 362/687] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:22 2022] GET /compute/v2.1/servers/fc77e94c-e9f8-4717-aecf-f5f222647117 => generated 1465 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:22.886780 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0e8099e1-2589-48a5-a678-dd89ef8c9c43 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:22.887432 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-0e8099e1-2589-48a5-a678-dd89ef8c9c43 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:22.893634 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0e8099e1-2589-48a5-a678-dd89ef8c9c43 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:22.894238 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0e8099e1-2589-48a5-a678-dd89ef8c9c43 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:22.895102 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0e8099e1-2589-48a5-a678-dd89ef8c9c43 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:22.895870 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0e8099e1-2589-48a5-a678-dd89ef8c9c43 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:22.896394 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0e8099e1-2589-48a5-a678-dd89ef8c9c43 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:22.896636 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0e8099e1-2589-48a5-a678-dd89ef8c9c43 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:23.051875 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-0e8099e1-2589-48a5-a678-dd89ef8c9c43 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:23.059988 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0e8099e1-2589-48a5-a678-dd89ef8c9c43 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 200 len: 1470 microversion: 2.1 time: 0.178375 Oct 12 13:24:23.060569 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 363/688] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:22 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 1470 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:23.064992 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-98b4123d-2b48-4489-aaaf-3720f0890ee1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:23.065588 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-98b4123d-2b48-4489-aaaf-3720f0890ee1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:23.071158 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-98b4123d-2b48-4489-aaaf-3720f0890ee1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:23.071644 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-98b4123d-2b48-4489-aaaf-3720f0890ee1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:23.072084 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-98b4123d-2b48-4489-aaaf-3720f0890ee1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:23.072776 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-98b4123d-2b48-4489-aaaf-3720f0890ee1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:23.073257 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-98b4123d-2b48-4489-aaaf-3720f0890ee1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:23.073684 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-98b4123d-2b48-4489-aaaf-3720f0890ee1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:23.143421 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-98b4123d-2b48-4489-aaaf-3720f0890ee1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:23.151717 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-98b4123d-2b48-4489-aaaf-3720f0890ee1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:23.153184 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-98b4123d-2b48-4489-aaaf-3720f0890ee1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:23.158096 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-98b4123d-2b48-4489-aaaf-3720f0890ee1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1537 microversion: 2.91 time: 0.096555 Oct 12 13:24:23.158678 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 364/689] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:23 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1537 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:23.163537 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-773d84b8-4f67-403b-a62f-8d89d668b12b tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Action: 'update', calling method: .version_select at 0x7f8a9bfe33a0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:23.377347 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-773d84b8-4f67-403b-a62f-8d89d668b12b tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:23.379810 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-773d84b8-4f67-403b-a62f-8d89d668b12b tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:23.379810 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-773d84b8-4f67-403b-a62f-8d89d668b12b tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:23.379810 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-773d84b8-4f67-403b-a62f-8d89d668b12b tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:23.380254 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-773d84b8-4f67-403b-a62f-8d89d668b12b tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:23.380865 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-773d84b8-4f67-403b-a62f-8d89d668b12b tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:23.410478 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:23.418878 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-773d84b8-4f67-403b-a62f-8d89d668b12b tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:23.419360 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-773d84b8-4f67-403b-a62f-8d89d668b12b tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:23.420125 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-773d84b8-4f67-403b-a62f-8d89d668b12b tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:23.420693 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-773d84b8-4f67-403b-a62f-8d89d668b12b tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:23.421328 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-773d84b8-4f67-403b-a62f-8d89d668b12b tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:23.422093 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-773d84b8-4f67-403b-a62f-8d89d668b12b tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:23.534542 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7d3f97ba-235a-47e2-aac0-ce22030eeee9 tempest-FloatingIPDetailsTestJSON-312440971 tempest-FloatingIPDetailsTestJSON-312440971-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/4e318f09-2e3f-4549-ad5e-5f7bb4b55023" status: 202 len: 0 microversion: 2.1 time: 1.375786 Oct 12 13:24:23.538872 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 326/690] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 12 13:24:22 2022] DELETE /compute/v2.1/os-floating-ips/4e318f09-2e3f-4549-ad5e-5f7bb4b55023 => generated 0 bytes in 1377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:24:23.539805 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6ef247bb-9e96-4688-8d01-1b93b858da9c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:23.545792 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-6ef247bb-9e96-4688-8d01-1b93b858da9c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:23.546667 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6ef247bb-9e96-4688-8d01-1b93b858da9c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Searching by: {'reservation_id': 'r-liv2aw04', 'deleted': False, 'project_id': 'be50900be6b246aa9289de6ec5d366f9'} {{(pid=120932) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 13:24:23.554122 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ef247bb-9e96-4688-8d01-1b93b858da9c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:23.554608 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ef247bb-9e96-4688-8d01-1b93b858da9c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:23.560389 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ef247bb-9e96-4688-8d01-1b93b858da9c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:23.560389 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ef247bb-9e96-4688-8d01-1b93b858da9c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:23.560389 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ef247bb-9e96-4688-8d01-1b93b858da9c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:23.560389 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ef247bb-9e96-4688-8d01-1b93b858da9c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:23.601137 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-773d84b8-4f67-403b-a62f-8d89d668b12b tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/53fa447d1c5b4c35ba1d5e994265d0b2?user_id=f661858915b14062a17f246017f7904f" status: 200 len: 148 microversion: 2.57 time: 0.441182 Oct 12 13:24:23.608256 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 365/691] 10.222.0.52 () {62 vars in 1384 bytes} [Wed Oct 12 13:24:23 2022] PUT /compute/v2.1/os-quota-sets/53fa447d1c5b4c35ba1d5e994265d0b2?user_id=f661858915b14062a17f246017f7904f => generated 148 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:24:23.613367 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b3decf46-5f68-44f6-a3bc-d90a91f82e2d tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa0142700>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:23.660827 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b3decf46-5f68-44f6-a3bc-d90a91f82e2d tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9" status: 200 len: 1454 microversion: 2.1 time: 0.051172 Oct 12 13:24:23.661436 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 366/692] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:23 2022] GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9 => generated 1454 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:23.700888 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.multi_cell_list [None req-6ef247bb-9e96-4688-8d01-1b93b858da9c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120932) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 13:24:23.829438 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fed190c5-d13f-4bc4-86a0-324f35b86765 tempest-DeleteServersAdminTestJSON-1393324785 tempest-DeleteServersAdminTestJSON-1393324785-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:23.830059 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-fed190c5-d13f-4bc4-86a0-324f35b86765 tempest-DeleteServersAdminTestJSON-1393324785 tempest-DeleteServersAdminTestJSON-1393324785-project-admin] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:23.839078 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fed190c5-d13f-4bc4-86a0-324f35b86765 tempest-DeleteServersAdminTestJSON-1393324785 tempest-DeleteServersAdminTestJSON-1393324785-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:23.839572 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fed190c5-d13f-4bc4-86a0-324f35b86765 tempest-DeleteServersAdminTestJSON-1393324785 tempest-DeleteServersAdminTestJSON-1393324785-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:23.840044 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fed190c5-d13f-4bc4-86a0-324f35b86765 tempest-DeleteServersAdminTestJSON-1393324785 tempest-DeleteServersAdminTestJSON-1393324785-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:23.842657 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fed190c5-d13f-4bc4-86a0-324f35b86765 tempest-DeleteServersAdminTestJSON-1393324785 tempest-DeleteServersAdminTestJSON-1393324785-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:23.845139 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fed190c5-d13f-4bc4-86a0-324f35b86765 tempest-DeleteServersAdminTestJSON-1393324785 tempest-DeleteServersAdminTestJSON-1393324785-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:23.845139 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fed190c5-d13f-4bc4-86a0-324f35b86765 tempest-DeleteServersAdminTestJSON-1393324785 tempest-DeleteServersAdminTestJSON-1393324785-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:23.926468 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-fed190c5-d13f-4bc4-86a0-324f35b86765 tempest-DeleteServersAdminTestJSON-1393324785 tempest-DeleteServersAdminTestJSON-1393324785-project-admin] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Going to try to terminate instance {{(pid=120933) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:24:24.022097 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-6ef247bb-9e96-4688-8d01-1b93b858da9c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:24.029293 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ef247bb-9e96-4688-8d01-1b93b858da9c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:24.029898 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ef247bb-9e96-4688-8d01-1b93b858da9c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:24.035171 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ef247bb-9e96-4688-8d01-1b93b858da9c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:24.195796 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6ef247bb-9e96-4688-8d01-1b93b858da9c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?reservation_id=r-liv2aw04" status: 200 len: 2923 microversion: 2.1 time: 0.659568 Oct 12 13:24:24.196431 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 327/693] 10.222.0.52 () {58 vars in 1197 bytes} [Wed Oct 12 13:24:23 2022] GET /compute/v2.1/servers/detail?reservation_id=r-liv2aw04 => generated 2923 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:24.202834 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4a45ab4c-755b-4fcc-aeed-10c70117b47c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:24.203521 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-4a45ab4c-755b-4fcc-aeed-10c70117b47c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:24.210765 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4a45ab4c-755b-4fcc-aeed-10c70117b47c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:24.211267 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4a45ab4c-755b-4fcc-aeed-10c70117b47c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:24.211897 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4a45ab4c-755b-4fcc-aeed-10c70117b47c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:24.212735 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4a45ab4c-755b-4fcc-aeed-10c70117b47c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:24.213234 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4a45ab4c-755b-4fcc-aeed-10c70117b47c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:24.213657 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4a45ab4c-755b-4fcc-aeed-10c70117b47c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:24.352201 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fed190c5-d13f-4bc4-86a0-324f35b86765 tempest-DeleteServersAdminTestJSON-1393324785 tempest-DeleteServersAdminTestJSON-1393324785-project-admin] 10.222.0.52 "DELETE /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 204 len: 0 microversion: 2.1 time: 0.689464 Oct 12 13:24:24.353868 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 367/694] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:24:23 2022] DELETE /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:24:24.361665 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-98c24baa-ef24-48c4-8b53-b2b9cbd95335 tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] Calling method '.version_select at 0x7f8aa002aa60>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:24.385418 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-4a45ab4c-755b-4fcc-aeed-10c70117b47c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:24.398003 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4a45ab4c-755b-4fcc-aeed-10c70117b47c tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 200 len: 1462 microversion: 2.1 time: 0.197178 Oct 12 13:24:24.401000 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 328/695] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:24 2022] GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 1462 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:24.427296 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fae97d73-5bb8-4a5c-8aa7-e0c1326f758a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:24.427296 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fae97d73-5bb8-4a5c-8aa7-e0c1326f758a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:24.440843 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fae97d73-5bb8-4a5c-8aa7-e0c1326f758a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:24.441966 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fae97d73-5bb8-4a5c-8aa7-e0c1326f758a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:24.442839 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fae97d73-5bb8-4a5c-8aa7-e0c1326f758a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:24.443779 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fae97d73-5bb8-4a5c-8aa7-e0c1326f758a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:24.444245 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fae97d73-5bb8-4a5c-8aa7-e0c1326f758a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:24.444667 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fae97d73-5bb8-4a5c-8aa7-e0c1326f758a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:24.490465 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:24.544674 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-fae97d73-5bb8-4a5c-8aa7-e0c1326f758a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:24.553950 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-fae97d73-5bb8-4a5c-8aa7-e0c1326f758a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:24.562069 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-fae97d73-5bb8-4a5c-8aa7-e0c1326f758a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:24.574558 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fae97d73-5bb8-4a5c-8aa7-e0c1326f758a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1537 microversion: 2.91 time: 0.152842 Oct 12 13:24:24.594610 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 329/696] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:24 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1537 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:24.604806 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-55d4543c-ccdf-4617-9e82-488ac9999204 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:24.638528 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-98c24baa-ef24-48c4-8b53-b2b9cbd95335 tempest-QuotasAdminTestV257-2115088548 tempest-QuotasAdminTestV257-2115088548-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/53fa447d1c5b4c35ba1d5e994265d0b2?user_id=f661858915b14062a17f246017f7904f" status: 200 len: 190 microversion: 2.57 time: 0.282741 Oct 12 13:24:24.639043 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 368/697] 10.222.0.52 () {60 vars in 1364 bytes} [Wed Oct 12 13:24:24 2022] GET /compute/v2.1/os-quota-sets/53fa447d1c5b4c35ba1d5e994265d0b2?user_id=f661858915b14062a17f246017f7904f => generated 190 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:24:24.646100 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1682824f-2dad-4490-88de-ddd2806cb92b tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:24.647121 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-1682824f-2dad-4490-88de-ddd2806cb92b tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:24.654722 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1682824f-2dad-4490-88de-ddd2806cb92b tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:24.655397 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1682824f-2dad-4490-88de-ddd2806cb92b tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:24.655996 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1682824f-2dad-4490-88de-ddd2806cb92b tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:24.657280 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1682824f-2dad-4490-88de-ddd2806cb92b tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:24.657901 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1682824f-2dad-4490-88de-ddd2806cb92b tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:24.658476 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1682824f-2dad-4490-88de-ddd2806cb92b tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:24.673790 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.compute.server_groups [None req-55d4543c-ccdf-4617-9e82-488ac9999204 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Querying cell c7d37a9d-54da-4741-8e88-e51a0f3ae3d5(cell1) for 2 instances {{(pid=120932) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 12 13:24:24.674144 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-55d4543c-ccdf-4617-9e82-488ac9999204 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:24.674770 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-55d4543c-ccdf-4617-9e82-488ac9999204 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:24.675276 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-55d4543c-ccdf-4617-9e82-488ac9999204 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:24.715570 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-55d4543c-ccdf-4617-9e82-488ac9999204 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/b7df70df-24c1-41ad-9d28-be4f73ece55a" status: 200 len: 265 microversion: 2.1 time: 0.119698 Oct 12 13:24:24.716552 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 330/698] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 12 13:24:24 2022] GET /compute/v2.1/os-server-groups/b7df70df-24c1-41ad-9d28-be4f73ece55a => generated 265 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:24.727295 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e6e8dda3-3a7e-4552-9407-b54f5a21770d tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:24.728600 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e6e8dda3-3a7e-4552-9407-b54f5a21770d tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:24.737678 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6e8dda3-3a7e-4552-9407-b54f5a21770d tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:24.738615 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6e8dda3-3a7e-4552-9407-b54f5a21770d tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:24.739366 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6e8dda3-3a7e-4552-9407-b54f5a21770d tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:24.740261 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6e8dda3-3a7e-4552-9407-b54f5a21770d tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:24.740866 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6e8dda3-3a7e-4552-9407-b54f5a21770d tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:24.741631 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6e8dda3-3a7e-4552-9407-b54f5a21770d tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:24.893711 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-1682824f-2dad-4490-88de-ddd2806cb92b tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:24.907288 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1682824f-2dad-4490-88de-ddd2806cb92b tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 200 len: 1476 microversion: 2.1 time: 0.265925 Oct 12 13:24:24.922678 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 369/699] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:24 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 1476 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:24.931504 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c31aa85c-dd8e-4919-a7c0-124602a66d3d tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bfe3c10>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:24.958297 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e6e8dda3-3a7e-4552-9407-b54f5a21770d tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 200 len: 1613 microversion: 2.1 time: 0.240489 Oct 12 13:24:24.965123 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 331/700] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:24 2022] GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 1613 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:24.966757 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b709644f-d26a-42f0-8075-a64c4be3f474 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:24.967035 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b709644f-d26a-42f0-8075-a64c4be3f474 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] [instance: 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:24.973380 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b709644f-d26a-42f0-8075-a64c4be3f474 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:24.973867 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b709644f-d26a-42f0-8075-a64c4be3f474 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:24.974302 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b709644f-d26a-42f0-8075-a64c4be3f474 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:24.975067 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b709644f-d26a-42f0-8075-a64c4be3f474 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:24.975502 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b709644f-d26a-42f0-8075-a64c4be3f474 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:24.975923 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b709644f-d26a-42f0-8075-a64c4be3f474 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:24.978665 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c31aa85c-dd8e-4919-a7c0-124602a66d3d tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9" status: 200 len: 1454 microversion: 2.1 time: 0.054729 Oct 12 13:24:24.979277 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 370/701] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:24 2022] GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9 => generated 1454 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:24.984137 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-202c228a-5f71-4e3a-8aa9-4b4b1fee384f tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:24.984948 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-202c228a-5f71-4e3a-8aa9-4b4b1fee384f tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:24.991269 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-202c228a-5f71-4e3a-8aa9-4b4b1fee384f tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:24.991761 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-202c228a-5f71-4e3a-8aa9-4b4b1fee384f tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:24.992207 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-202c228a-5f71-4e3a-8aa9-4b4b1fee384f tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:24.992942 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-202c228a-5f71-4e3a-8aa9-4b4b1fee384f tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:24.993411 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-202c228a-5f71-4e3a-8aa9-4b4b1fee384f tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:24.993872 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-202c228a-5f71-4e3a-8aa9-4b4b1fee384f tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:25.117489 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b709644f-d26a-42f0-8075-a64c4be3f474 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17" status: 200 len: 1616 microversion: 2.1 time: 0.157180 Oct 12 13:24:25.134301 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 332/702] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:24 2022] GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 => generated 1616 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:25.138261 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-202c228a-5f71-4e3a-8aa9-4b4b1fee384f tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-629241f0-d321-420a-b740-8866ef75d50d) Oct 12 13:24:25.138261 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:25.138261 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:24:25.138261 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:24:25.138261 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:24:25.138261 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:24:25.138261 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 12 13:24:25.138261 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 12 13:24:25.138261 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 12 13:24:25.138261 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 12 13:24:25.138261 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 12 13:24:25.138261 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 12 13:24:25.138261 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:24:25.138261 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:24:25.139339 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:24:25.139339 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:24:25.139339 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:24:25.139339 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:24:25.139339 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:24:25.139339 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:24:25.139339 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:24:25.139339 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:24:25.139339 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:24:25.139339 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:24:25.139339 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:24:25.139339 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:24:25.139339 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:24:25.139339 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:24:25.139339 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:24:25.139339 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:24:25.139339 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:24:25.139339 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:24:25.140610 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:24:25.140610 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:24:25.140610 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:24:25.140610 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:24:25.140610 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:24:25.140610 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:24:25.140610 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:24:25.140610 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:24:25.140610 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:24:25.140610 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:24:25.140610 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:24:25.140610 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:24:25.140610 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:24:25.140610 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:24:25.140610 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:24:25.140610 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:24:25.147031 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:24:25.147031 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:24:25.147031 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:24:25.147031 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:24:25.147031 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:24:25.147031 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:24:25.147031 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:24:25.147031 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:24:25.147031 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:24:25.147031 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:24:25.147031 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-629241f0-d321-420a-b740-8866ef75d50d) Oct 12 13:24:25.147031 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:25.147031 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-202c228a-5f71-4e3a-8aa9-4b4b1fee384f tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:24:25.147031 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:24:25.149030 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-202c228a-5f71-4e3a-8aa9-4b4b1fee384f tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Request method failure captured: Oct 12 13:24:25.149030 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af/action HTTP/1.1 Oct 12 13:24:25.149030 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:24:25.149030 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:24:25.149030 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:24:25.149030 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 15 Oct 12 13:24:25.149030 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:24:25.149030 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:24:25.149030 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:24:25.149030 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:24:25.149030 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr-X9s6OnMePnTkPdpdpXuH5wy46cOe9GRya0mAbV1EHPGS4giy7zHykGQ0hAqQmeHuyseLok3sv3L76_swYqSY77owooCQIk27k4UBy44jI7NX2E5DeEN5U3Ww6datBEcPl214U-rUvk_4jvgQkZsvQQqrDmZmuru2fHkEUj2Bi2LQ Oct 12 13:24:25.149030 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:24:25.149030 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:24:25.149030 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:24:25.149030 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:24:25.149030 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:24:25.149030 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:24:25.149030 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: a597640040eb4f28afccca47c7c4e4be Oct 12 13:24:25.149030 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-MigrationsAdminTest-1144872436 Oct 12 13:24:25.149030 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:24:25.149030 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:24:25.150273 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a597640040eb4f28afccca47c7c4e4be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a597640040eb4f28afccca47c7c4e4be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a597640040eb4f28afccca47c7c4e4be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a597640040eb4f28afccca47c7c4e4be"}]}] Oct 12 13:24:25.150273 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-MigrationsAdminTest-1144872436 Oct 12 13:24:25.150273 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: a597640040eb4f28afccca47c7c4e4be Oct 12 13:24:25.150273 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-MigrationsAdminTest-1144872436 Oct 12 13:24:25.150273 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-MigrationsAdminTest-1144872436-project-admin Oct 12 13:24:25.150273 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:24:25.150273 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:24:25.150273 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 24b53bc4b5a24e57918a421065edd233 Oct 12 13:24:25.150273 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-MigrationsAdminTest-1144872436-project-admin Oct 12 13:24:25.150273 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:24:25.150273 n-d-861076-2 devstack@n-api.service[120933]: {"migrate": {}} Oct 12 13:24:25.150273 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:24:25.150273 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:24:25.151047 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:24:25.151047 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'd88ccd8b-e58a-432a-9276-29cb5fa800af', 'body': {'migrate': {}}} Oct 12 13:24:25.151047 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:24:25.151047 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:25.151047 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:24:25.151047 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:24:25.151047 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:24:25.151047 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:24:25.151047 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 12 13:24:25.151047 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 12 13:24:25.151047 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 12 13:24:25.151047 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 12 13:24:25.151047 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 12 13:24:25.151047 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 12 13:24:25.151047 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:24:25.151047 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:24:25.151047 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:24:25.151047 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:24:25.151047 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:24:25.155385 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:24:25.155385 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:24:25.155385 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:24:25.155385 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:24:25.155385 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:24:25.155385 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:24:25.155385 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:24:25.155385 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:24:25.155385 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:24:25.155385 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:24:25.155385 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:24:25.155385 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:24:25.155385 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:24:25.155385 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:24:25.155385 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:24:25.155385 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:24:25.155385 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:24:25.155385 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:24:25.158153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:24:25.158153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:24:25.158153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:24:25.158153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:24:25.158153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:24:25.158153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:24:25.158153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:24:25.158153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:24:25.158153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:24:25.158153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:24:25.158153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:24:25.158153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:24:25.158153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:24:25.158153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:24:25.158153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:24:25.158153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:24:25.158153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:24:25.161021 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:24:25.161021 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:24:25.161021 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:24:25.161021 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:24:25.161021 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:24:25.161021 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:24:25.161021 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-629241f0-d321-420a-b740-8866ef75d50d) Oct 12 13:24:25.161021 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:25.161021 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:24:25.161021 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:25.161021 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:25.161021 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:24:25.161021 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:24:25.161021 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:24:25.161021 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:24:25.161021 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:24:25.161021 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:24:25.165222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:24:25.165222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:25.165222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:25.165222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:24:25.165222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:25.165222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:25.165222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:24:25.165222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:24:25.165222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:24:25.165222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:24:25.165222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:24:25.165222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:25.165222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:25.165222 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-202c228a-5f71-4e3a-8aa9-4b4b1fee384f tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:24:25.165222 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:24:25.167641 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-202c228a-5f71-4e3a-8aa9-4b4b1fee384f tempest-MigrationsAdminTest-1144872436 tempest-MigrationsAdminTest-1144872436-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af/action" status: 500 len: 214 microversion: 2.1 time: 0.161641 Oct 12 13:24:25.167641 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 371/703] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:24:24 2022] POST /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af/action => generated 214 bytes in 163 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:24:25.167803 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-593c53a6-6709-4ea7-8f09-d0a9df51580a tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:25.167803 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-593c53a6-6709-4ea7-8f09-d0a9df51580a tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] [instance: fc77e94c-e9f8-4717-aecf-f5f222647117] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:25.167981 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-79258401-c65d-4bc0-a5ec-33171dd00c08 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:25.169000 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-79258401-c65d-4bc0-a5ec-33171dd00c08 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:25.172595 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-593c53a6-6709-4ea7-8f09-d0a9df51580a tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:25.174316 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-593c53a6-6709-4ea7-8f09-d0a9df51580a tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:25.174766 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-593c53a6-6709-4ea7-8f09-d0a9df51580a tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:25.180437 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-593c53a6-6709-4ea7-8f09-d0a9df51580a tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:25.180437 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-593c53a6-6709-4ea7-8f09-d0a9df51580a tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:25.180437 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-593c53a6-6709-4ea7-8f09-d0a9df51580a tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:25.191837 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-79258401-c65d-4bc0-a5ec-33171dd00c08 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:25.192336 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-79258401-c65d-4bc0-a5ec-33171dd00c08 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:25.197973 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-79258401-c65d-4bc0-a5ec-33171dd00c08 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:25.198863 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-79258401-c65d-4bc0-a5ec-33171dd00c08 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:25.199394 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-79258401-c65d-4bc0-a5ec-33171dd00c08 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:25.199834 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-79258401-c65d-4bc0-a5ec-33171dd00c08 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:25.267076 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-79258401-c65d-4bc0-a5ec-33171dd00c08 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Going to try to terminate instance {{(pid=120933) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:24:25.414684 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-593c53a6-6709-4ea7-8f09-d0a9df51580a tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fc77e94c-e9f8-4717-aecf-f5f222647117" status: 200 len: 1616 microversion: 2.1 time: 0.270451 Oct 12 13:24:25.416310 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 333/704] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:25 2022] GET /compute/v2.1/servers/fc77e94c-e9f8-4717-aecf-f5f222647117 => generated 1616 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:25.446976 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e43ed91b-3468-43f9-848f-5948625aee6b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Action: 'create', calling method: .version_select at 0x7f8a9be5f8b0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-751870262", "policies": ["anti-affinity"]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:25.475657 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-e43ed91b-3468-43f9-848f-5948625aee6b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_groups'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:24:25.483107 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-e43ed91b-3468-43f9-848f-5948625aee6b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for user a0fd9458bb2842829a1e13ac93fade30 and project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_groups'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:24:25.609123 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-79258401-c65d-4bc0-a5ec-33171dd00c08 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 204 len: 0 microversion: 2.1 time: 0.450710 Oct 12 13:24:25.612939 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 372/705] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:24:25 2022] DELETE /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:24:25.620114 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fb887019-0e4c-4bd9-944e-63b649822515 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:25.620837 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-fb887019-0e4c-4bd9-944e-63b649822515 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:25.627319 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-e43ed91b-3468-43f9-848f-5948625aee6b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_groups'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:24:25.628094 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb887019-0e4c-4bd9-944e-63b649822515 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:25.628590 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb887019-0e4c-4bd9-944e-63b649822515 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:25.629262 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb887019-0e4c-4bd9-944e-63b649822515 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:25.630371 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb887019-0e4c-4bd9-944e-63b649822515 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:25.630831 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb887019-0e4c-4bd9-944e-63b649822515 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:25.631524 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb887019-0e4c-4bd9-944e-63b649822515 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:25.633350 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-e43ed91b-3468-43f9-848f-5948625aee6b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for user a0fd9458bb2842829a1e13ac93fade30 and project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_groups'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:24:25.656816 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e43ed91b-3468-43f9-848f-5948625aee6b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.218107 Oct 12 13:24:25.658192 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 334/706] 10.222.0.52 () {60 vars in 1174 bytes} [Wed Oct 12 13:24:25 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:25.664742 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5183a416-dca4-48ba-b2da-b15fc2093edf tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:25.666070 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5183a416-dca4-48ba-b2da-b15fc2093edf tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:25.674112 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5183a416-dca4-48ba-b2da-b15fc2093edf tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:25.674875 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5183a416-dca4-48ba-b2da-b15fc2093edf tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:25.675473 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5183a416-dca4-48ba-b2da-b15fc2093edf tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:25.677211 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5183a416-dca4-48ba-b2da-b15fc2093edf tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:25.677862 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5183a416-dca4-48ba-b2da-b15fc2093edf tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:25.678551 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5183a416-dca4-48ba-b2da-b15fc2093edf tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:25.776941 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-fb887019-0e4c-4bd9-944e-63b649822515 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:25.802700 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-fb887019-0e4c-4bd9-944e-63b649822515 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:25.804614 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-fb887019-0e4c-4bd9-944e-63b649822515 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:25.824017 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fb887019-0e4c-4bd9-944e-63b649822515 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1537 microversion: 2.91 time: 0.209867 Oct 12 13:24:25.837059 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 373/707] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:25 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1537 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:25.935636 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a2bfdf83-9c18-4bc3-8195-538e43a58767 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:25.936688 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a2bfdf83-9c18-4bc3-8195-538e43a58767 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:25.947420 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-5183a416-dca4-48ba-b2da-b15fc2093edf tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:25.951242 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a2bfdf83-9c18-4bc3-8195-538e43a58767 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:25.951974 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a2bfdf83-9c18-4bc3-8195-538e43a58767 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:25.952433 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a2bfdf83-9c18-4bc3-8195-538e43a58767 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:25.954150 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a2bfdf83-9c18-4bc3-8195-538e43a58767 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:25.957234 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a2bfdf83-9c18-4bc3-8195-538e43a58767 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:25.958348 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a2bfdf83-9c18-4bc3-8195-538e43a58767 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:25.959839 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5183a416-dca4-48ba-b2da-b15fc2093edf tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 200 len: 1468 microversion: 2.1 time: 0.300242 Oct 12 13:24:25.977216 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 335/708] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:25 2022] GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 1468 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:26.012062 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c636150a-fc50-4d1b-a76c-0ab9718e7b85 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9be260d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:26.102321 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c636150a-fc50-4d1b-a76c-0ab9718e7b85 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9" status: 200 len: 1454 microversion: 2.1 time: 0.105212 Oct 12 13:24:26.103555 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 336/709] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:25 2022] GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9 => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:26.110560 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-408587701", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "cd2995b2-cabe-4f7a-96e7-30ec9ebc56fd"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:26.236223 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] validate_networks() for None {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:24:26.637181 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:24:26.638270 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:24:26.639537 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:24:26.640164 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:24:26.640739 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:24:26.661442 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:26.662213 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:26.662848 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:26.663790 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:26.664404 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:26.665016 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:26.686831 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for project be50900be6b246aa9289de6ec5d366f9. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:24:26.692728 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a2bfdf83-9c18-4bc3-8195-538e43a58767 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:26.693351 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for user a0fd9458bb2842829a1e13ac93fade30 and project be50900be6b246aa9289de6ec5d366f9. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:24:26.703223 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a2bfdf83-9c18-4bc3-8195-538e43a58767 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 200 len: 1476 microversion: 2.1 time: 0.772360 Oct 12 13:24:26.713988 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 374/710] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:25 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 1476 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:24:26.713988 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-338a6ca1-f827-4050-9ab7-b4116123c751 req-8598bf3d-392e-46a0-a0cd-f8fcb5342524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14676667-3743-4d37-8ff9-f8d161a483d4", "name": "network-vif-plugged", "status": "completed", "tag": "5170297d-0d3f-4e69-aa8a-6c0e40750532"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:26.726352 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Going to run 2 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:24:26.726818 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-338a6ca1-f827-4050-9ab7-b4116123c751 req-8598bf3d-392e-46a0-a0cd-f8fcb5342524 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:26.727303 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-338a6ca1-f827-4050-9ab7-b4116123c751 req-8598bf3d-392e-46a0-a0cd-f8fcb5342524 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:26.727738 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-338a6ca1-f827-4050-9ab7-b4116123c751 req-8598bf3d-392e-46a0-a0cd-f8fcb5342524 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:26.729858 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: d9e25817-4f35-4244-afa0-543c63840ad2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:24:26.745265 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-338a6ca1-f827-4050-9ab7-b4116123c751 req-8598bf3d-392e-46a0-a0cd-f8fcb5342524 service nova] Creating event network-vif-plugged:5170297d-0d3f-4e69-aa8a-6c0e40750532 for instance 14676667-3743-4d37-8ff9-f8d161a483d4 on n-h2-861076-2 Oct 12 13:24:26.752338 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-338a6ca1-f827-4050-9ab7-b4116123c751 req-8598bf3d-392e-46a0-a0cd-f8fcb5342524 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046418 Oct 12 13:24:26.756972 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 375/711] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:26.859469 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-303d5cc6-157c-4d6c-9140-861845e4d87f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:26.860210 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-303d5cc6-157c-4d6c-9140-861845e4d87f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:26.866847 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-303d5cc6-157c-4d6c-9140-861845e4d87f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:26.867337 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-303d5cc6-157c-4d6c-9140-861845e4d87f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:26.867769 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-303d5cc6-157c-4d6c-9140-861845e4d87f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:26.868479 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-303d5cc6-157c-4d6c-9140-861845e4d87f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:26.868936 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-303d5cc6-157c-4d6c-9140-861845e4d87f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:26.869366 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-303d5cc6-157c-4d6c-9140-861845e4d87f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:26.937117 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-303d5cc6-157c-4d6c-9140-861845e4d87f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:26.946064 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-303d5cc6-157c-4d6c-9140-861845e4d87f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:26.947525 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-303d5cc6-157c-4d6c-9140-861845e4d87f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:26.953363 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-303d5cc6-157c-4d6c-9140-861845e4d87f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1537 microversion: 2.91 time: 0.099250 Oct 12 13:24:26.953945 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 376/712] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:26 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1537 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:24:26.980428 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120932) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 12 13:24:26.986699 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d25ca09a-1455-497e-b3e3-7418fdd2f1a1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:26.998932 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-d25ca09a-1455-497e-b3e3-7418fdd2f1a1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:26.998932 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d25ca09a-1455-497e-b3e3-7418fdd2f1a1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:26.998932 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d25ca09a-1455-497e-b3e3-7418fdd2f1a1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:26.999238 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:26.999321 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d25ca09a-1455-497e-b3e3-7418fdd2f1a1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:26.999321 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d25ca09a-1455-497e-b3e3-7418fdd2f1a1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:26.999321 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d25ca09a-1455-497e-b3e3-7418fdd2f1a1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:26.999321 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d25ca09a-1455-497e-b3e3-7418fdd2f1a1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:27.005437 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_group_members'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:24:27.010886 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for user a0fd9458bb2842829a1e13ac93fade30 and project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_group_members'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:24:27.130254 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d25ca09a-1455-497e-b3e3-7418fdd2f1a1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:27.132159 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_group_members'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:24:27.137482 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for user a0fd9458bb2842829a1e13ac93fade30 and project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_group_members'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:24:27.141518 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d25ca09a-1455-497e-b3e3-7418fdd2f1a1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 200 len: 1468 microversion: 2.1 time: 0.161693 Oct 12 13:24:27.142724 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 377/713] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:26 2022] GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 1468 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:24:27.147817 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9b827541-4686-4807-b601-34640640e9da tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bf0ab80>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:27.158479 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fdd5df96-d739-4e05-a503-2cfcab635cc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=d9e25817-4f35-4244-afa0-543c63840ad2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:24:27.204543 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9b827541-4686-4807-b601-34640640e9da tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9" status: 200 len: 1454 microversion: 2.1 time: 0.060539 Oct 12 13:24:27.205445 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 378/714] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:27 2022] GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9 => generated 1454 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:27.519796 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_group_members'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:24:27.525845 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for user a0fd9458bb2842829a1e13ac93fade30 and project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_group_members'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:24:27.653322 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_group_members'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:24:27.660950 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for user a0fd9458bb2842829a1e13ac93fade30 and project be50900be6b246aa9289de6ec5d366f9. Resources: {'server_group_members'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:24:27.700783 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0d1e27e3-a5b8-4772-a6b7-37a4833ac5de tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.594615 Oct 12 13:24:27.701800 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 337/715] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:24:26 2022] POST /compute/v2.1/servers => generated 32 bytes in 1597 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 12 13:24:27.715777 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-641b4ac3-f29e-476d-a784-e4a71a38ffb5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:27.738620 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6ce61a5e-cadd-4a8c-a9c2-aac7774dee74 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:27.739393 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6ce61a5e-cadd-4a8c-a9c2-aac7774dee74 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:27.740591 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-641b4ac3-f29e-476d-a784-e4a71a38ffb5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:27.741443 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-641b4ac3-f29e-476d-a784-e4a71a38ffb5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Searching by: {'deleted': False, 'project_id': 'be50900be6b246aa9289de6ec5d366f9'} {{(pid=120933) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 13:24:27.750611 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ce61a5e-cadd-4a8c-a9c2-aac7774dee74 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:27.751149 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ce61a5e-cadd-4a8c-a9c2-aac7774dee74 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:27.751779 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ce61a5e-cadd-4a8c-a9c2-aac7774dee74 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:27.753946 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ce61a5e-cadd-4a8c-a9c2-aac7774dee74 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:27.754658 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ce61a5e-cadd-4a8c-a9c2-aac7774dee74 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:27.755241 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ce61a5e-cadd-4a8c-a9c2-aac7774dee74 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:27.816765 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-641b4ac3-f29e-476d-a784-e4a71a38ffb5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:27.817783 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-641b4ac3-f29e-476d-a784-e4a71a38ffb5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:27.818346 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-641b4ac3-f29e-476d-a784-e4a71a38ffb5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:27.819270 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-641b4ac3-f29e-476d-a784-e4a71a38ffb5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:27.820460 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-641b4ac3-f29e-476d-a784-e4a71a38ffb5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:27.820962 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-641b4ac3-f29e-476d-a784-e4a71a38ffb5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:27.893017 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.multi_cell_list [None req-641b4ac3-f29e-476d-a784-e4a71a38ffb5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120933) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 13:24:27.936233 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-641b4ac3-f29e-476d-a784-e4a71a38ffb5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1657 microversion: 2.1 time: 0.229642 Oct 12 13:24:27.942141 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 379/716] 10.222.0.52 () {58 vars in 1125 bytes} [Wed Oct 12 13:24:27 2022] GET /compute/v2.1/servers => generated 1657 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:27.950287 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4083e808-eb05-4c3f-b354-69948d67d642 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:27.950984 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-4083e808-eb05-4c3f-b354-69948d67d642 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fdd5df96-d739-4e05-a503-2cfcab635cc8] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:28.250245 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-4083e808-eb05-4c3f-b354-69948d67d642 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:28.267089 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4083e808-eb05-4c3f-b354-69948d67d642 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8" status: 200 len: 1218 microversion: 2.1 time: 0.315984 Oct 12 13:24:28.275241 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 380/717] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:27 2022] GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8 => generated 1218 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:24:28.280431 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d3a80fc4-2582-4716-8bc7-adb42a9ced94 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:28.285756 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-d3a80fc4-2582-4716-8bc7-adb42a9ced94 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:28.292385 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3a80fc4-2582-4716-8bc7-adb42a9ced94 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:28.293040 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3a80fc4-2582-4716-8bc7-adb42a9ced94 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:28.293712 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3a80fc4-2582-4716-8bc7-adb42a9ced94 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:28.294543 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3a80fc4-2582-4716-8bc7-adb42a9ced94 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:28.295353 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3a80fc4-2582-4716-8bc7-adb42a9ced94 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:28.296061 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3a80fc4-2582-4716-8bc7-adb42a9ced94 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:28.301396 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:28.381449 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-6ce61a5e-cadd-4a8c-a9c2-aac7774dee74 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:28.404233 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6ce61a5e-cadd-4a8c-a9c2-aac7774dee74 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 200 len: 1476 microversion: 2.1 time: 0.678836 Oct 12 13:24:28.414849 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d3a80fc4-2582-4716-8bc7-adb42a9ced94 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:28.427685 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 338/718] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:27 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 1476 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:28.432489 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d3a80fc4-2582-4716-8bc7-adb42a9ced94 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:28.434380 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f4ac3238-bfc1-4d61-9cb8-7d4f196b4bb8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:28.434566 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d3a80fc4-2582-4716-8bc7-adb42a9ced94 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:28.437911 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f4ac3238-bfc1-4d61-9cb8-7d4f196b4bb8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:28.443055 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d3a80fc4-2582-4716-8bc7-adb42a9ced94 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1537 microversion: 2.91 time: 0.166409 Oct 12 13:24:28.443636 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 381/719] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:28 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1537 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:28.453090 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4ac3238-bfc1-4d61-9cb8-7d4f196b4bb8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:28.453090 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4ac3238-bfc1-4d61-9cb8-7d4f196b4bb8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:28.453090 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4ac3238-bfc1-4d61-9cb8-7d4f196b4bb8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:28.453090 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4ac3238-bfc1-4d61-9cb8-7d4f196b4bb8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:28.453481 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4ac3238-bfc1-4d61-9cb8-7d4f196b4bb8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:28.453481 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4ac3238-bfc1-4d61-9cb8-7d4f196b4bb8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:28.464456 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-facf261e-7614-41ae-a80e-39332819b999 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa049a160>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:28.514280 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-facf261e-7614-41ae-a80e-39332819b999 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9" status: 200 len: 1454 microversion: 2.1 time: 0.054937 Oct 12 13:24:28.514888 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 382/720] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:28 2022] GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9 => generated 1454 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:28.804542 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f4ac3238-bfc1-4d61-9cb8-7d4f196b4bb8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:28.814335 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f4ac3238-bfc1-4d61-9cb8-7d4f196b4bb8 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 200 len: 1468 microversion: 2.1 time: 0.385049 Oct 12 13:24:28.815314 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 339/721] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:28 2022] GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 1468 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:29.112985 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-e5af2be3-3f2e-41e4-b944-623138aa6874 req-c4243b53-a72a-4d95-b227-fe7c922e84ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "551f2f8d-4679-4647-a8dd-ece2be8eac33", "name": "network-vif-deleted", "tag": "8a9663e4-375c-4ed5-af37-d960c893ee70"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:29.134013 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-e5af2be3-3f2e-41e4-b944-623138aa6874 req-c4243b53-a72a-4d95-b227-fe7c922e84ab service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:29.134540 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-e5af2be3-3f2e-41e4-b944-623138aa6874 req-c4243b53-a72a-4d95-b227-fe7c922e84ab service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:29.134989 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-e5af2be3-3f2e-41e4-b944-623138aa6874 req-c4243b53-a72a-4d95-b227-fe7c922e84ab service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:29.168122 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-e5af2be3-3f2e-41e4-b944-623138aa6874 req-c4243b53-a72a-4d95-b227-fe7c922e84ab service nova] Creating event network-vif-deleted:8a9663e4-375c-4ed5-af37-d960c893ee70 for instance 551f2f8d-4679-4647-a8dd-ece2be8eac33 on n-h2-861076-2 Oct 12 13:24:29.186346 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-e5af2be3-3f2e-41e4-b944-623138aa6874 req-c4243b53-a72a-4d95-b227-fe7c922e84ab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077520 Oct 12 13:24:29.188160 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 383/722] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:29.313565 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-067b9faa-a6ae-483d-8231-8e9b2aca86e7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:29.314043 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-067b9faa-a6ae-483d-8231-8e9b2aca86e7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fdd5df96-d739-4e05-a503-2cfcab635cc8] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:29.432418 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8dff78b7-6388-4c37-89b7-87810748a7bc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:29.433195 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-8dff78b7-6388-4c37-89b7-87810748a7bc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:29.441450 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8dff78b7-6388-4c37-89b7-87810748a7bc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:29.441928 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8dff78b7-6388-4c37-89b7-87810748a7bc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:29.442408 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8dff78b7-6388-4c37-89b7-87810748a7bc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:29.443077 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8dff78b7-6388-4c37-89b7-87810748a7bc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:29.443533 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8dff78b7-6388-4c37-89b7-87810748a7bc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:29.443962 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8dff78b7-6388-4c37-89b7-87810748a7bc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:29.468733 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-067b9faa-a6ae-483d-8231-8e9b2aca86e7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:29.479803 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-067b9faa-a6ae-483d-8231-8e9b2aca86e7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8" status: 200 len: 1218 microversion: 2.1 time: 0.191832 Oct 12 13:24:29.497503 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 340/723] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:29 2022] GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8 => generated 1218 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:29.502693 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5f9048c1-146d-4f1c-904e-fe8b1ff76897 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:29.503568 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5f9048c1-146d-4f1c-904e-fe8b1ff76897 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:29.510313 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f9048c1-146d-4f1c-904e-fe8b1ff76897 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:29.511054 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f9048c1-146d-4f1c-904e-fe8b1ff76897 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:29.511735 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f9048c1-146d-4f1c-904e-fe8b1ff76897 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:29.512687 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f9048c1-146d-4f1c-904e-fe8b1ff76897 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:29.513368 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f9048c1-146d-4f1c-904e-fe8b1ff76897 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:29.513973 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f9048c1-146d-4f1c-904e-fe8b1ff76897 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:29.518581 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8dff78b7-6388-4c37-89b7-87810748a7bc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:29.519574 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8dff78b7-6388-4c37-89b7-87810748a7bc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:29.520074 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8dff78b7-6388-4c37-89b7-87810748a7bc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:29.520706 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-8dff78b7-6388-4c37-89b7-87810748a7bc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lazy-loading 'fault' on Instance uuid 551f2f8d-4679-4647-a8dd-ece2be8eac33 {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:24:29.634111 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-5f9048c1-146d-4f1c-904e-fe8b1ff76897 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:29.660158 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-5f9048c1-146d-4f1c-904e-fe8b1ff76897 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:29.666120 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-5f9048c1-146d-4f1c-904e-fe8b1ff76897 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:29.684331 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5f9048c1-146d-4f1c-904e-fe8b1ff76897 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1537 microversion: 2.91 time: 0.185562 Oct 12 13:24:29.684943 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 341/724] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:29 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1537 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:29.692705 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d6659638-9d44-4c0f-bf75-08e932a77d33 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9be5f8b0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:29.801945 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-8dff78b7-6388-4c37-89b7-87810748a7bc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:29.803858 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d6659638-9d44-4c0f-bf75-08e932a77d33 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9" status: 200 len: 1454 microversion: 2.1 time: 0.116184 Oct 12 13:24:29.804441 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 342/725] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:29 2022] GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9 => generated 1454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:29.832258 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-8dff78b7-6388-4c37-89b7-87810748a7bc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 200 len: 1310 microversion: 2.1 time: 0.404129 Oct 12 13:24:29.833214 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 384/726] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:29 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 1310 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:29.837859 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-411579f5-151e-43e5-aa39-4bcf87084856 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:29.838472 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-411579f5-151e-43e5-aa39-4bcf87084856 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:29.864889 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-411579f5-151e-43e5-aa39-4bcf87084856 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:29.865399 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-411579f5-151e-43e5-aa39-4bcf87084856 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:29.876035 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-411579f5-151e-43e5-aa39-4bcf87084856 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:29.876809 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-411579f5-151e-43e5-aa39-4bcf87084856 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:29.877364 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-411579f5-151e-43e5-aa39-4bcf87084856 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:29.877819 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-411579f5-151e-43e5-aa39-4bcf87084856 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:30.234223 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-411579f5-151e-43e5-aa39-4bcf87084856 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:30.257023 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-411579f5-151e-43e5-aa39-4bcf87084856 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 200 len: 1426 microversion: 2.1 time: 0.421039 Oct 12 13:24:30.278192 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 343/727] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:29 2022] GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 1426 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:30.511070 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d4394d18-4933-4196-a204-01b9126e8734 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:30.512321 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-d4394d18-4933-4196-a204-01b9126e8734 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fdd5df96-d739-4e05-a503-2cfcab635cc8] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:30.540047 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d4394d18-4933-4196-a204-01b9126e8734 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:30.561142 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d4394d18-4933-4196-a204-01b9126e8734 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:30.562017 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d4394d18-4933-4196-a204-01b9126e8734 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:30.563527 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d4394d18-4933-4196-a204-01b9126e8734 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:30.565967 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d4394d18-4933-4196-a204-01b9126e8734 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:30.567936 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d4394d18-4933-4196-a204-01b9126e8734 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:30.714825 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-08f7c204-fc3f-4ae1-8f24-bd63b72c36ba tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:30.715713 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-08f7c204-fc3f-4ae1-8f24-bd63b72c36ba tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:30.731951 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-08f7c204-fc3f-4ae1-8f24-bd63b72c36ba tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:30.732491 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-08f7c204-fc3f-4ae1-8f24-bd63b72c36ba tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:30.738930 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-08f7c204-fc3f-4ae1-8f24-bd63b72c36ba tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:30.739918 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-08f7c204-fc3f-4ae1-8f24-bd63b72c36ba tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:30.740402 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-08f7c204-fc3f-4ae1-8f24-bd63b72c36ba tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:30.745347 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-08f7c204-fc3f-4ae1-8f24-bd63b72c36ba tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:31.014106 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d4394d18-4933-4196-a204-01b9126e8734 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:31.014106 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d4394d18-4933-4196-a204-01b9126e8734 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8" status: 200 len: 1222 microversion: 2.1 time: 0.412427 Oct 12 13:24:31.014106 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 385/728] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:30 2022] GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8 => generated 1222 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:31.014106 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ab7d45de-1cca-4026-8f68-7f768fd95c31 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa0060dc0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:31.014727 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-08f7c204-fc3f-4ae1-8f24-bd63b72c36ba tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:31.014727 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-08f7c204-fc3f-4ae1-8f24-bd63b72c36ba tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:31.015220 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-08f7c204-fc3f-4ae1-8f24-bd63b72c36ba tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:31.015220 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-08f7c204-fc3f-4ae1-8f24-bd63b72c36ba tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1537 microversion: 2.91 time: 0.266876 Oct 12 13:24:31.015220 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 344/729] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:30 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1537 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:24:31.015220 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cfdcb99b-e42a-4e32-b9ce-df82e3765eb4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:31.015574 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cfdcb99b-e42a-4e32-b9ce-df82e3765eb4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:31.015574 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cfdcb99b-e42a-4e32-b9ce-df82e3765eb4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:31.015574 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cfdcb99b-e42a-4e32-b9ce-df82e3765eb4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:31.015962 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ab7d45de-1cca-4026-8f68-7f768fd95c31 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9" status: 200 len: 1454 microversion: 2.1 time: 0.070258 Oct 12 13:24:31.016084 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cfdcb99b-e42a-4e32-b9ce-df82e3765eb4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:31.016173 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 386/730] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:30 2022] GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9 => generated 1454 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:31.016255 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cfdcb99b-e42a-4e32-b9ce-df82e3765eb4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:31.016255 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cfdcb99b-e42a-4e32-b9ce-df82e3765eb4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:31.016255 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cfdcb99b-e42a-4e32-b9ce-df82e3765eb4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:31.059650 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cfdcb99b-e42a-4e32-b9ce-df82e3765eb4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:31.060304 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cfdcb99b-e42a-4e32-b9ce-df82e3765eb4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:31.060833 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cfdcb99b-e42a-4e32-b9ce-df82e3765eb4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:31.061428 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-cfdcb99b-e42a-4e32-b9ce-df82e3765eb4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lazy-loading 'fault' on Instance uuid 551f2f8d-4679-4647-a8dd-ece2be8eac33 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:24:31.127386 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-cfdcb99b-e42a-4e32-b9ce-df82e3765eb4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:31.138343 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cfdcb99b-e42a-4e32-b9ce-df82e3765eb4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 200 len: 1310 microversion: 2.1 time: 0.159601 Oct 12 13:24:31.139460 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 345/731] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:30 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 1310 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:31.206919 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-160c455f-1d46-4a5d-9ca4-48a32c5bd329 req-a9a38ba2-80d3-4bb6-9439-0b1f74c5d8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d88ccd8b-e58a-432a-9276-29cb5fa800af", "name": "network-vif-deleted", "tag": "e1de3787-e3fa-4432-b69e-b1340e341a8b"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:31.220596 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-160c455f-1d46-4a5d-9ca4-48a32c5bd329 req-a9a38ba2-80d3-4bb6-9439-0b1f74c5d8ec service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:31.224702 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-160c455f-1d46-4a5d-9ca4-48a32c5bd329 req-a9a38ba2-80d3-4bb6-9439-0b1f74c5d8ec service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:31.227022 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-160c455f-1d46-4a5d-9ca4-48a32c5bd329 req-a9a38ba2-80d3-4bb6-9439-0b1f74c5d8ec service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:31.242683 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-160c455f-1d46-4a5d-9ca4-48a32c5bd329 req-a9a38ba2-80d3-4bb6-9439-0b1f74c5d8ec service nova] Creating event network-vif-deleted:e1de3787-e3fa-4432-b69e-b1340e341a8b for instance d88ccd8b-e58a-432a-9276-29cb5fa800af on n-h2-861076-2 Oct 12 13:24:31.249480 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-160c455f-1d46-4a5d-9ca4-48a32c5bd329 req-a9a38ba2-80d3-4bb6-9439-0b1f74c5d8ec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046207 Oct 12 13:24:31.250597 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 387/732] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:31.297543 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4968026c-7979-4f26-bebc-0320fd14d38b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:31.301871 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-4968026c-7979-4f26-bebc-0320fd14d38b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:31.332019 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4968026c-7979-4f26-bebc-0320fd14d38b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:31.346101 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4968026c-7979-4f26-bebc-0320fd14d38b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:31.347731 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4968026c-7979-4f26-bebc-0320fd14d38b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:31.353921 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4968026c-7979-4f26-bebc-0320fd14d38b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:31.355481 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4968026c-7979-4f26-bebc-0320fd14d38b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:31.355941 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4968026c-7979-4f26-bebc-0320fd14d38b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:31.472430 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4968026c-7979-4f26-bebc-0320fd14d38b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:31.475787 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4968026c-7979-4f26-bebc-0320fd14d38b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:31.476477 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4968026c-7979-4f26-bebc-0320fd14d38b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:31.477369 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-4968026c-7979-4f26-bebc-0320fd14d38b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lazy-loading 'fault' on Instance uuid d88ccd8b-e58a-432a-9276-29cb5fa800af {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:24:31.707144 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-4968026c-7979-4f26-bebc-0320fd14d38b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:31.722714 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4968026c-7979-4f26-bebc-0320fd14d38b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 200 len: 1303 microversion: 2.1 time: 0.438304 Oct 12 13:24:31.725082 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 346/733] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:31 2022] GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 1303 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:32.021088 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d493bf82-4fcd-4a98-9152-a09136a83fa1 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa002a310>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:32.048365 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b2f0b9c3-0f58-4418-bd4d-de571bf645bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:32.051127 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b2f0b9c3-0f58-4418-bd4d-de571bf645bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fdd5df96-d739-4e05-a503-2cfcab635cc8] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:32.088222 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b2f0b9c3-0f58-4418-bd4d-de571bf645bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:32.088840 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b2f0b9c3-0f58-4418-bd4d-de571bf645bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:32.089320 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b2f0b9c3-0f58-4418-bd4d-de571bf645bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:32.093900 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b2f0b9c3-0f58-4418-bd4d-de571bf645bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:32.096258 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b2f0b9c3-0f58-4418-bd4d-de571bf645bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:32.117391 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b2f0b9c3-0f58-4418-bd4d-de571bf645bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:32.178336 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d493bf82-4fcd-4a98-9152-a09136a83fa1 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9" status: 200 len: 1454 microversion: 2.1 time: 0.164940 Oct 12 13:24:32.187638 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 388/734] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:32 2022] GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9 => generated 1454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:32.205505 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-693a8b37-0a4a-4c41-8d9c-27b5700b3793 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:32.206534 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-693a8b37-0a4a-4c41-8d9c-27b5700b3793 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:32.230324 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-693a8b37-0a4a-4c41-8d9c-27b5700b3793 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:32.231202 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-693a8b37-0a4a-4c41-8d9c-27b5700b3793 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:32.232157 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-693a8b37-0a4a-4c41-8d9c-27b5700b3793 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:32.234180 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-693a8b37-0a4a-4c41-8d9c-27b5700b3793 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:32.234890 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-693a8b37-0a4a-4c41-8d9c-27b5700b3793 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:32.235812 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-693a8b37-0a4a-4c41-8d9c-27b5700b3793 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:32.517836 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-693a8b37-0a4a-4c41-8d9c-27b5700b3793 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:32.545977 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-693a8b37-0a4a-4c41-8d9c-27b5700b3793 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:32.548861 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-693a8b37-0a4a-4c41-8d9c-27b5700b3793 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:32.553785 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-b2f0b9c3-0f58-4418-bd4d-de571bf645bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:32.562344 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b2f0b9c3-0f58-4418-bd4d-de571bf645bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8" status: 200 len: 1214 microversion: 2.1 time: 0.539149 Oct 12 13:24:32.568977 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-693a8b37-0a4a-4c41-8d9c-27b5700b3793 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1537 microversion: 2.91 time: 0.377251 Oct 12 13:24:32.587605 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 347/735] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:32 2022] GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8 => generated 1214 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:32.591054 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 389/736] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:32 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1537 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:32.592501 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-73fd4d04-bbfc-446b-b310-783eea98368a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:32.593158 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-73fd4d04-bbfc-446b-b310-783eea98368a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:32.609037 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-73fd4d04-bbfc-446b-b310-783eea98368a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:32.610519 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-73fd4d04-bbfc-446b-b310-783eea98368a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:32.611126 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-73fd4d04-bbfc-446b-b310-783eea98368a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:32.612079 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-73fd4d04-bbfc-446b-b310-783eea98368a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:32.612816 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-73fd4d04-bbfc-446b-b310-783eea98368a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:32.613536 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-73fd4d04-bbfc-446b-b310-783eea98368a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:32.691281 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-73fd4d04-bbfc-446b-b310-783eea98368a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] HTTP exception thrown: Instance 551f2f8d-4679-4647-a8dd-ece2be8eac33 could not be found. Oct 12 13:24:32.691281 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-73fd4d04-bbfc-446b-b310-783eea98368a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Request method failure captured: Oct 12 13:24:32.691281 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 HTTP/1.1 Oct 12 13:24:32.691281 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:24:32.691281 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:24:32.691281 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:24:32.691281 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:24:32.691281 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:24:32.691281 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:24:32.691281 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:24:32.691281 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:24:32.691281 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr_fvJoyTSs7WO2_Iw4uP0Z2_F14g2aLvTYWrc1RYensHajPuwGcg78PGS8UDkSPy4-UNg6TtCQ8p6g0i3jwwtlSd0ytnvWOHoyn7wKcTqsjYeQzwoNDLc3DamDRHuirUh7j0tKaXDk4jkZqifo90H26Dxvn3J4935xRkSF6t7PmkfU Oct 12 13:24:32.691281 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:24:32.691281 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:24:32.691281 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:24:32.691281 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:24:32.691281 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:24:32.691281 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:24:32.691281 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 8a6244b389164297b219fa7356b46ffe Oct 12 13:24:32.691281 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-DeleteServersAdminTestJSON-824206404 Oct 12 13:24:32.691281 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:24:32.691281 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:24:32.692766 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8a6244b389164297b219fa7356b46ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8a6244b389164297b219fa7356b46ffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a6244b389164297b219fa7356b46ffe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a6244b389164297b219fa7356b46ffe"}]}] Oct 12 13:24:32.692766 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-DeleteServersAdminTestJSON-824206404 Oct 12 13:24:32.692766 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 8a6244b389164297b219fa7356b46ffe Oct 12 13:24:32.692766 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-824206404 Oct 12 13:24:32.692766 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-DeleteServersAdminTestJSON-824206404-project Oct 12 13:24:32.692766 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:24:32.692766 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:24:32.692766 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 685195d760b9401685e9017725fe9d0a Oct 12 13:24:32.692766 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-DeleteServersAdminTestJSON-824206404-project Oct 12 13:24:32.692766 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:24:32.692766 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance 551f2f8d-4679-4647-a8dd-ece2be8eac33 could not be found. Oct 12 13:24:32.692766 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '551f2f8d-4679-4647-a8dd-ece2be8eac33'} Oct 12 13:24:32.693636 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:24:32.693636 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:32.693636 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:24:32.693636 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:24:32.693636 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:24:32.693636 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:24:32.693636 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:24:32.693636 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:24:32.693636 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:24:32.693636 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:24:32.693636 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 551f2f8d-4679-4647-a8dd-ece2be8eac33 could not be found. Oct 12 13:24:32.693636 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:24:32.693636 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:24:32.693636 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:24:32.693636 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:32.693636 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:24:32.693636 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:24:32.693636 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:24:32.693636 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:24:32.693636 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:24:32.694917 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:24:32.694917 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:24:32.694917 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:24:32.694917 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:24:32.694917 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:24:32.694917 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:24:32.694917 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:24:32.694917 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 551f2f8d-4679-4647-a8dd-ece2be8eac33 could not be found. Oct 12 13:24:32.694917 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:24:32.694917 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:24:32.694917 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:24:32.694917 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:32.694917 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:24:32.694917 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:24:32.694917 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:24:32.694917 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:24:32.694917 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 551f2f8d-4679-4647-a8dd-ece2be8eac33 could not be found. Oct 12 13:24:32.694917 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:24:32.696038 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-73fd4d04-bbfc-446b-b310-783eea98368a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Returning 404 to user: Instance 551f2f8d-4679-4647-a8dd-ece2be8eac33 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:24:32.696038 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-73fd4d04-bbfc-446b-b310-783eea98368a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 404 len: 111 microversion: 2.1 time: 0.102132 Oct 12 13:24:32.707445 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 348/737] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:32 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:24:32.779258 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6bef84ab-f009-4a8f-85f1-803b30dfe4c5 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:32.782250 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-6bef84ab-f009-4a8f-85f1-803b30dfe4c5 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: d88ccd8b-e58a-432a-9276-29cb5fa800af] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:32.817749 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6bef84ab-f009-4a8f-85f1-803b30dfe4c5 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:32.824222 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6bef84ab-f009-4a8f-85f1-803b30dfe4c5 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:32.825010 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6bef84ab-f009-4a8f-85f1-803b30dfe4c5 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:32.827555 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6bef84ab-f009-4a8f-85f1-803b30dfe4c5 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:32.832228 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6bef84ab-f009-4a8f-85f1-803b30dfe4c5 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:32.832989 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6bef84ab-f009-4a8f-85f1-803b30dfe4c5 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:32.904889 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-6bef84ab-f009-4a8f-85f1-803b30dfe4c5 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] HTTP exception thrown: Instance d88ccd8b-e58a-432a-9276-29cb5fa800af could not be found. Oct 12 13:24:32.910333 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6bef84ab-f009-4a8f-85f1-803b30dfe4c5 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Request method failure captured: Oct 12 13:24:32.910333 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af HTTP/1.1 Oct 12 13:24:32.910333 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:24:32.910333 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:24:32.910333 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:24:32.910333 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:24:32.910333 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:24:32.910333 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:24:32.910333 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:24:32.910333 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:24:32.910333 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr-Uy7R0-vO84LNBAwxPsssPvLLJJvDLLoKGFa8vBBM7F1Mf1vlFFzFToaRgPGnPKfPfeQQEWDVwjA-kXG2ItKpreMCd93oSqbLTmiWoKKoCe0M_BbZ4_liwNDN0-6wBzZaO_Moy7e6iBmO_tj-vMYydnf_VGtaHbljYhF2p-bsDVq4 Oct 12 13:24:32.910333 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:24:32.910333 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:24:32.910333 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:24:32.910333 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:24:32.910333 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:24:32.910333 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:24:32.910333 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: b92cdc745c654b538146a4a64f5f4b6f Oct 12 13:24:32.910333 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-MigrationsAdminTest-933851851 Oct 12 13:24:32.910333 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:24:32.910333 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:24:32.911837 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b92cdc745c654b538146a4a64f5f4b6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b92cdc745c654b538146a4a64f5f4b6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b92cdc745c654b538146a4a64f5f4b6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b92cdc745c654b538146a4a64f5f4b6f"}]}] Oct 12 13:24:32.911837 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-MigrationsAdminTest-933851851 Oct 12 13:24:32.911837 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: b92cdc745c654b538146a4a64f5f4b6f Oct 12 13:24:32.911837 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-MigrationsAdminTest-933851851 Oct 12 13:24:32.911837 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-MigrationsAdminTest-933851851-project Oct 12 13:24:32.911837 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:24:32.911837 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:24:32.911837 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 0df255f194e54dfb8781b982c2c60a98 Oct 12 13:24:32.911837 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-MigrationsAdminTest-933851851-project Oct 12 13:24:32.911837 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:24:32.911837 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance d88ccd8b-e58a-432a-9276-29cb5fa800af could not be found. Oct 12 13:24:32.911837 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'd88ccd8b-e58a-432a-9276-29cb5fa800af'} Oct 12 13:24:32.912655 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:24:32.912655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:32.912655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:24:32.912655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:24:32.912655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:24:32.912655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:24:32.912655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:24:32.912655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:24:32.912655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:24:32.912655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:24:32.912655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d88ccd8b-e58a-432a-9276-29cb5fa800af could not be found. Oct 12 13:24:32.912655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:32.912655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:24:32.912655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:32.912655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:32.912655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:24:32.912655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:24:32.912655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:24:32.912655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:24:32.912655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:24:32.913828 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:24:32.913828 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:24:32.913828 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:24:32.913828 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:24:32.913828 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:24:32.913828 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:24:32.913828 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:24:32.913828 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d88ccd8b-e58a-432a-9276-29cb5fa800af could not be found. Oct 12 13:24:32.913828 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:32.913828 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:24:32.913828 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:32.913828 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:32.913828 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:24:32.913828 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:24:32.913828 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:24:32.913828 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:24:32.913828 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d88ccd8b-e58a-432a-9276-29cb5fa800af could not be found. Oct 12 13:24:32.913828 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:32.915771 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6bef84ab-f009-4a8f-85f1-803b30dfe4c5 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Returning 404 to user: Instance d88ccd8b-e58a-432a-9276-29cb5fa800af could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:24:32.928948 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6bef84ab-f009-4a8f-85f1-803b30dfe4c5 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af" status: 404 len: 111 microversion: 2.1 time: 0.179498 Oct 12 13:24:32.935594 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 390/738] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:32 2022] GET /compute/v2.1/servers/d88ccd8b-e58a-432a-9276-29cb5fa800af => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:24:32.949357 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3072947e-bd90-4d8c-a91e-8070172bdab6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:32.949357 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3072947e-bd90-4d8c-a91e-8070172bdab6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:32.956112 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3072947e-bd90-4d8c-a91e-8070172bdab6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:32.957296 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3072947e-bd90-4d8c-a91e-8070172bdab6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:32.957742 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3072947e-bd90-4d8c-a91e-8070172bdab6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:32.961236 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3072947e-bd90-4d8c-a91e-8070172bdab6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:32.961737 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3072947e-bd90-4d8c-a91e-8070172bdab6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:32.962245 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3072947e-bd90-4d8c-a91e-8070172bdab6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:32.979629 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ff443933-1fe2-4e2b-801f-aadad0283312 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1436595396", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:33.027997 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3072947e-bd90-4d8c-a91e-8070172bdab6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:24:33.135791 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-ff443933-1fe2-4e2b-801f-aadad0283312 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] validate_networks() for None {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:24:33.236667 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:33.521812 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3072947e-bd90-4d8c-a91e-8070172bdab6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 204 len: 0 microversion: 2.1 time: 0.581191 Oct 12 13:24:33.522411 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 349/739] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:24:32 2022] DELETE /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:24:33.531218 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2f1a0d41-5130-476d-8b99-bd011c65c92e tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bcabf70>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:33.616134 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2f1a0d41-5130-476d-8b99-bd011c65c92e tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9" status: 200 len: 1454 microversion: 2.1 time: 0.089075 Oct 12 13:24:33.617224 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 350/740] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:33 2022] GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:33.624282 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-838de9d5-0973-4150-b281-552b3136f60b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:33.625058 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-838de9d5-0973-4150-b281-552b3136f60b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:33.648452 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-838de9d5-0973-4150-b281-552b3136f60b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:33.648991 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-838de9d5-0973-4150-b281-552b3136f60b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:33.649633 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-838de9d5-0973-4150-b281-552b3136f60b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:33.650978 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-838de9d5-0973-4150-b281-552b3136f60b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:33.651740 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-838de9d5-0973-4150-b281-552b3136f60b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:33.652388 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-838de9d5-0973-4150-b281-552b3136f60b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:34.227657 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-ff443933-1fe2-4e2b-801f-aadad0283312 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:24:34.228163 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-ff443933-1fe2-4e2b-801f-aadad0283312 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:24:34.228548 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-ff443933-1fe2-4e2b-801f-aadad0283312 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:24:34.229543 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-ff443933-1fe2-4e2b-801f-aadad0283312 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:24:34.229967 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-ff443933-1fe2-4e2b-801f-aadad0283312 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:24:34.246776 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ff443933-1fe2-4e2b-801f-aadad0283312 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:34.247269 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ff443933-1fe2-4e2b-801f-aadad0283312 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:34.247905 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ff443933-1fe2-4e2b-801f-aadad0283312 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:34.248642 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ff443933-1fe2-4e2b-801f-aadad0283312 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:34.250616 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ff443933-1fe2-4e2b-801f-aadad0283312 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:34.252156 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ff443933-1fe2-4e2b-801f-aadad0283312 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:34.305439 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-ff443933-1fe2-4e2b-801f-aadad0283312 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Getting quotas for project 8a6244b389164297b219fa7356b46ffe. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:24:34.322026 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-ff443933-1fe2-4e2b-801f-aadad0283312 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Getting quotas for user 685195d760b9401685e9017725fe9d0a and project 8a6244b389164297b219fa7356b46ffe. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:24:34.340049 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-838de9d5-0973-4150-b281-552b3136f60b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:34.355007 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-ff443933-1fe2-4e2b-801f-aadad0283312 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Going to run 1 instances... {{(pid=120933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:24:34.361776 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-838de9d5-0973-4150-b281-552b3136f60b tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 200 len: 1534 microversion: 2.1 time: 0.733624 Oct 12 13:24:34.361776 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 351/741] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:33 2022] GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 1534 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:34.363263 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-ff443933-1fe2-4e2b-801f-aadad0283312 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:24:34.386907 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d6edc0dd-9829-49e9-a652-a32a0770e520 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:34.390430 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d6edc0dd-9829-49e9-a652-a32a0770e520 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fdd5df96-d739-4e05-a503-2cfcab635cc8] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:34.405354 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6edc0dd-9829-49e9-a652-a32a0770e520 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:34.406346 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6edc0dd-9829-49e9-a652-a32a0770e520 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:34.406848 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6edc0dd-9829-49e9-a652-a32a0770e520 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:34.408603 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6edc0dd-9829-49e9-a652-a32a0770e520 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:34.409109 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6edc0dd-9829-49e9-a652-a32a0770e520 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:34.409539 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6edc0dd-9829-49e9-a652-a32a0770e520 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:34.541912 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d6edc0dd-9829-49e9-a652-a32a0770e520 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:34.553169 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d6edc0dd-9829-49e9-a652-a32a0770e520 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8" status: 200 len: 1270 microversion: 2.1 time: 0.194770 Oct 12 13:24:34.554536 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 352/742] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:34 2022] GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8 => generated 1270 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:34.562811 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-60f42922-43d8-4f13-8f22-2b180c1e5998 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:34.563544 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-60f42922-43d8-4f13-8f22-2b180c1e5998 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:34.573196 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-60f42922-43d8-4f13-8f22-2b180c1e5998 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:34.573798 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-60f42922-43d8-4f13-8f22-2b180c1e5998 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:34.574299 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-60f42922-43d8-4f13-8f22-2b180c1e5998 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:34.575066 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-60f42922-43d8-4f13-8f22-2b180c1e5998 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:34.575616 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-60f42922-43d8-4f13-8f22-2b180c1e5998 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:34.576132 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-60f42922-43d8-4f13-8f22-2b180c1e5998 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:34.634766 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ff443933-1fe2-4e2b-801f-aadad0283312 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.665030 Oct 12 13:24:34.635406 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 391/743] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:24:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 13:24:34.653805 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e7ab2c5d-feb7-401a-852c-611dacbceaf0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa017bb80>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:34.721100 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-60f42922-43d8-4f13-8f22-2b180c1e5998 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:34.728237 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e7ab2c5d-feb7-401a-852c-611dacbceaf0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9" status: 200 len: 1454 microversion: 2.1 time: 0.081331 Oct 12 13:24:34.728821 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 392/744] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:34 2022] GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:34.739895 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-bc88e930-c993-4c0f-bc11-2b515f17c36f tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:34.741714 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-60f42922-43d8-4f13-8f22-2b180c1e5998 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:34.747121 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-60f42922-43d8-4f13-8f22-2b180c1e5998 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:34.748295 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-bc88e930-c993-4c0f-bc11-2b515f17c36f tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:34.762107 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-60f42922-43d8-4f13-8f22-2b180c1e5998 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1537 microversion: 2.91 time: 0.206262 Oct 12 13:24:34.781260 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 353/745] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:34 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1537 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:34.801502 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:34.893016 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-bc88e930-c993-4c0f-bc11-2b515f17c36f tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:34.919380 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-bc88e930-c993-4c0f-bc11-2b515f17c36f tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 200 len: 1220 microversion: 2.1 time: 0.167240 Oct 12 13:24:34.943019 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 393/746] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:34 2022] GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 1220 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:35.388608 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ed1fd710-8ed9-4d14-853e-beb061fc1a71 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:35.393959 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-ed1fd710-8ed9-4d14-853e-beb061fc1a71 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:35.398428 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ed1fd710-8ed9-4d14-853e-beb061fc1a71 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:35.403781 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ed1fd710-8ed9-4d14-853e-beb061fc1a71 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:35.405392 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ed1fd710-8ed9-4d14-853e-beb061fc1a71 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:35.409675 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ed1fd710-8ed9-4d14-853e-beb061fc1a71 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:35.410352 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ed1fd710-8ed9-4d14-853e-beb061fc1a71 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:35.413363 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ed1fd710-8ed9-4d14-853e-beb061fc1a71 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:35.843374 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-54bc1fad-3550-459a-ae20-31ec2bccdfe4 tempest-ListImageFiltersNegativeTestJSON-388475548 tempest-ListImageFiltersNegativeTestJSON-388475548-project] Calling method '.version_select at 0x7f8a9be701f0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:35.888091 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-54bc1fad-3550-459a-ae20-31ec2bccdfe4 tempest-ListImageFiltersNegativeTestJSON-388475548 tempest-ListImageFiltersNegativeTestJSON-388475548-project] HTTP exception thrown: Image not found. Oct 12 13:24:35.906873 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-54bc1fad-3550-459a-ae20-31ec2bccdfe4 tempest-ListImageFiltersNegativeTestJSON-388475548 tempest-ListImageFiltersNegativeTestJSON-388475548-project] Request method failure captured: Oct 12 13:24:35.906873 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/images/c6fd21ae-afab-4b64-a4c3-e8a4b702b711 HTTP/1.1 Oct 12 13:24:35.906873 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:24:35.906873 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:24:35.906873 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:24:35.906873 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:24:35.906873 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:24:35.906873 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:24:35.906873 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:24:35.906873 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:24:35.906873 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsASl_Kd6CBwTxjkVRqKvpdxfSucA-T5mTKfJqzUQzvhw-NPnxnZ5IuHJ3_pOJlveGSufyCdTQeMNeTEwHtURpK8Dn5sjdu7C8ri_KMa5ksi0OYSYOughGMiVFBRTLW2PeQR7VOahB7ewq8aoSd_k92jT5KQ2T-YIl_dv-b3pAsDtXo Oct 12 13:24:35.906873 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:24:35.906873 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:24:35.906873 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:24:35.906873 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:24:35.906873 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:24:35.906873 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:24:35.906873 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 2de76744c8cb490cbfefb849356e3573 Oct 12 13:24:35.906873 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-388475548 Oct 12 13:24:35.906873 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:24:35.906873 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:24:35.908114 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2de76744c8cb490cbfefb849356e3573"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2de76744c8cb490cbfefb849356e3573"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2de76744c8cb490cbfefb849356e3573"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2de76744c8cb490cbfefb849356e3573"}]}] Oct 12 13:24:35.908114 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-388475548 Oct 12 13:24:35.908114 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 2de76744c8cb490cbfefb849356e3573 Oct 12 13:24:35.908114 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-388475548 Oct 12 13:24:35.908114 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ListImageFiltersNegativeTestJSON-388475548-project Oct 12 13:24:35.908114 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:24:35.908114 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:24:35.908114 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 2172d7db90b745e29dc1c99976fd29ba Oct 12 13:24:35.908114 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-388475548-project Oct 12 13:24:35.908114 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:24:35.908114 n-d-861076-2 devstack@n-api.service[120932]: exception: Image not found. Oct 12 13:24:35.908114 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'c6fd21ae-afab-4b64-a4c3-e8a4b702b711'} Oct 12 13:24:35.908114 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:24:35.909677 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:35.909677 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 13:24:35.909677 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 13:24:35.909677 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 13:24:35.909677 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 13:24:35.909677 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 13:24:35.909677 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 13:24:35.909677 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 13:24:35.909677 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 13:24:35.909677 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 13:24:35.909677 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 13:24:35.909677 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 13:24:35.909677 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 13:24:35.909677 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 13:24:35.909677 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 13:24:35.909677 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 13:24:35.909677 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 13:24:35.909677 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c6fd21ae-afab-4b64-a4c3-e8a4b702b711 Oct 12 13:24:35.910795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:24:35.910795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:24:35.910795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:24:35.910795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:35.910795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 12 13:24:35.910795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 12 13:24:35.910795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 13:24:35.910795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 13:24:35.910795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 13:24:35.910795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 13:24:35.910795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 13:24:35.910795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 13:24:35.910795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 13:24:35.910795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 13:24:35.910795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 13:24:35.910795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 13:24:35.910795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 13:24:35.910795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 13:24:35.910795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 13:24:35.910795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 13:24:35.911955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 13:24:35.911955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 13:24:35.911955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 13:24:35.911955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 13:24:35.911955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 13:24:35.911955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 13:24:35.911955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 13:24:35.911955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 13:24:35.911955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c6fd21ae-afab-4b64-a4c3-e8a4b702b711 could not be found. Oct 12 13:24:35.911955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:24:35.911955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:24:35.911955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:24:35.911955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:35.911955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:24:35.911955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:24:35.911955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:24:35.911955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:24:35.911955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:24:35.911955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:24:35.913112 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:24:35.913112 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:24:35.913112 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 12 13:24:35.913112 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 13:24:35.913112 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 13:24:35.913112 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:24:35.913112 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:24:35.913112 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:24:35.913112 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:35.913112 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:24:35.913112 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:24:35.913112 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:24:35.913112 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:24:35.913112 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 13:24:35.913112 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:24:35.913112 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-54bc1fad-3550-459a-ae20-31ec2bccdfe4 tempest-ListImageFiltersNegativeTestJSON-388475548 tempest-ListImageFiltersNegativeTestJSON-388475548-project] Returning 404 to user: Image not found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:24:35.926151 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-54bc1fad-3550-459a-ae20-31ec2bccdfe4 tempest-ListImageFiltersNegativeTestJSON-388475548 tempest-ListImageFiltersNegativeTestJSON-388475548-project] 10.222.0.52 "GET /compute/v2.1/images/c6fd21ae-afab-4b64-a4c3-e8a4b702b711" status: 404 len: 62 microversion: 2.1 time: 0.830609 Oct 12 13:24:35.931946 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 354/747] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:35 2022] GET /compute/v2.1/images/c6fd21ae-afab-4b64-a4c3-e8a4b702b711 => generated 62 bytes in 835 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:24:35.947226 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fefdf0ea-e08c-41ac-8d96-ddcaa198b85e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:35.947849 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fefdf0ea-e08c-41ac-8d96-ddcaa198b85e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fdd5df96-d739-4e05-a503-2cfcab635cc8] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:35.962594 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fefdf0ea-e08c-41ac-8d96-ddcaa198b85e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:35.963099 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fefdf0ea-e08c-41ac-8d96-ddcaa198b85e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:35.963539 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fefdf0ea-e08c-41ac-8d96-ddcaa198b85e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:35.968187 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fefdf0ea-e08c-41ac-8d96-ddcaa198b85e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:35.969637 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fefdf0ea-e08c-41ac-8d96-ddcaa198b85e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:35.970102 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fefdf0ea-e08c-41ac-8d96-ddcaa198b85e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:36.269090 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-fefdf0ea-e08c-41ac-8d96-ddcaa198b85e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:36.278113 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fefdf0ea-e08c-41ac-8d96-ddcaa198b85e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8" status: 200 len: 1270 microversion: 2.1 time: 0.345247 Oct 12 13:24:36.283050 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 355/748] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:35 2022] GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8 => generated 1270 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:36.283171 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-86a0eb84-2d20-4624-95c4-872e22a85543 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9be704c0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:36.307850 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-ed1fd710-8ed9-4d14-853e-beb061fc1a71 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:36.328210 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ed1fd710-8ed9-4d14-853e-beb061fc1a71 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 200 len: 1534 microversion: 2.1 time: 0.942885 Oct 12 13:24:36.349516 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 394/749] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:35 2022] GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 1534 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:36.463623 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c4b40e65-ac0a-4150-84ec-e2622e21e2e0 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-959483015", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:36.464631 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-86a0eb84-2d20-4624-95c4-872e22a85543 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9" status: 200 len: 1454 microversion: 2.1 time: 0.184862 Oct 12 13:24:36.474806 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 356/750] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:36 2022] GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9 => generated 1454 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:36.486261 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c9b4890f-f933-4b8b-bf8b-f2cccd1bea17 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:36.486898 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c9b4890f-f933-4b8b-bf8b-f2cccd1bea17 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:36.511336 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9b4890f-f933-4b8b-bf8b-f2cccd1bea17 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:36.518944 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9b4890f-f933-4b8b-bf8b-f2cccd1bea17 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:36.523059 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9b4890f-f933-4b8b-bf8b-f2cccd1bea17 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:36.523845 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9b4890f-f933-4b8b-bf8b-f2cccd1bea17 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:36.524339 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9b4890f-f933-4b8b-bf8b-f2cccd1bea17 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:36.531032 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9b4890f-f933-4b8b-bf8b-f2cccd1bea17 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:36.571041 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-c4b40e65-ac0a-4150-84ec-e2622e21e2e0 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] validate_networks() for None {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:24:36.675185 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:36.967202 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c9b4890f-f933-4b8b-bf8b-f2cccd1bea17 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:36.994135 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c9b4890f-f933-4b8b-bf8b-f2cccd1bea17 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:36.996376 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c9b4890f-f933-4b8b-bf8b-f2cccd1bea17 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:36.999798 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:37.004418 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c9b4890f-f933-4b8b-bf8b-f2cccd1bea17 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1537 microversion: 2.91 time: 0.532037 Oct 12 13:24:37.005722 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 357/751] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:36 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1537 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:37.011236 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7a0fe539-40fb-4c28-9d1f-f59dfb2ee271 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:37.012196 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7a0fe539-40fb-4c28-9d1f-f59dfb2ee271 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:37.020215 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7a0fe539-40fb-4c28-9d1f-f59dfb2ee271 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:37.021087 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7a0fe539-40fb-4c28-9d1f-f59dfb2ee271 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:37.021763 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7a0fe539-40fb-4c28-9d1f-f59dfb2ee271 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:37.022753 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7a0fe539-40fb-4c28-9d1f-f59dfb2ee271 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:37.023493 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7a0fe539-40fb-4c28-9d1f-f59dfb2ee271 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:37.024158 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7a0fe539-40fb-4c28-9d1f-f59dfb2ee271 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:37.319615 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-7a0fe539-40fb-4c28-9d1f-f59dfb2ee271 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:37.328659 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7a0fe539-40fb-4c28-9d1f-f59dfb2ee271 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 200 len: 1224 microversion: 2.1 time: 0.321601 Oct 12 13:24:37.346483 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 358/752] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:37 2022] GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 1224 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:37.363782 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-46424729-3588-439b-8fe5-e9bd1ef1b8a7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:37.375296 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-46424729-3588-439b-8fe5-e9bd1ef1b8a7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fdd5df96-d739-4e05-a503-2cfcab635cc8] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:37.382340 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-46424729-3588-439b-8fe5-e9bd1ef1b8a7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:37.383169 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-46424729-3588-439b-8fe5-e9bd1ef1b8a7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:37.383816 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-46424729-3588-439b-8fe5-e9bd1ef1b8a7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:37.384828 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-46424729-3588-439b-8fe5-e9bd1ef1b8a7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:37.385585 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-46424729-3588-439b-8fe5-e9bd1ef1b8a7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:37.386256 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-46424729-3588-439b-8fe5-e9bd1ef1b8a7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:37.882665 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-46424729-3588-439b-8fe5-e9bd1ef1b8a7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:37.901814 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-46424729-3588-439b-8fe5-e9bd1ef1b8a7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8" status: 200 len: 1276 microversion: 2.1 time: 0.552423 Oct 12 13:24:37.908663 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 359/753] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:37 2022] GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8 => generated 1276 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:37.915601 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-41403068-e4c1-409f-90f6-ca27e62134a3 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:37.916256 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-41403068-e4c1-409f-90f6-ca27e62134a3 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:37.933935 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-41403068-e4c1-409f-90f6-ca27e62134a3 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:37.936145 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-41403068-e4c1-409f-90f6-ca27e62134a3 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:37.936145 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-41403068-e4c1-409f-90f6-ca27e62134a3 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:37.939450 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-41403068-e4c1-409f-90f6-ca27e62134a3 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:37.940047 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-41403068-e4c1-409f-90f6-ca27e62134a3 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:37.940498 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-41403068-e4c1-409f-90f6-ca27e62134a3 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:38.132056 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-41403068-e4c1-409f-90f6-ca27e62134a3 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:38.142509 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-41403068-e4c1-409f-90f6-ca27e62134a3 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 200 len: 1492 microversion: 2.1 time: 0.236665 Oct 12 13:24:38.143101 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 360/754] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:37 2022] GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 1492 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:38.178908 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b08f89d3-739c-49a2-8b3a-29451994f924 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa01ff0d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:38.285844 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b08f89d3-739c-49a2-8b3a-29451994f924 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9" status: 200 len: 1454 microversion: 2.1 time: 0.130131 Oct 12 13:24:38.289823 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 361/755] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:38 2022] GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9 => generated 1454 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:38.302685 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-ea175a52-f156-45eb-adf7-35a193f99999 req-7b9f34d8-5a06-4ad3-8e09-4e2e5777243d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad899a20-368e-4d9b-908d-4081aabc4e96", "name": "network-vif-deleted", "tag": "5e2de395-46bb-4f74-87a2-7ec1e55f5f38"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:38.330756 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ea175a52-f156-45eb-adf7-35a193f99999 req-7b9f34d8-5a06-4ad3-8e09-4e2e5777243d service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:38.333695 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ea175a52-f156-45eb-adf7-35a193f99999 req-7b9f34d8-5a06-4ad3-8e09-4e2e5777243d service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:38.335880 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ea175a52-f156-45eb-adf7-35a193f99999 req-7b9f34d8-5a06-4ad3-8e09-4e2e5777243d service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:38.362907 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-c4b40e65-ac0a-4150-84ec-e2622e21e2e0 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:24:38.364571 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-c4b40e65-ac0a-4150-84ec-e2622e21e2e0 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:24:38.365629 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-c4b40e65-ac0a-4150-84ec-e2622e21e2e0 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:24:38.367501 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-c4b40e65-ac0a-4150-84ec-e2622e21e2e0 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:24:38.368191 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-c4b40e65-ac0a-4150-84ec-e2622e21e2e0 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:24:38.376687 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-ea175a52-f156-45eb-adf7-35a193f99999 req-7b9f34d8-5a06-4ad3-8e09-4e2e5777243d service nova] Creating event network-vif-deleted:5e2de395-46bb-4f74-87a2-7ec1e55f5f38 for instance ad899a20-368e-4d9b-908d-4081aabc4e96 on n-h1-861076-2 Oct 12 13:24:38.378848 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-ea175a52-f156-45eb-adf7-35a193f99999 req-7b9f34d8-5a06-4ad3-8e09-4e2e5777243d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086740 Oct 12 13:24:38.385201 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 362/756] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:38.394045 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=57 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:38.399273 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d0ae34f3-e3e1-463e-9e0e-b570c4be8f56 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:38.404464 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d0ae34f3-e3e1-463e-9e0e-b570c4be8f56 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:38.404776 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c4b40e65-ac0a-4150-84ec-e2622e21e2e0 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:38.405305 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c4b40e65-ac0a-4150-84ec-e2622e21e2e0 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:38.411535 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c4b40e65-ac0a-4150-84ec-e2622e21e2e0 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:38.412500 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c4b40e65-ac0a-4150-84ec-e2622e21e2e0 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:38.413014 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c4b40e65-ac0a-4150-84ec-e2622e21e2e0 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:38.418479 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c4b40e65-ac0a-4150-84ec-e2622e21e2e0 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:38.422652 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0ae34f3-e3e1-463e-9e0e-b570c4be8f56 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:38.427103 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0ae34f3-e3e1-463e-9e0e-b570c4be8f56 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:38.429091 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0ae34f3-e3e1-463e-9e0e-b570c4be8f56 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:38.431274 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0ae34f3-e3e1-463e-9e0e-b570c4be8f56 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:38.433172 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0ae34f3-e3e1-463e-9e0e-b570c4be8f56 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:38.434982 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0ae34f3-e3e1-463e-9e0e-b570c4be8f56 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:38.493587 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-c4b40e65-ac0a-4150-84ec-e2622e21e2e0 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Getting quotas for project 7afd8d44b48d4ec0b54a400fd73ca770. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:24:38.502686 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-c4b40e65-ac0a-4150-84ec-e2622e21e2e0 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Getting quotas for user 27540849dbc344a384a1f24a6cc32175 and project 7afd8d44b48d4ec0b54a400fd73ca770. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:24:38.531898 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c4b40e65-ac0a-4150-84ec-e2622e21e2e0 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Going to run 1 instances... {{(pid=120933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:24:38.539785 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c4b40e65-ac0a-4150-84ec-e2622e21e2e0 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: 981cf996-0c9a-4e4a-8ec0-53ca023742eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:24:38.746522 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c4b40e65-ac0a-4150-84ec-e2622e21e2e0 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.389249 Oct 12 13:24:38.751411 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 395/757] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:24:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 13:24:38.774092 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a4865d39-5e76-49d5-8ee2-a662fdf502a5 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:38.781624 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a4865d39-5e76-49d5-8ee2-a662fdf502a5 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:38.822120 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a4865d39-5e76-49d5-8ee2-a662fdf502a5 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:38.824594 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a4865d39-5e76-49d5-8ee2-a662fdf502a5 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:38.830461 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a4865d39-5e76-49d5-8ee2-a662fdf502a5 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:38.831633 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a4865d39-5e76-49d5-8ee2-a662fdf502a5 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:38.838226 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a4865d39-5e76-49d5-8ee2-a662fdf502a5 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:38.839069 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a4865d39-5e76-49d5-8ee2-a662fdf502a5 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:38.878533 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d0ae34f3-e3e1-463e-9e0e-b570c4be8f56 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:38.894992 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d0ae34f3-e3e1-463e-9e0e-b570c4be8f56 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:38.896465 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d0ae34f3-e3e1-463e-9e0e-b570c4be8f56 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:38.929210 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d0ae34f3-e3e1-463e-9e0e-b570c4be8f56 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1537 microversion: 2.91 time: 0.542143 Oct 12 13:24:38.935547 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 363/758] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:38 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1537 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:38.950355 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3189fa36-63a0-497f-8d17-0ccb2119a437 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:38.951010 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3189fa36-63a0-497f-8d17-0ccb2119a437 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: 981cf996-0c9a-4e4a-8ec0-53ca023742eb] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:39.251560 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-3189fa36-63a0-497f-8d17-0ccb2119a437 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:39.254706 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=51 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:39.262062 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3189fa36-63a0-497f-8d17-0ccb2119a437 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb" status: 200 len: 1221 microversion: 2.1 time: 0.325276 Oct 12 13:24:39.289269 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 364/759] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:38 2022] GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb => generated 1221 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:39.294341 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b3fb3500-f6fe-4f42-9a2b-20affad83e45 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:39.294951 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b3fb3500-f6fe-4f42-9a2b-20affad83e45 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fdd5df96-d739-4e05-a503-2cfcab635cc8] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:39.303326 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3fb3500-f6fe-4f42-9a2b-20affad83e45 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:39.303826 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3fb3500-f6fe-4f42-9a2b-20affad83e45 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:39.304536 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3fb3500-f6fe-4f42-9a2b-20affad83e45 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:39.305335 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3fb3500-f6fe-4f42-9a2b-20affad83e45 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:39.305797 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3fb3500-f6fe-4f42-9a2b-20affad83e45 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:39.306395 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3fb3500-f6fe-4f42-9a2b-20affad83e45 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:39.338124 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a4865d39-5e76-49d5-8ee2-a662fdf502a5 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:39.340160 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a4865d39-5e76-49d5-8ee2-a662fdf502a5 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 200 len: 1280 microversion: 2.1 time: 0.587038 Oct 12 13:24:39.341938 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 396/760] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:38 2022] GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 1280 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:39.358850 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-48fc4c33-fa80-4cc4-a7c2-63108757cd22 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:39.359554 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-48fc4c33-fa80-4cc4-a7c2-63108757cd22 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:39.373507 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-48fc4c33-fa80-4cc4-a7c2-63108757cd22 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:39.374529 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-48fc4c33-fa80-4cc4-a7c2-63108757cd22 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:39.375040 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-48fc4c33-fa80-4cc4-a7c2-63108757cd22 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:39.376470 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-48fc4c33-fa80-4cc4-a7c2-63108757cd22 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:39.380663 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-48fc4c33-fa80-4cc4-a7c2-63108757cd22 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:39.381536 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-48fc4c33-fa80-4cc4-a7c2-63108757cd22 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:39.471072 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-48fc4c33-fa80-4cc4-a7c2-63108757cd22 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:39.473899 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-48fc4c33-fa80-4cc4-a7c2-63108757cd22 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:39.474538 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-48fc4c33-fa80-4cc4-a7c2-63108757cd22 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:39.475152 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-48fc4c33-fa80-4cc4-a7c2-63108757cd22 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lazy-loading 'fault' on Instance uuid ad899a20-368e-4d9b-908d-4081aabc4e96 {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:24:39.609694 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-b3fb3500-f6fe-4f42-9a2b-20affad83e45 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:39.613195 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-48fc4c33-fa80-4cc4-a7c2-63108757cd22 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:39.623353 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b3fb3500-f6fe-4f42-9a2b-20affad83e45 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8" status: 200 len: 1276 microversion: 2.1 time: 0.332660 Oct 12 13:24:39.623908 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 365/761] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:39 2022] GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8 => generated 1276 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:39.639024 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e9358c63-235c-4aea-a8e4-a9d16500b87b tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa029e5e0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:39.655104 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-48fc4c33-fa80-4cc4-a7c2-63108757cd22 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 200 len: 1368 microversion: 2.1 time: 0.310231 Oct 12 13:24:39.657025 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 397/762] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:39 2022] GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 1368 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:39.724779 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e9358c63-235c-4aea-a8e4-a9d16500b87b tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9" status: 200 len: 1454 microversion: 2.1 time: 0.099654 Oct 12 13:24:39.727005 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 366/763] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:39 2022] GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9 => generated 1454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:39.965439 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d437d995-d4ef-42c1-ad66-7186a774f38b tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:39.966107 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-d437d995-d4ef-42c1-ad66-7186a774f38b tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:39.986603 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d437d995-d4ef-42c1-ad66-7186a774f38b tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:39.988668 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d437d995-d4ef-42c1-ad66-7186a774f38b tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:39.992076 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d437d995-d4ef-42c1-ad66-7186a774f38b tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:39.992839 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d437d995-d4ef-42c1-ad66-7186a774f38b tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:39.993366 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d437d995-d4ef-42c1-ad66-7186a774f38b tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:39.993800 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d437d995-d4ef-42c1-ad66-7186a774f38b tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:40.298419 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1f97efd7-91ab-412a-9edb-cb2e4c733836 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:40.299237 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1f97efd7-91ab-412a-9edb-cb2e4c733836 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: 981cf996-0c9a-4e4a-8ec0-53ca023742eb] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:40.315747 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d437d995-d4ef-42c1-ad66-7186a774f38b tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:40.331843 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d437d995-d4ef-42c1-ad66-7186a774f38b tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:40.333955 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d437d995-d4ef-42c1-ad66-7186a774f38b tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:40.353531 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d437d995-d4ef-42c1-ad66-7186a774f38b tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1537 microversion: 2.91 time: 0.392931 Oct 12 13:24:40.365715 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 398/764] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:39 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1537 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:40.380391 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b959293d-bc18-42a2-96eb-86c79c3a5c3c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:40.381092 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-b959293d-bc18-42a2-96eb-86c79c3a5c3c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:40.400221 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b959293d-bc18-42a2-96eb-86c79c3a5c3c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:40.400969 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b959293d-bc18-42a2-96eb-86c79c3a5c3c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:40.401595 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b959293d-bc18-42a2-96eb-86c79c3a5c3c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:40.402556 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b959293d-bc18-42a2-96eb-86c79c3a5c3c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:40.405583 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b959293d-bc18-42a2-96eb-86c79c3a5c3c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:40.406241 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b959293d-bc18-42a2-96eb-86c79c3a5c3c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:40.789941 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-1f97efd7-91ab-412a-9edb-cb2e4c733836 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:40.803524 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1f97efd7-91ab-412a-9edb-cb2e4c733836 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb" status: 200 len: 1221 microversion: 2.1 time: 0.510818 Oct 12 13:24:40.810292 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 367/765] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:40 2022] GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb => generated 1221 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:24:40.830279 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b54dd02e-92dd-4535-82eb-f3381c446879 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:40.834312 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b54dd02e-92dd-4535-82eb-f3381c446879 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fdd5df96-d739-4e05-a503-2cfcab635cc8] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:40.844582 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b54dd02e-92dd-4535-82eb-f3381c446879 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:40.845532 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b54dd02e-92dd-4535-82eb-f3381c446879 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:40.846205 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b54dd02e-92dd-4535-82eb-f3381c446879 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:40.848865 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b54dd02e-92dd-4535-82eb-f3381c446879 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:40.849026 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b959293d-bc18-42a2-96eb-86c79c3a5c3c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:40.850518 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b54dd02e-92dd-4535-82eb-f3381c446879 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:40.851346 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b54dd02e-92dd-4535-82eb-f3381c446879 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:40.884072 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b959293d-bc18-42a2-96eb-86c79c3a5c3c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 200 len: 1278 microversion: 2.1 time: 0.508641 Oct 12 13:24:40.884752 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 399/766] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:40 2022] GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 1278 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:40.896054 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-88d71b37-0562-4d99-8471-8c41b2623086 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:40.903856 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-88d71b37-0562-4d99-8471-8c41b2623086 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: ad899a20-368e-4d9b-908d-4081aabc4e96] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:40.948921 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-88d71b37-0562-4d99-8471-8c41b2623086 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:40.951253 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-88d71b37-0562-4d99-8471-8c41b2623086 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:40.954598 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-88d71b37-0562-4d99-8471-8c41b2623086 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:40.959818 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-88d71b37-0562-4d99-8471-8c41b2623086 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:40.961284 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-88d71b37-0562-4d99-8471-8c41b2623086 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:40.961761 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-88d71b37-0562-4d99-8471-8c41b2623086 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:40.995774 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-88d71b37-0562-4d99-8471-8c41b2623086 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] HTTP exception thrown: Instance ad899a20-368e-4d9b-908d-4081aabc4e96 could not be found. Oct 12 13:24:40.998293 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-88d71b37-0562-4d99-8471-8c41b2623086 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Request method failure captured: Oct 12 13:24:40.998293 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 HTTP/1.1 Oct 12 13:24:40.998293 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:24:40.998293 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:24:40.998293 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:24:40.998293 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:24:40.998293 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:24:40.998293 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:24:40.998293 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:24:40.998293 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:24:40.998293 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr-Uy7R0-vO84LNBAwxPsssPvLLJJvDLLoKGFa8vBBM7F1Mf1vlFFzFToaRgPGnPKfPfeQQEWDVwjA-kXG2ItKpreMCd93oSqbLTmiWoKKoCe0M_BbZ4_liwNDN0-6wBzZaO_Moy7e6iBmO_tj-vMYydnf_VGtaHbljYhF2p-bsDVq4 Oct 12 13:24:40.998293 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:24:40.998293 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:24:40.998293 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:24:40.998293 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:24:40.998293 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:24:40.998293 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:24:40.998293 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: b92cdc745c654b538146a4a64f5f4b6f Oct 12 13:24:40.998293 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-MigrationsAdminTest-933851851 Oct 12 13:24:40.998293 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:24:40.998293 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:24:40.999820 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b92cdc745c654b538146a4a64f5f4b6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b92cdc745c654b538146a4a64f5f4b6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b92cdc745c654b538146a4a64f5f4b6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b92cdc745c654b538146a4a64f5f4b6f"}]}] Oct 12 13:24:40.999820 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-MigrationsAdminTest-933851851 Oct 12 13:24:40.999820 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: b92cdc745c654b538146a4a64f5f4b6f Oct 12 13:24:40.999820 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-MigrationsAdminTest-933851851 Oct 12 13:24:40.999820 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-MigrationsAdminTest-933851851-project Oct 12 13:24:40.999820 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:24:40.999820 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:24:40.999820 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 0df255f194e54dfb8781b982c2c60a98 Oct 12 13:24:40.999820 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-MigrationsAdminTest-933851851-project Oct 12 13:24:40.999820 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:24:40.999820 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance ad899a20-368e-4d9b-908d-4081aabc4e96 could not be found. Oct 12 13:24:40.999820 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'ad899a20-368e-4d9b-908d-4081aabc4e96'} Oct 12 13:24:41.000928 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:24:41.000928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:41.000928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:24:41.000928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:24:41.000928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:24:41.000928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:24:41.000928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:24:41.000928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:24:41.000928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:24:41.000928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:24:41.000928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad899a20-368e-4d9b-908d-4081aabc4e96 could not be found. Oct 12 13:24:41.000928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:41.000928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:24:41.000928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:41.000928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:41.000928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:24:41.000928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:24:41.000928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:24:41.000928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:24:41.000928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:24:41.002382 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:24:41.002382 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:24:41.002382 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:24:41.002382 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:24:41.002382 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:24:41.002382 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:24:41.002382 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:24:41.002382 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad899a20-368e-4d9b-908d-4081aabc4e96 could not be found. Oct 12 13:24:41.002382 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:41.002382 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:24:41.002382 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:41.002382 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:41.002382 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:24:41.002382 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:24:41.002382 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:24:41.002382 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:24:41.002382 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad899a20-368e-4d9b-908d-4081aabc4e96 could not be found. Oct 12 13:24:41.002382 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:41.005433 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-88d71b37-0562-4d99-8471-8c41b2623086 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Returning 404 to user: Instance ad899a20-368e-4d9b-908d-4081aabc4e96 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:24:41.006539 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-88d71b37-0562-4d99-8471-8c41b2623086 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96" status: 404 len: 111 microversion: 2.1 time: 0.120812 Oct 12 13:24:41.010499 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 400/767] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:40 2022] GET /compute/v2.1/servers/ad899a20-368e-4d9b-908d-4081aabc4e96 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:24:41.016684 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3d403271-0d38-430b-a4a1-3425c5f25f12 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa002adc0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:41.074067 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3d403271-0d38-430b-a4a1-3425c5f25f12 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9" status: 200 len: 1454 microversion: 2.1 time: 0.062240 Oct 12 13:24:41.075691 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 401/768] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:41 2022] GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9 => generated 1454 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:41.310024 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-b54dd02e-92dd-4535-82eb-f3381c446879 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:41.320458 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b54dd02e-92dd-4535-82eb-f3381c446879 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8" status: 200 len: 1276 microversion: 2.1 time: 0.509014 Oct 12 13:24:41.321085 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 368/769] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:40 2022] GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8 => generated 1276 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:41.344754 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-57c066bd-e591-4f87-b511-8045a933bd80 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:41.353080 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-57c066bd-e591-4f87-b511-8045a933bd80 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 177cff06-72ce-423d-bbe7-9ebcd331d29d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:41.376213 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-57c066bd-e591-4f87-b511-8045a933bd80 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:41.376709 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-57c066bd-e591-4f87-b511-8045a933bd80 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:41.388263 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-57c066bd-e591-4f87-b511-8045a933bd80 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:41.389138 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-57c066bd-e591-4f87-b511-8045a933bd80 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:41.389631 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-57c066bd-e591-4f87-b511-8045a933bd80 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:41.390067 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-57c066bd-e591-4f87-b511-8045a933bd80 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:41.483629 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-41728d25-cd97-4f8b-b016-b265fc172b9e tempest-ServersTestJSON-1777698360 tempest-ServersTestJSON-1777698360-project] Action: 'create', calling method: .version_select at 0x7f8a9be7cee0>, body: {"keypair": {"name": "tempest-keypair-1125322203", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFYvHdYBBt9QNza/gAf1OcINNQlEnxow58NOojBif0kDAgNP8fGYyRIPf1MipHhWGHEOtF2u8A+i4+dLt6AArqCOMooN5HCdkIL4WcJIJ9p2pqiDgAxRde9JUOVSJOIMA=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:41.489667 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-57c066bd-e591-4f87-b511-8045a933bd80 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 177cff06-72ce-423d-bbe7-9ebcd331d29d] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:24:41.538733 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-41728d25-cd97-4f8b-b016-b265fc172b9e tempest-ServersTestJSON-1777698360 tempest-ServersTestJSON-1777698360-project] Getting quotas for project 4b98325c375f46cea78ea69a82378bd4. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:24:41.547260 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-41728d25-cd97-4f8b-b016-b265fc172b9e tempest-ServersTestJSON-1777698360 tempest-ServersTestJSON-1777698360-project] Getting quotas for user b9adc9c00131411596c43adaa83e1588 and project 4b98325c375f46cea78ea69a82378bd4. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:24:41.740841 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-41728d25-cd97-4f8b-b016-b265fc172b9e tempest-ServersTestJSON-1777698360 tempest-ServersTestJSON-1777698360-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.663477 Oct 12 13:24:41.757406 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 402/770] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:24:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:41.757406 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9ad53cd6-3748-4807-91be-8b8c7521a5dc tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:41.757406 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-9ad53cd6-3748-4807-91be-8b8c7521a5dc tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:41.780013 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9ad53cd6-3748-4807-91be-8b8c7521a5dc tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:41.781326 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9ad53cd6-3748-4807-91be-8b8c7521a5dc tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:41.782061 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9ad53cd6-3748-4807-91be-8b8c7521a5dc tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:41.784646 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9ad53cd6-3748-4807-91be-8b8c7521a5dc tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:41.785381 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9ad53cd6-3748-4807-91be-8b8c7521a5dc tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:41.786713 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9ad53cd6-3748-4807-91be-8b8c7521a5dc tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:41.944116 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9ad53cd6-3748-4807-91be-8b8c7521a5dc tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:41.954858 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9ad53cd6-3748-4807-91be-8b8c7521a5dc tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:41.962373 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9ad53cd6-3748-4807-91be-8b8c7521a5dc tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:41.974195 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9ad53cd6-3748-4807-91be-8b8c7521a5dc tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1558 microversion: 2.91 time: 0.222917 Oct 12 13:24:41.979387 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 403/771] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:41 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1558 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:41.994158 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-004a49bd-44e5-487a-af8b-b052cabdc915 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:41.994692 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-004a49bd-44e5-487a-af8b-b052cabdc915 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: 981cf996-0c9a-4e4a-8ec0-53ca023742eb] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:42.003812 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-004a49bd-44e5-487a-af8b-b052cabdc915 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:42.004311 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-004a49bd-44e5-487a-af8b-b052cabdc915 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:42.007851 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-004a49bd-44e5-487a-af8b-b052cabdc915 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:42.008639 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-004a49bd-44e5-487a-af8b-b052cabdc915 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:42.013017 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-004a49bd-44e5-487a-af8b-b052cabdc915 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:42.013532 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-004a49bd-44e5-487a-af8b-b052cabdc915 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:42.113734 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-57c066bd-e591-4f87-b511-8045a933bd80 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "DELETE /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d" status: 204 len: 0 microversion: 2.1 time: 0.780114 Oct 12 13:24:42.115997 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 369/772] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:24:41 2022] DELETE /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d => generated 0 bytes in 794 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:24:42.129626 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-004a49bd-44e5-487a-af8b-b052cabdc915 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:42.138220 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-dc68a6be-9f8a-451e-8331-6ea952700d58 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:42.146703 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-dc68a6be-9f8a-451e-8331-6ea952700d58 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:42.148228 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-004a49bd-44e5-487a-af8b-b052cabdc915 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb" status: 200 len: 1225 microversion: 2.1 time: 0.167677 Oct 12 13:24:42.156356 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 404/773] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:41 2022] GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb => generated 1225 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:42.160212 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dc68a6be-9f8a-451e-8331-6ea952700d58 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:42.164754 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dc68a6be-9f8a-451e-8331-6ea952700d58 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:42.165782 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dc68a6be-9f8a-451e-8331-6ea952700d58 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:42.166752 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dc68a6be-9f8a-451e-8331-6ea952700d58 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:42.167458 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dc68a6be-9f8a-451e-8331-6ea952700d58 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:42.168453 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dc68a6be-9f8a-451e-8331-6ea952700d58 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:42.384828 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-96b02841-2705-4b32-999f-7103e51a7dda tempest-ListImagesTestJSON-798611039 tempest-ListImagesTestJSON-798611039-project] Calling method '.version_select at 0x7f8aa0060160>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:42.490278 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-96b02841-2705-4b32-999f-7103e51a7dda tempest-ListImagesTestJSON-798611039 tempest-ListImagesTestJSON-798611039-project] 10.222.0.52 "GET /compute/v2.1/images/92c34f67-0f72-4439-9fdb-d8567b96935c" status: 200 len: 784 microversion: 2.1 time: 0.331842 Oct 12 13:24:42.498681 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 405/774] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:42 2022] GET /compute/v2.1/images/92c34f67-0f72-4439-9fdb-d8567b96935c => generated 784 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:42.511690 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-453f3f3b-eefe-4536-9a3e-fc831cfca4ca tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9be7ce50>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:42.575794 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-453f3f3b-eefe-4536-9a3e-fc831cfca4ca tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9" status: 200 len: 1454 microversion: 2.1 time: 0.075094 Oct 12 13:24:42.577413 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 406/775] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:42 2022] GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9 => generated 1454 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:42.588867 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f41a0af2-18cb-455c-8641-ab6a85470bb4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:42.589512 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f41a0af2-18cb-455c-8641-ab6a85470bb4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 177cff06-72ce-423d-bbe7-9ebcd331d29d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:42.608583 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f41a0af2-18cb-455c-8641-ab6a85470bb4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:42.609115 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f41a0af2-18cb-455c-8641-ab6a85470bb4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:42.609555 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f41a0af2-18cb-455c-8641-ab6a85470bb4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:42.610280 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f41a0af2-18cb-455c-8641-ab6a85470bb4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:42.610738 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f41a0af2-18cb-455c-8641-ab6a85470bb4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:42.611167 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f41a0af2-18cb-455c-8641-ab6a85470bb4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:42.715472 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-dc68a6be-9f8a-451e-8331-6ea952700d58 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:42.735432 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-dc68a6be-9f8a-451e-8331-6ea952700d58 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 200 len: 1278 microversion: 2.1 time: 0.612401 Oct 12 13:24:42.736459 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 370/776] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:42 2022] GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 1278 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:42.751811 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-03dabeb8-bc99-464a-b28b-0450bf1cd4a5 req-8210520e-665a-46a8-8398-e8b39c1e9bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9e25817-4f35-4244-afa0-543c63840ad2", "tag": "bbe46d58-c87c-45e3-b076-716e17b57f55"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:42.802433 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-03dabeb8-bc99-464a-b28b-0450bf1cd4a5 req-8210520e-665a-46a8-8398-e8b39c1e9bf2 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:42.802912 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-03dabeb8-bc99-464a-b28b-0450bf1cd4a5 req-8210520e-665a-46a8-8398-e8b39c1e9bf2 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:42.803333 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-03dabeb8-bc99-464a-b28b-0450bf1cd4a5 req-8210520e-665a-46a8-8398-e8b39c1e9bf2 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:42.822418 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-03dabeb8-bc99-464a-b28b-0450bf1cd4a5 req-8210520e-665a-46a8-8398-e8b39c1e9bf2 service nova] Creating event network-changed:bbe46d58-c87c-45e3-b076-716e17b57f55 for instance d9e25817-4f35-4244-afa0-543c63840ad2 on n-h2-861076-2 Oct 12 13:24:42.834382 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-03dabeb8-bc99-464a-b28b-0450bf1cd4a5 req-8210520e-665a-46a8-8398-e8b39c1e9bf2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089662 Oct 12 13:24:42.834382 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 371/777] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:42.841890 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1c74aa21-bdf7-415a-8010-f644d9483b22 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:42.842637 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1c74aa21-bdf7-415a-8010-f644d9483b22 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fdd5df96-d739-4e05-a503-2cfcab635cc8] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:42.851326 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c74aa21-bdf7-415a-8010-f644d9483b22 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:42.851749 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c74aa21-bdf7-415a-8010-f644d9483b22 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:42.852271 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c74aa21-bdf7-415a-8010-f644d9483b22 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:42.853162 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c74aa21-bdf7-415a-8010-f644d9483b22 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:42.854812 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c74aa21-bdf7-415a-8010-f644d9483b22 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:42.855267 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c74aa21-bdf7-415a-8010-f644d9483b22 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:43.436933 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f41a0af2-18cb-455c-8641-ab6a85470bb4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:43.454300 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f41a0af2-18cb-455c-8641-ab6a85470bb4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d" status: 200 len: 1468 microversion: 2.1 time: 0.872518 Oct 12 13:24:43.454300 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 407/778] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:42 2022] GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d => generated 1468 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:43.468504 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b54501b8-23e8-4aa0-ba59-0ae831c5b21a tempest-ListImagesTestJSON-798611039 tempest-ListImagesTestJSON-798611039-project] Calling method '.version_select at 0x7f8aa017b670>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:43.523753 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-1c74aa21-bdf7-415a-8010-f644d9483b22 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:43.527606 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:43.542795 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1c74aa21-bdf7-415a-8010-f644d9483b22 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8" status: 200 len: 1318 microversion: 2.1 time: 0.709131 Oct 12 13:24:43.562583 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 372/779] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:42 2022] GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8 => generated 1318 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:43.567842 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2ba31147-3c6b-4aa5-a26a-7cb410e69b93 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:43.568718 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2ba31147-3c6b-4aa5-a26a-7cb410e69b93 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:43.586701 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2ba31147-3c6b-4aa5-a26a-7cb410e69b93 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:43.589615 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2ba31147-3c6b-4aa5-a26a-7cb410e69b93 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:43.603206 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2ba31147-3c6b-4aa5-a26a-7cb410e69b93 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:43.603206 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2ba31147-3c6b-4aa5-a26a-7cb410e69b93 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:43.603206 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2ba31147-3c6b-4aa5-a26a-7cb410e69b93 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:43.603206 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2ba31147-3c6b-4aa5-a26a-7cb410e69b93 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:43.699710 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b54501b8-23e8-4aa0-ba59-0ae831c5b21a tempest-ListImagesTestJSON-798611039 tempest-ListImagesTestJSON-798611039-project] 10.222.0.52 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.247504 Oct 12 13:24:43.700645 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 408/780] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Oct 12 13:24:43 2022] GET /compute/v2.1/images => generated 445 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:43.708759 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-62266819-0639-45cd-a99d-d11ef7012f16 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:43.708759 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-62266819-0639-45cd-a99d-d11ef7012f16 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: 981cf996-0c9a-4e4a-8ec0-53ca023742eb] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:43.718709 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-62266819-0639-45cd-a99d-d11ef7012f16 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:43.719272 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-62266819-0639-45cd-a99d-d11ef7012f16 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:43.719655 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-62266819-0639-45cd-a99d-d11ef7012f16 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:43.720400 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-62266819-0639-45cd-a99d-d11ef7012f16 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:43.720869 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-62266819-0639-45cd-a99d-d11ef7012f16 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:43.721327 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-62266819-0639-45cd-a99d-d11ef7012f16 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:43.883011 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-2ba31147-3c6b-4aa5-a26a-7cb410e69b93 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:43.894428 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-2ba31147-3c6b-4aa5-a26a-7cb410e69b93 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:43.902516 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-2ba31147-3c6b-4aa5-a26a-7cb410e69b93 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:43.916012 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2ba31147-3c6b-4aa5-a26a-7cb410e69b93 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1558 microversion: 2.91 time: 0.351845 Oct 12 13:24:43.923022 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 373/781] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:43 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1558 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:43.928035 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6d9e6c40-327c-435d-a628-bfbf97969bca tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9be70160>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:44.025548 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6d9e6c40-327c-435d-a628-bfbf97969bca tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9" status: 200 len: 1454 microversion: 2.1 time: 0.100666 Oct 12 13:24:44.033960 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 374/782] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:43 2022] GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9 => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:44.039164 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-dc9be2e2-d9a6-4cb0-99ce-130042d88191 tempest-ListImagesTestJSON-798611039 tempest-ListImagesTestJSON-798611039-project] Calling method '.version_select at 0x7f8a9bd59670>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:44.102474 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-dc9be2e2-d9a6-4cb0-99ce-130042d88191 tempest-ListImagesTestJSON-798611039 tempest-ListImagesTestJSON-798611039-project] 10.222.0.52 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.067281 Oct 12 13:24:44.103053 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 375/783] 10.222.0.52 () {58 vars in 1143 bytes} [Wed Oct 12 13:24:44 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:44.109216 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-72348a41-8900-44f4-83f6-ac8abaacb841 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:44.110227 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-72348a41-8900-44f4-83f6-ac8abaacb841 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:44.121446 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72348a41-8900-44f4-83f6-ac8abaacb841 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:44.122352 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72348a41-8900-44f4-83f6-ac8abaacb841 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:44.123010 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72348a41-8900-44f4-83f6-ac8abaacb841 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:44.123992 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72348a41-8900-44f4-83f6-ac8abaacb841 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:44.124752 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72348a41-8900-44f4-83f6-ac8abaacb841 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:44.125496 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72348a41-8900-44f4-83f6-ac8abaacb841 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:44.151824 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-62266819-0639-45cd-a99d-d11ef7012f16 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:44.165069 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-62266819-0639-45cd-a99d-d11ef7012f16 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb" status: 200 len: 1217 microversion: 2.1 time: 0.460864 Oct 12 13:24:44.166428 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 409/784] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:43 2022] GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb => generated 1217 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:44.387313 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-72348a41-8900-44f4-83f6-ac8abaacb841 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:44.397700 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-72348a41-8900-44f4-83f6-ac8abaacb841 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 200 len: 1278 microversion: 2.1 time: 0.293253 Oct 12 13:24:44.423798 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 376/785] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:44 2022] GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 1278 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:44.479932 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6ab8396d-48aa-4633-9c44-0c01b90307e6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:44.481037 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-6ab8396d-48aa-4633-9c44-0c01b90307e6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 177cff06-72ce-423d-bbe7-9ebcd331d29d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:44.495470 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6ab8396d-48aa-4633-9c44-0c01b90307e6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:44.511789 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6ab8396d-48aa-4633-9c44-0c01b90307e6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:44.512741 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6ab8396d-48aa-4633-9c44-0c01b90307e6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:44.518228 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6ab8396d-48aa-4633-9c44-0c01b90307e6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:44.519187 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6ab8396d-48aa-4633-9c44-0c01b90307e6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:44.520888 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6ab8396d-48aa-4633-9c44-0c01b90307e6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:44.574183 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f83364bd-3495-40a8-ba78-239ca9fb7586 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:44.575873 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f83364bd-3495-40a8-ba78-239ca9fb7586 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fdd5df96-d739-4e05-a503-2cfcab635cc8] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:44.603903 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f83364bd-3495-40a8-ba78-239ca9fb7586 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:44.603903 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f83364bd-3495-40a8-ba78-239ca9fb7586 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:44.603903 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f83364bd-3495-40a8-ba78-239ca9fb7586 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:44.603903 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f83364bd-3495-40a8-ba78-239ca9fb7586 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:44.604566 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f83364bd-3495-40a8-ba78-239ca9fb7586 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:44.604566 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f83364bd-3495-40a8-ba78-239ca9fb7586 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:45.146201 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f83364bd-3495-40a8-ba78-239ca9fb7586 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:45.154035 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f83364bd-3495-40a8-ba78-239ca9fb7586 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8" status: 200 len: 1318 microversion: 2.1 time: 0.586500 Oct 12 13:24:45.160181 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 377/786] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:44 2022] GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8 => generated 1318 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:45.165605 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f8b6b25c-89ab-45aa-8577-8b4d8a187f32 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:45.172768 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f8b6b25c-89ab-45aa-8577-8b4d8a187f32 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:45.188227 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f8b6b25c-89ab-45aa-8577-8b4d8a187f32 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:45.189113 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f8b6b25c-89ab-45aa-8577-8b4d8a187f32 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:45.189796 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f8b6b25c-89ab-45aa-8577-8b4d8a187f32 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:45.190767 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f8b6b25c-89ab-45aa-8577-8b4d8a187f32 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:45.195134 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f8b6b25c-89ab-45aa-8577-8b4d8a187f32 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:45.196651 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f8b6b25c-89ab-45aa-8577-8b4d8a187f32 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:45.236284 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-6ab8396d-48aa-4633-9c44-0c01b90307e6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:45.248762 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6ab8396d-48aa-4633-9c44-0c01b90307e6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d" status: 200 len: 1468 microversion: 2.1 time: 0.774967 Oct 12 13:24:45.249748 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 410/787] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:44 2022] GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d => generated 1468 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:45.262461 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8b37c7f4-132f-4177-9939-52d9d52d6530 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bf56ee0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:45.423812 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-8b37c7f4-132f-4177-9939-52d9d52d6530 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9" status: 200 len: 1454 microversion: 2.1 time: 0.172560 Oct 12 13:24:45.424825 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 411/788] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:45 2022] GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9 => generated 1454 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:45.432475 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2ccf3a7d-f885-44cd-96d5-a84b0280beb8 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:45.439307 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-2ccf3a7d-f885-44cd-96d5-a84b0280beb8 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: 981cf996-0c9a-4e4a-8ec0-53ca023742eb] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:45.455774 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2ccf3a7d-f885-44cd-96d5-a84b0280beb8 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:45.456279 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2ccf3a7d-f885-44cd-96d5-a84b0280beb8 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:45.456717 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2ccf3a7d-f885-44cd-96d5-a84b0280beb8 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:45.464114 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2ccf3a7d-f885-44cd-96d5-a84b0280beb8 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:45.464854 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2ccf3a7d-f885-44cd-96d5-a84b0280beb8 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:45.465478 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2ccf3a7d-f885-44cd-96d5-a84b0280beb8 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:45.523820 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=100 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:45.679389 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f8b6b25c-89ab-45aa-8577-8b4d8a187f32 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:45.681688 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-2ccf3a7d-f885-44cd-96d5-a84b0280beb8 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:45.692547 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f8b6b25c-89ab-45aa-8577-8b4d8a187f32 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:45.694062 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f8b6b25c-89ab-45aa-8577-8b4d8a187f32 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:45.694189 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2ccf3a7d-f885-44cd-96d5-a84b0280beb8 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb" status: 200 len: 1281 microversion: 2.1 time: 0.267986 Oct 12 13:24:45.694980 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 412/789] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:45 2022] GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb => generated 1281 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:45.710625 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f8b6b25c-89ab-45aa-8577-8b4d8a187f32 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1553 microversion: 2.91 time: 0.548808 Oct 12 13:24:45.711937 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a347ac98-7d50-493b-aa04-8eb2f6b4beaf tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:45.712568 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a347ac98-7d50-493b-aa04-8eb2f6b4beaf tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:45.721014 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 378/790] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:45 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1553 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:45.741860 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a347ac98-7d50-493b-aa04-8eb2f6b4beaf tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:45.742323 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a347ac98-7d50-493b-aa04-8eb2f6b4beaf tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:45.747370 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a347ac98-7d50-493b-aa04-8eb2f6b4beaf tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:45.763308 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a347ac98-7d50-493b-aa04-8eb2f6b4beaf tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:45.763816 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a347ac98-7d50-493b-aa04-8eb2f6b4beaf tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:45.764269 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a347ac98-7d50-493b-aa04-8eb2f6b4beaf tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:46.193328 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-392cef6d-45c0-46c4-9595-d84cb1b9b66f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:46.195236 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-392cef6d-45c0-46c4-9595-d84cb1b9b66f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fdd5df96-d739-4e05-a503-2cfcab635cc8] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:46.214521 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-392cef6d-45c0-46c4-9595-d84cb1b9b66f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:46.215293 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-392cef6d-45c0-46c4-9595-d84cb1b9b66f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:46.216027 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-392cef6d-45c0-46c4-9595-d84cb1b9b66f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:46.217548 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-392cef6d-45c0-46c4-9595-d84cb1b9b66f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:46.218731 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-392cef6d-45c0-46c4-9595-d84cb1b9b66f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:46.219367 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-392cef6d-45c0-46c4-9595-d84cb1b9b66f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:47.142815 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a347ac98-7d50-493b-aa04-8eb2f6b4beaf tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:47.153167 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a347ac98-7d50-493b-aa04-8eb2f6b4beaf tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 200 len: 1320 microversion: 2.1 time: 1.457282 Oct 12 13:24:47.167374 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 413/791] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:45 2022] GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 1320 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:47.173738 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b98f8a4c-2ae7-4437-8b87-bfa1f47e7a1e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:47.173738 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-b98f8a4c-2ae7-4437-8b87-bfa1f47e7a1e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 177cff06-72ce-423d-bbe7-9ebcd331d29d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:47.224910 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b98f8a4c-2ae7-4437-8b87-bfa1f47e7a1e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:47.228042 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b98f8a4c-2ae7-4437-8b87-bfa1f47e7a1e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:47.229460 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b98f8a4c-2ae7-4437-8b87-bfa1f47e7a1e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:47.234005 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b98f8a4c-2ae7-4437-8b87-bfa1f47e7a1e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:47.234853 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b98f8a4c-2ae7-4437-8b87-bfa1f47e7a1e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:47.235622 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b98f8a4c-2ae7-4437-8b87-bfa1f47e7a1e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:47.465163 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-392cef6d-45c0-46c4-9595-d84cb1b9b66f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:47.489924 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-392cef6d-45c0-46c4-9595-d84cb1b9b66f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8" status: 200 len: 1318 microversion: 2.1 time: 1.289288 Oct 12 13:24:47.522067 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 379/792] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:46 2022] GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8 => generated 1318 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:24:47.544253 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-221b358e-cf63-45b1-bae0-8fc0bcaac8c1 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bd05790>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:47.696309 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b98f8a4c-2ae7-4437-8b87-bfa1f47e7a1e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:47.705170 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b98f8a4c-2ae7-4437-8b87-bfa1f47e7a1e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d" status: 200 len: 1426 microversion: 2.1 time: 0.536489 Oct 12 13:24:47.706352 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 414/793] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:47 2022] GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d => generated 1426 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:47.726632 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-41a5ac35-59f1-42cd-b3da-3f86c0e5de7a tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:47.727433 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-41a5ac35-59f1-42cd-b3da-3f86c0e5de7a tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: 981cf996-0c9a-4e4a-8ec0-53ca023742eb] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:47.734302 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-41a5ac35-59f1-42cd-b3da-3f86c0e5de7a tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:47.735073 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-41a5ac35-59f1-42cd-b3da-3f86c0e5de7a tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:47.735698 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-41a5ac35-59f1-42cd-b3da-3f86c0e5de7a tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:47.736591 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-41a5ac35-59f1-42cd-b3da-3f86c0e5de7a tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:47.737231 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-41a5ac35-59f1-42cd-b3da-3f86c0e5de7a tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:47.737818 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-41a5ac35-59f1-42cd-b3da-3f86c0e5de7a tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:47.919925 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-41a5ac35-59f1-42cd-b3da-3f86c0e5de7a tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:47.935567 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-41a5ac35-59f1-42cd-b3da-3f86c0e5de7a tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb" status: 200 len: 1279 microversion: 2.1 time: 0.215786 Oct 12 13:24:47.956968 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 415/794] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:47 2022] GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb => generated 1279 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:47.966126 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-79f0306a-c9f1-4eff-a726-2272a422ed1f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:47.966126 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-79f0306a-c9f1-4eff-a726-2272a422ed1f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:47.972240 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-79f0306a-c9f1-4eff-a726-2272a422ed1f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:47.973590 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-79f0306a-c9f1-4eff-a726-2272a422ed1f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:47.974641 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-79f0306a-c9f1-4eff-a726-2272a422ed1f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:47.976016 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-79f0306a-c9f1-4eff-a726-2272a422ed1f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:47.977531 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-79f0306a-c9f1-4eff-a726-2272a422ed1f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:47.978215 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-79f0306a-c9f1-4eff-a726-2272a422ed1f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:48.401250 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-79f0306a-c9f1-4eff-a726-2272a422ed1f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:48.416253 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-79f0306a-c9f1-4eff-a726-2272a422ed1f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:48.423767 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-79f0306a-c9f1-4eff-a726-2272a422ed1f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:48.435894 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-79f0306a-c9f1-4eff-a726-2272a422ed1f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1553 microversion: 2.91 time: 0.477408 Oct 12 13:24:48.450241 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 416/795] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:47 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1553 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:48.466079 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0e8764cb-0d44-4352-a15b-8c27eccb3e13 tempest-ServersTestJSON-1777698360 tempest-ServersTestJSON-1777698360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-680302325", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "eaa92e60-04fc-484e-97ce-ee4c8cedb6a9"}], "security_groups": [{"name": "tempest-securitygroup--863394514"}], "key_name": "tempest-keypair-1125322203", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:48.517318 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=15 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:50.794741 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:51.556241 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=9 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:54.607096 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-221b358e-cf63-45b1-bae0-8fc0bcaac8c1 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9" status: 200 len: 1463 microversion: 2.1 time: 7.080387 Oct 12 13:24:54.608810 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 380/796] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:47 2022] GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9 => generated 1463 bytes in 7086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:54.614295 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-1b321ee8-b60a-473a-b8e0-6e2f9a1f1063 req-6431fee0-60ab-4d10-b124-0ca7073cf04f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "177cff06-72ce-423d-bbe7-9ebcd331d29d", "name": "network-vif-deleted", "tag": "6849491b-9544-4029-90ad-8fe791181f39"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:54.629301 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-1b321ee8-b60a-473a-b8e0-6e2f9a1f1063 req-6431fee0-60ab-4d10-b124-0ca7073cf04f service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:54.630260 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-1b321ee8-b60a-473a-b8e0-6e2f9a1f1063 req-6431fee0-60ab-4d10-b124-0ca7073cf04f service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:54.630908 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-1b321ee8-b60a-473a-b8e0-6e2f9a1f1063 req-6431fee0-60ab-4d10-b124-0ca7073cf04f service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:54.647073 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-1b321ee8-b60a-473a-b8e0-6e2f9a1f1063 req-6431fee0-60ab-4d10-b124-0ca7073cf04f service nova] Creating event network-vif-deleted:6849491b-9544-4029-90ad-8fe791181f39 for instance 177cff06-72ce-423d-bbe7-9ebcd331d29d on n-h1-861076-2 Oct 12 13:24:54.653036 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-1b321ee8-b60a-473a-b8e0-6e2f9a1f1063 req-6431fee0-60ab-4d10-b124-0ca7073cf04f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042514 Oct 12 13:24:54.654270 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 381/797] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:54.659772 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7f376d59-24c1-42e2-a975-599f22fd61ac tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:54.660892 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7f376d59-24c1-42e2-a975-599f22fd61ac tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:54.670465 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f376d59-24c1-42e2-a975-599f22fd61ac tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:54.671512 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f376d59-24c1-42e2-a975-599f22fd61ac tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:54.672185 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f376d59-24c1-42e2-a975-599f22fd61ac tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:54.673114 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f376d59-24c1-42e2-a975-599f22fd61ac tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:54.673809 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f376d59-24c1-42e2-a975-599f22fd61ac tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:54.674435 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f376d59-24c1-42e2-a975-599f22fd61ac tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:54.717105 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-0e8764cb-0d44-4352-a15b-8c27eccb3e13 tempest-ServersTestJSON-1777698360 tempest-ServersTestJSON-1777698360-project] validate_networks() for [('eaa92e60-04fc-484e-97ce-ee4c8cedb6a9', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:24:54.924630 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-7f376d59-24c1-42e2-a975-599f22fd61ac tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:54.934919 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7f376d59-24c1-42e2-a975-599f22fd61ac tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 200 len: 1320 microversion: 2.1 time: 0.279297 Oct 12 13:24:54.949423 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 382/798] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:54 2022] GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 1320 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:54.957191 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d2a235c0-df69-4f7e-8e07-a7b1b19655a6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:54.958175 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d2a235c0-df69-4f7e-8e07-a7b1b19655a6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fdd5df96-d739-4e05-a503-2cfcab635cc8] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:54.965354 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d2a235c0-df69-4f7e-8e07-a7b1b19655a6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:54.965846 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d2a235c0-df69-4f7e-8e07-a7b1b19655a6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:54.966281 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d2a235c0-df69-4f7e-8e07-a7b1b19655a6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:54.966985 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d2a235c0-df69-4f7e-8e07-a7b1b19655a6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:54.967480 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d2a235c0-df69-4f7e-8e07-a7b1b19655a6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:54.967927 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d2a235c0-df69-4f7e-8e07-a7b1b19655a6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:55.115878 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-0e8764cb-0d44-4352-a15b-8c27eccb3e13 tempest-ServersTestJSON-1777698360 tempest-ServersTestJSON-1777698360-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-182de919-ee02-4cf5-9cd9-0a613ed47822) Oct 12 13:24:55.115878 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:55.115878 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:24:55.115878 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:24:55.115878 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:24:55.115878 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:24:55.115878 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:24:55.115878 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:24:55.115878 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:24:55.115878 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:24:55.115878 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:24:55.115878 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:24:55.115878 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:24:55.115878 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:24:55.115878 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:24:55.115878 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:24:55.118802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:24:55.118802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:24:55.118802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:24:55.118802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:24:55.118802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:24:55.118802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:24:55.118802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:24:55.118802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:24:55.118802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:24:55.118802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:24:55.118802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:24:55.118802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:24:55.118802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:24:55.118802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:24:55.118802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:24:55.118802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:24:55.118802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:24:55.118802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:24:55.121786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:24:55.121786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:24:55.121786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:24:55.121786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:24:55.121786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:24:55.121786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:24:55.121786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:24:55.121786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:24:55.121786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:24:55.121786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:24:55.121786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:24:55.121786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:24:55.121786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:24:55.121786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:24:55.121786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:24:55.121786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:24:55.121786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:24:55.121786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:24:55.123164 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:24:55.123164 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:24:55.123164 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:24:55.123164 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:24:55.123164 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:24:55.123164 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:24:55.123164 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:24:55.123164 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:24:55.123164 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:24:55.123164 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:24:55.123164 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:24:55.123164 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:24:55.123164 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:24:55.123164 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:24:55.123164 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-182de919-ee02-4cf5-9cd9-0a613ed47822) Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-0e8764cb-0d44-4352-a15b-8c27eccb3e13 tempest-ServersTestJSON-1777698360 tempest-ServersTestJSON-1777698360-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0e8764cb-0d44-4352-a15b-8c27eccb3e13 tempest-ServersTestJSON-1777698360 tempest-ServersTestJSON-1777698360-project] Request method failure captured: Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 631 Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsAYrvwmIv6WI2e62toMTd3TZPVSIO3zBFBDiC4RPljGT61AJu5lOoZ_N_Gx53gwdFosNw_-qI7X2zTIC_jh-lGYJhJUISGND_ZFehDzHUA6TfiPaIHklYeAXYrBpvN-PDGo0vFQ0fjBFSYvL-Jpom6zuvwPHoNvRusBCI_TKhZ4sUA Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 4b98325c375f46cea78ea69a82378bd4 Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServersTestJSON-1777698360 Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:24:55.124267 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:24:55.126702 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4b98325c375f46cea78ea69a82378bd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4b98325c375f46cea78ea69a82378bd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4b98325c375f46cea78ea69a82378bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4b98325c375f46cea78ea69a82378bd4"}]}] Oct 12 13:24:55.126702 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServersTestJSON-1777698360 Oct 12 13:24:55.126702 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 4b98325c375f46cea78ea69a82378bd4 Oct 12 13:24:55.126702 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServersTestJSON-1777698360 Oct 12 13:24:55.126702 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServersTestJSON-1777698360-project Oct 12 13:24:55.126702 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:24:55.126702 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:24:55.126702 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: b9adc9c00131411596c43adaa83e1588 Oct 12 13:24:55.126702 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServersTestJSON-1777698360-project Oct 12 13:24:55.126702 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:24:55.127459 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-ServersTestJSON-server-680302325", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "O0^A@QpOj&Qlp@h", "networks": [{"uuid": "eaa92e60-04fc-484e-97ce-ee4c8cedb6a9"}], "security_groups": [{"name": "tempest-securitygroup--863394514"}], "key_name": "tempest-keypair-1125322203", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "AUTO"}} Oct 12 13:24:55.127459 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:24:55.127459 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:24:55.127459 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:24:55.127459 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-680302325', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'metadata': {'hello': 'world'}, 'adminPass': 'O0^A@QpOj&Qlp@h', 'networks': [{'uuid': 'eaa92e60-04fc-484e-97ce-ee4c8cedb6a9'}], 'security_groups': [{'name': 'tempest-securitygroup--863394514'}], 'key_name': 'tempest-keypair-1125322203', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 12 13:24:55.127459 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:24:55.127459 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:55.127459 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:24:55.127459 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:24:55.127459 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:24:55.127459 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:24:55.128333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:24:55.128333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:24:55.128333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:24:55.128333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:24:55.128333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:24:55.128333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:24:55.128333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:24:55.128333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:24:55.128333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:24:55.128333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:24:55.128333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:24:55.128333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:24:55.128333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:24:55.128333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:24:55.128333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:24:55.128333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:24:55.128333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:24:55.128333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:24:55.128333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:24:55.129918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:24:55.129918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:24:55.129918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:24:55.129918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:24:55.129918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:24:55.129918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:24:55.129918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:24:55.129918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:24:55.129918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:24:55.129918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:24:55.129918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:24:55.129918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:24:55.129918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:24:55.129918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:24:55.129918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:24:55.129918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:24:55.129918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:24:55.129918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:24:55.131157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:24:55.131157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:24:55.131157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:24:55.131157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:24:55.131157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:24:55.131157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:24:55.131157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:24:55.131157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:24:55.131157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:24:55.131157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:24:55.131157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:24:55.131157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:24:55.131157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:24:55.131157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:24:55.131157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:24:55.131157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:24:55.131157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:24:55.132324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:24:55.132324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:24:55.132324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:24:55.132324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:24:55.132324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:24:55.132324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:24:55.132324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:24:55.132324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-182de919-ee02-4cf5-9cd9-0a613ed47822) Oct 12 13:24:55.132324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:55.132324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:24:55.132324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:55.132324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:55.132324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:24:55.132324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:24:55.132324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:24:55.132324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:24:55.132324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:24:55.133572 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:24:55.133572 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:24:55.133572 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:55.133572 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:55.133572 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:24:55.133572 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:55.133572 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:55.133572 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:24:55.133572 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:24:55.133572 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:24:55.133572 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:24:55.133572 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:24:55.133572 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:55.133572 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:55.133572 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0e8764cb-0d44-4352-a15b-8c27eccb3e13 tempest-ServersTestJSON-1777698360 tempest-ServersTestJSON-1777698360-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:24:55.133572 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:24:55.134631 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0e8764cb-0d44-4352-a15b-8c27eccb3e13 tempest-ServersTestJSON-1777698360 tempest-ServersTestJSON-1777698360-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 6.634393 Oct 12 13:24:55.134631 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 417/799] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:24:48 2022] POST /compute/v2.1/servers => generated 214 bytes in 6636 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:24:55.134631 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8a1abc3a-363f-46c9-9dde-ade0b76b0ef6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:55.134631 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-8a1abc3a-363f-46c9-9dde-ade0b76b0ef6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 177cff06-72ce-423d-bbe7-9ebcd331d29d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:55.134631 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8a1abc3a-363f-46c9-9dde-ade0b76b0ef6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:55.135011 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8a1abc3a-363f-46c9-9dde-ade0b76b0ef6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:55.135011 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8a1abc3a-363f-46c9-9dde-ade0b76b0ef6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:55.135011 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8a1abc3a-363f-46c9-9dde-ade0b76b0ef6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:55.135011 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8a1abc3a-363f-46c9-9dde-ade0b76b0ef6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:55.135337 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8a1abc3a-363f-46c9-9dde-ade0b76b0ef6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:55.135337 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-8a1abc3a-363f-46c9-9dde-ade0b76b0ef6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] HTTP exception thrown: Instance 177cff06-72ce-423d-bbe7-9ebcd331d29d could not be found. Oct 12 13:24:55.135337 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8a1abc3a-363f-46c9-9dde-ade0b76b0ef6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Request method failure captured: Oct 12 13:24:55.135337 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d HTTP/1.1 Oct 12 13:24:55.135337 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:24:55.135337 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:24:55.135337 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:24:55.135337 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:24:55.135337 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:24:55.135337 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:24:55.135337 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:24:55.135337 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:24:55.135337 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr-Uy7R0-vO84LNBAwxPsssPvLLJJvDLLoKGFa8vBBM7F1Mf1vlFFzFToaRgPGnPKfPfeQQEWDVwjA-kXG2ItKpreMCd93oSqbLTmiWoKKoCe0M_BbZ4_liwNDN0-6wBzZaO_Moy7e6iBmO_tj-vMYydnf_VGtaHbljYhF2p-bsDVq4 Oct 12 13:24:55.135337 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:24:55.135337 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:24:55.135337 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:24:55.135337 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:24:55.135337 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:24:55.135337 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:24:55.135337 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: b92cdc745c654b538146a4a64f5f4b6f Oct 12 13:24:55.135337 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-MigrationsAdminTest-933851851 Oct 12 13:24:55.135337 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:24:55.135337 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:24:55.137327 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b92cdc745c654b538146a4a64f5f4b6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b92cdc745c654b538146a4a64f5f4b6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b92cdc745c654b538146a4a64f5f4b6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b92cdc745c654b538146a4a64f5f4b6f"}]}] Oct 12 13:24:55.137327 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-MigrationsAdminTest-933851851 Oct 12 13:24:55.137327 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: b92cdc745c654b538146a4a64f5f4b6f Oct 12 13:24:55.137327 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-MigrationsAdminTest-933851851 Oct 12 13:24:55.137327 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-MigrationsAdminTest-933851851-project Oct 12 13:24:55.137327 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:24:55.137327 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:24:55.137327 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 0df255f194e54dfb8781b982c2c60a98 Oct 12 13:24:55.137327 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-MigrationsAdminTest-933851851-project Oct 12 13:24:55.137327 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:24:55.137327 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance 177cff06-72ce-423d-bbe7-9ebcd331d29d could not be found. Oct 12 13:24:55.137327 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '177cff06-72ce-423d-bbe7-9ebcd331d29d'} Oct 12 13:24:55.138171 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:24:55.138171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:55.138171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:24:55.138171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:24:55.138171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:24:55.138171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:24:55.138171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:24:55.138171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:24:55.138171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:24:55.138171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:24:55.138171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 177cff06-72ce-423d-bbe7-9ebcd331d29d could not be found. Oct 12 13:24:55.138171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:55.138171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:24:55.138171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:55.138171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:55.138171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:24:55.138171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:24:55.138171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:24:55.138171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:24:55.138171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:24:55.139570 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:24:55.139570 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:24:55.139570 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:24:55.139570 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:24:55.139570 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:24:55.139570 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:24:55.139570 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:24:55.139570 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 177cff06-72ce-423d-bbe7-9ebcd331d29d could not be found. Oct 12 13:24:55.139570 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:55.139570 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:24:55.139570 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:55.139570 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:24:55.139570 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:24:55.139570 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:24:55.139570 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:24:55.139570 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:24:55.139570 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 177cff06-72ce-423d-bbe7-9ebcd331d29d could not be found. Oct 12 13:24:55.139570 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:24:55.140779 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8a1abc3a-363f-46c9-9dde-ade0b76b0ef6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Returning 404 to user: Instance 177cff06-72ce-423d-bbe7-9ebcd331d29d could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:24:55.140779 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-8a1abc3a-363f-46c9-9dde-ade0b76b0ef6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d" status: 404 len: 111 microversion: 2.1 time: 0.037400 Oct 12 13:24:55.140779 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 418/800] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:55 2022] GET /compute/v2.1/servers/177cff06-72ce-423d-bbe7-9ebcd331d29d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:24:55.140779 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9c1368e5-721d-4b0d-a578-d601dcb03c15 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:55.140779 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-9c1368e5-721d-4b0d-a578-d601dcb03c15 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: 981cf996-0c9a-4e4a-8ec0-53ca023742eb] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:55.141182 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d2a235c0-df69-4f7e-8e07-a7b1b19655a6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:55.141294 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9c1368e5-721d-4b0d-a578-d601dcb03c15 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:55.141294 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9c1368e5-721d-4b0d-a578-d601dcb03c15 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:55.141294 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9c1368e5-721d-4b0d-a578-d601dcb03c15 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:55.141294 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9c1368e5-721d-4b0d-a578-d601dcb03c15 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:55.141622 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9c1368e5-721d-4b0d-a578-d601dcb03c15 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:55.141622 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9c1368e5-721d-4b0d-a578-d601dcb03c15 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:55.146463 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d2a235c0-df69-4f7e-8e07-a7b1b19655a6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8" status: 200 len: 1318 microversion: 2.1 time: 0.195833 Oct 12 13:24:55.147127 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 383/801] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:54 2022] GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:55.282987 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0ea8c1fa-44a6-4818-83d6-4b069c9489bb tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Action: 'create', calling method: .version_select at 0x7f8aa01f4940>, body: {"keypair": {"name": "tempest-keypair-1893711894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBd/uXkIJzE5Gv4RthJkgjU7fqEL1Rw6h9pHka40LV5j0xQ1CjZEgoJ4+/ZAXKTG+uv8eCLmxdRAwSu1SZKo1Nj1s7kZPdu1X8H0KiLVfc2jFdVon48ENjUcGwgHwbF5fw=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:55.294230 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9c1368e5-721d-4b0d-a578-d601dcb03c15 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:55.302129 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9c1368e5-721d-4b0d-a578-d601dcb03c15 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb" status: 200 len: 1321 microversion: 2.1 time: 0.175511 Oct 12 13:24:55.302695 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 419/802] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:55 2022] GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:55.306220 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-0ea8c1fa-44a6-4818-83d6-4b069c9489bb tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Getting quotas for project 21701cafbb134af6946aa5eade164aa7. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:24:55.308166 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-88867ac9-a096-4c81-9daf-b209cca237f0 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:55.308675 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-88867ac9-a096-4c81-9daf-b209cca237f0 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:55.312732 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-0ea8c1fa-44a6-4818-83d6-4b069c9489bb tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Getting quotas for user 22f672ea5f9b4b3f9fc87cb44452bae3 and project 21701cafbb134af6946aa5eade164aa7. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:24:55.314587 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-88867ac9-a096-4c81-9daf-b209cca237f0 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:55.315062 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-88867ac9-a096-4c81-9daf-b209cca237f0 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:55.315696 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-88867ac9-a096-4c81-9daf-b209cca237f0 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:55.316385 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-88867ac9-a096-4c81-9daf-b209cca237f0 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:55.316838 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-88867ac9-a096-4c81-9daf-b209cca237f0 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:55.317284 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-88867ac9-a096-4c81-9daf-b209cca237f0 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:55.380562 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-88867ac9-a096-4c81-9daf-b209cca237f0 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:55.388486 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-88867ac9-a096-4c81-9daf-b209cca237f0 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:55.390048 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-88867ac9-a096-4c81-9daf-b209cca237f0 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:55.394783 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-88867ac9-a096-4c81-9daf-b209cca237f0 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1553 microversion: 2.91 time: 0.091001 Oct 12 13:24:55.395347 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 420/803] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:55 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1553 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:55.399743 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6c4c709f-92b0-4d3d-b3eb-3bf9bd084cec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa002aca0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:55.442723 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6c4c709f-92b0-4d3d-b3eb-3bf9bd084cec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9" status: 200 len: 1463 microversion: 2.1 time: 0.046376 Oct 12 13:24:55.443287 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 421/804] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:24:55 2022] GET /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9 => generated 1463 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:55.447655 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-de974bb9-b4d7-4379-bfb3-2d6efe89437e req-ae57f55a-08ea-44a5-8184-a38ca1a2094f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e25817-4f35-4244-afa0-543c63840ad2", "name": "network-vif-plugged", "status": "completed", "tag": "bbe46d58-c87c-45e3-b076-716e17b57f55"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:55.457367 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-de974bb9-b4d7-4379-bfb3-2d6efe89437e req-ae57f55a-08ea-44a5-8184-a38ca1a2094f service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:55.457847 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-de974bb9-b4d7-4379-bfb3-2d6efe89437e req-ae57f55a-08ea-44a5-8184-a38ca1a2094f service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:55.458412 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-de974bb9-b4d7-4379-bfb3-2d6efe89437e req-ae57f55a-08ea-44a5-8184-a38ca1a2094f service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:55.469791 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-de974bb9-b4d7-4379-bfb3-2d6efe89437e req-ae57f55a-08ea-44a5-8184-a38ca1a2094f service nova] Creating event network-vif-plugged:bbe46d58-c87c-45e3-b076-716e17b57f55 for instance d9e25817-4f35-4244-afa0-543c63840ad2 on n-h2-861076-2 Oct 12 13:24:55.474805 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-de974bb9-b4d7-4379-bfb3-2d6efe89437e req-ae57f55a-08ea-44a5-8184-a38ca1a2094f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030427 Oct 12 13:24:55.487020 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 422/805] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:55.487020 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-20e0c801-1bb6-4262-96c6-e8bff45292fd tempest-ServersTestJSON-1777698360 tempest-ServersTestJSON-1777698360-project] Calling method '.version_select at 0x7f8aa04e7af0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:55.530571 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0ea8c1fa-44a6-4818-83d6-4b069c9489bb tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.382095 Oct 12 13:24:55.531767 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 384/806] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:24:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:55.536793 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-75872daf-7c2b-444a-a05c-a307c6154cce tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:55.537498 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-75872daf-7c2b-444a-a05c-a307c6154cce tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:55.546907 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-75872daf-7c2b-444a-a05c-a307c6154cce tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:55.547459 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-75872daf-7c2b-444a-a05c-a307c6154cce tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:55.548091 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-75872daf-7c2b-444a-a05c-a307c6154cce tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:55.548802 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-75872daf-7c2b-444a-a05c-a307c6154cce tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:55.549282 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-75872daf-7c2b-444a-a05c-a307c6154cce tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:55.549907 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-75872daf-7c2b-444a-a05c-a307c6154cce tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:55.579222 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-75872daf-7c2b-444a-a05c-a307c6154cce tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:24:55.618117 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-20e0c801-1bb6-4262-96c6-e8bff45292fd tempest-ServersTestJSON-1777698360 tempest-ServersTestJSON-1777698360-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1125322203" status: 202 len: 0 microversion: 2.1 time: 0.141495 Oct 12 13:24:55.629513 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 423/807] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 12 13:24:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1125322203 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:24:55.637912 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1e85d10d-4e62-43da-b461-a8989eea7698 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:55.638730 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-1e85d10d-4e62-43da-b461-a8989eea7698 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 14676667-3743-4d37-8ff9-f8d161a483d4] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:55.657845 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1e85d10d-4e62-43da-b461-a8989eea7698 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:55.661337 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1e85d10d-4e62-43da-b461-a8989eea7698 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:55.662215 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1e85d10d-4e62-43da-b461-a8989eea7698 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:55.664651 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1e85d10d-4e62-43da-b461-a8989eea7698 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:55.666214 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1e85d10d-4e62-43da-b461-a8989eea7698 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:55.667339 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1e85d10d-4e62-43da-b461-a8989eea7698 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:55.852186 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-1e85d10d-4e62-43da-b461-a8989eea7698 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:55.861277 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1e85d10d-4e62-43da-b461-a8989eea7698 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4" status: 200 len: 1479 microversion: 2.1 time: 0.230614 Oct 12 13:24:55.881926 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 424/808] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:55 2022] GET /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4 => generated 1479 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:55.881926 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-95c412bb-49db-4263-967a-40158f82d52f tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Calling method '.version_select at 0x7f8a9be7c940>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:55.883008 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-95c412bb-49db-4263-967a-40158f82d52f tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-1893711894" status: 200 len: 498 microversion: 2.1 time: 0.019813 Oct 12 13:24:55.883613 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 425/809] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Oct 12 13:24:55 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1893711894 => generated 498 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:55.896880 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-57d1ee47-8148-4b6b-a98d-1616c805f7ca tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Calling method '.version_select at 0x7f8aa002a310>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:55.967038 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-75872daf-7c2b-444a-a05c-a307c6154cce tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "DELETE /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f" status: 204 len: 0 microversion: 2.1 time: 0.433084 Oct 12 13:24:55.977239 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 385/810] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:24:55 2022] DELETE /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:24:55.986308 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d6d2eae4-8597-43f3-848c-eb23bc0c1fab tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:55.988242 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d6d2eae4-8597-43f3-848c-eb23bc0c1fab tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:56.001352 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-57d1ee47-8148-4b6b-a98d-1616c805f7ca tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1893711894" status: 202 len: 0 microversion: 2.1 time: 0.109568 Oct 12 13:24:56.002417 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 426/811] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 12 13:24:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1893711894 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 13:24:56.003714 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6d2eae4-8597-43f3-848c-eb23bc0c1fab tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:56.004414 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6d2eae4-8597-43f3-848c-eb23bc0c1fab tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:56.007281 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6d2eae4-8597-43f3-848c-eb23bc0c1fab tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:56.013922 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6d2eae4-8597-43f3-848c-eb23bc0c1fab tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:56.013922 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6d2eae4-8597-43f3-848c-eb23bc0c1fab tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:56.013922 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6d2eae4-8597-43f3-848c-eb23bc0c1fab tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:56.014499 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b537832e-0d12-480e-b341-d09b8c86997e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:56.014499 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-b537832e-0d12-480e-b341-d09b8c86997e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:56.032441 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b537832e-0d12-480e-b341-d09b8c86997e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:56.032971 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b537832e-0d12-480e-b341-d09b8c86997e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:56.040410 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b537832e-0d12-480e-b341-d09b8c86997e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:56.041751 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b537832e-0d12-480e-b341-d09b8c86997e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:56.042412 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b537832e-0d12-480e-b341-d09b8c86997e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:56.043049 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b537832e-0d12-480e-b341-d09b8c86997e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:56.389439 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b537832e-0d12-480e-b341-d09b8c86997e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:56.405888 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b537832e-0d12-480e-b341-d09b8c86997e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f" status: 200 len: 1469 microversion: 2.1 time: 0.400789 Oct 12 13:24:56.406759 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 427/812] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:56 2022] GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f => generated 1469 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:56.411891 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0dc5c045-ee69-4865-b5d2-86ec3c578e2f tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Action: 'create', calling method: .version_select at 0x7f8aa0045e50>, body: {"keypair": {"name": "tempest-keypair-997286858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWQ0Pb771uKxH+dx9jdFVdj5fLUQ65r9twIjAdFrOgO3O4dbM4Hjb5X4LlNTEFH/GIqrsJTQtXXPpdn60cQ875pSZda0AYxXutL69xrtlfpa6tHpGx3poM23aWXLyyw5g=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:56.439178 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:56.447856 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d6d2eae4-8597-43f3-848c-eb23bc0c1fab tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:56.457779 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d6d2eae4-8597-43f3-848c-eb23bc0c1fab tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 200 len: 1320 microversion: 2.1 time: 0.485149 Oct 12 13:24:56.459634 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-0dc5c045-ee69-4865-b5d2-86ec3c578e2f tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Getting quotas for project 21701cafbb134af6946aa5eade164aa7. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:24:56.462069 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 386/813] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:55 2022] GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 1320 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:56.467853 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-0dc5c045-ee69-4865-b5d2-86ec3c578e2f tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Getting quotas for user 22f672ea5f9b4b3f9fc87cb44452bae3 and project 21701cafbb134af6946aa5eade164aa7. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:24:56.470612 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bd873d9c-987e-46ed-8bb5-f1bc4fdac946 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:56.471396 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-bd873d9c-987e-46ed-8bb5-f1bc4fdac946 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fdd5df96-d739-4e05-a503-2cfcab635cc8] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:56.490735 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bd873d9c-987e-46ed-8bb5-f1bc4fdac946 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:56.493758 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bd873d9c-987e-46ed-8bb5-f1bc4fdac946 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:56.496422 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bd873d9c-987e-46ed-8bb5-f1bc4fdac946 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:56.497410 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bd873d9c-987e-46ed-8bb5-f1bc4fdac946 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:56.499175 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bd873d9c-987e-46ed-8bb5-f1bc4fdac946 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:56.499794 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bd873d9c-987e-46ed-8bb5-f1bc4fdac946 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:56.606397 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0dc5c045-ee69-4865-b5d2-86ec3c578e2f tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.198399 Oct 12 13:24:56.607019 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 428/814] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:24:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:56.611763 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-521bcc1a-c373-4c7a-a162-faad9b8a2007 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:56.615697 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-521bcc1a-c373-4c7a-a162-faad9b8a2007 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: 981cf996-0c9a-4e4a-8ec0-53ca023742eb] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:56.627380 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-521bcc1a-c373-4c7a-a162-faad9b8a2007 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:56.630317 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-521bcc1a-c373-4c7a-a162-faad9b8a2007 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:56.630966 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-521bcc1a-c373-4c7a-a162-faad9b8a2007 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:56.631850 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-521bcc1a-c373-4c7a-a162-faad9b8a2007 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:56.636335 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-521bcc1a-c373-4c7a-a162-faad9b8a2007 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:56.637057 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-521bcc1a-c373-4c7a-a162-faad9b8a2007 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:56.865605 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-bd873d9c-987e-46ed-8bb5-f1bc4fdac946 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:56.877598 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bd873d9c-987e-46ed-8bb5-f1bc4fdac946 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8" status: 200 len: 1318 microversion: 2.1 time: 0.414286 Oct 12 13:24:56.880395 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 387/815] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:56 2022] GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8 => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:56.892628 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-94b05e9b-ac14-4cba-b89f-32eb77bc4e5d tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:56.893487 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-94b05e9b-ac14-4cba-b89f-32eb77bc4e5d tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:56.901820 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-94b05e9b-ac14-4cba-b89f-32eb77bc4e5d tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:56.902546 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-94b05e9b-ac14-4cba-b89f-32eb77bc4e5d tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:56.903155 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-94b05e9b-ac14-4cba-b89f-32eb77bc4e5d tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:56.904017 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-94b05e9b-ac14-4cba-b89f-32eb77bc4e5d tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:56.905459 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-94b05e9b-ac14-4cba-b89f-32eb77bc4e5d tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:56.906945 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-94b05e9b-ac14-4cba-b89f-32eb77bc4e5d tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:56.981411 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-521bcc1a-c373-4c7a-a162-faad9b8a2007 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:56.998707 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-521bcc1a-c373-4c7a-a162-faad9b8a2007 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb" status: 200 len: 1321 microversion: 2.1 time: 0.390512 Oct 12 13:24:57.013146 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 429/816] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:56 2022] GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb => generated 1321 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:57.024030 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fb4b82fb-0e52-4986-98f2-f1dfa3c00118 tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Calling method '.version_select at 0x7f8aa002a670>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:57.047790 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-94b05e9b-ac14-4cba-b89f-32eb77bc4e5d tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:57.058943 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-94b05e9b-ac14-4cba-b89f-32eb77bc4e5d tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:57.060727 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-94b05e9b-ac14-4cba-b89f-32eb77bc4e5d tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:57.070019 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-94b05e9b-ac14-4cba-b89f-32eb77bc4e5d tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1553 microversion: 2.91 time: 0.188228 Oct 12 13:24:57.071826 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 388/817] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:24:56 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:24:57.082818 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-5ed7cf17-41d8-4043-a9d4-af6f424fe49f req-98890bae-fe6a-4fa5-90fb-a54a9ffb258d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdd5df96-d739-4e05-a503-2cfcab635cc8", "tag": "2bb7ff4c-4357-40c1-b7ad-e5260fdb5014"}, {"name": "network-changed", "server_uuid": "d144e260-baa1-4006-9e14-31be90b931ed", "tag": "3cf7861f-e727-4460-a639-40684297cc11"}, {"name": "network-changed", "server_uuid": "981cf996-0c9a-4e4a-8ec0-53ca023742eb", "tag": "bbd1fd9d-4fd1-45fc-969b-d8977c2bdd5a"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:57.099657 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-5ed7cf17-41d8-4043-a9d4-af6f424fe49f req-98890bae-fe6a-4fa5-90fb-a54a9ffb258d service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:57.100487 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-5ed7cf17-41d8-4043-a9d4-af6f424fe49f req-98890bae-fe6a-4fa5-90fb-a54a9ffb258d service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:57.101113 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-5ed7cf17-41d8-4043-a9d4-af6f424fe49f req-98890bae-fe6a-4fa5-90fb-a54a9ffb258d service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:57.120283 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-5ed7cf17-41d8-4043-a9d4-af6f424fe49f req-98890bae-fe6a-4fa5-90fb-a54a9ffb258d service nova] Creating event network-changed:2bb7ff4c-4357-40c1-b7ad-e5260fdb5014 for instance fdd5df96-d739-4e05-a503-2cfcab635cc8 on n-h1-861076-2 Oct 12 13:24:57.121413 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-5ed7cf17-41d8-4043-a9d4-af6f424fe49f req-98890bae-fe6a-4fa5-90fb-a54a9ffb258d service nova] Creating event network-changed:3cf7861f-e727-4460-a639-40684297cc11 for instance d144e260-baa1-4006-9e14-31be90b931ed on n-h2-861076-2 Oct 12 13:24:57.122147 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-5ed7cf17-41d8-4043-a9d4-af6f424fe49f req-98890bae-fe6a-4fa5-90fb-a54a9ffb258d service nova] Creating event network-changed:bbd1fd9d-4fd1-45fc-969b-d8977c2bdd5a for instance 981cf996-0c9a-4e4a-8ec0-53ca023742eb on n-h1-861076-2 Oct 12 13:24:57.155574 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-5ed7cf17-41d8-4043-a9d4-af6f424fe49f req-98890bae-fe6a-4fa5-90fb-a54a9ffb258d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.080116 Oct 12 13:24:57.156525 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 389/818] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:57.162070 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cced3e1f-661d-44c2-b120-ace24721b1f5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:57.162796 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cced3e1f-661d-44c2-b120-ace24721b1f5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 14676667-3743-4d37-8ff9-f8d161a483d4] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:57.176391 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cced3e1f-661d-44c2-b120-ace24721b1f5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:57.176924 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cced3e1f-661d-44c2-b120-ace24721b1f5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:57.177400 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cced3e1f-661d-44c2-b120-ace24721b1f5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:57.178145 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cced3e1f-661d-44c2-b120-ace24721b1f5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:57.178616 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cced3e1f-661d-44c2-b120-ace24721b1f5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:57.189292 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cced3e1f-661d-44c2-b120-ace24721b1f5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:57.212070 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fb4b82fb-0e52-4986-98f2-f1dfa3c00118 tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-997286858" status: 202 len: 0 microversion: 2.1 time: 0.197036 Oct 12 13:24:57.213004 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 430/819] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Oct 12 13:24:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-997286858 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:24:57.221829 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b755c2f3-5645-43cf-adee-ebd9d1069eea tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Action: 'create', calling method: .version_select at 0x7f8aa0045280>, body: {"keypair": {"name": "tempest-keypair-1417439275", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:57.260574 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-b755c2f3-5645-43cf-adee-ebd9d1069eea tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Getting quotas for project 21701cafbb134af6946aa5eade164aa7. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:24:57.281752 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-b755c2f3-5645-43cf-adee-ebd9d1069eea tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Getting quotas for user 22f672ea5f9b4b3f9fc87cb44452bae3 and project 21701cafbb134af6946aa5eade164aa7. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:24:57.556707 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b755c2f3-5645-43cf-adee-ebd9d1069eea tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.338657 Oct 12 13:24:57.558540 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 431/820] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:24:57 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:24:57.568420 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9d7f7bd7-a7b8-4f15-8d4e-1d19b29ffac6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:57.569330 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-9d7f7bd7-a7b8-4f15-8d4e-1d19b29ffac6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:57.585769 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9d7f7bd7-a7b8-4f15-8d4e-1d19b29ffac6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:57.587711 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9d7f7bd7-a7b8-4f15-8d4e-1d19b29ffac6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:57.589573 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9d7f7bd7-a7b8-4f15-8d4e-1d19b29ffac6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:57.590491 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9d7f7bd7-a7b8-4f15-8d4e-1d19b29ffac6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:57.591106 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9d7f7bd7-a7b8-4f15-8d4e-1d19b29ffac6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:57.594097 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9d7f7bd7-a7b8-4f15-8d4e-1d19b29ffac6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:58.009588 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-cced3e1f-661d-44c2-b120-ace24721b1f5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:58.038203 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cced3e1f-661d-44c2-b120-ace24721b1f5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4" status: 200 len: 1466 microversion: 2.1 time: 0.880292 Oct 12 13:24:58.039342 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 390/821] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:57 2022] GET /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4 => generated 1466 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:58.054572 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cc6b1555-02dc-4524-8629-469c6bcfd912 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:58.060693 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cc6b1555-02dc-4524-8629-469c6bcfd912 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:58.065525 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc6b1555-02dc-4524-8629-469c6bcfd912 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:58.078140 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc6b1555-02dc-4524-8629-469c6bcfd912 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:58.078893 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc6b1555-02dc-4524-8629-469c6bcfd912 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:58.079957 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc6b1555-02dc-4524-8629-469c6bcfd912 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:58.080579 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc6b1555-02dc-4524-8629-469c6bcfd912 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:58.081217 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc6b1555-02dc-4524-8629-469c6bcfd912 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:58.525021 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-cc6b1555-02dc-4524-8629-469c6bcfd912 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:58.537453 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cc6b1555-02dc-4524-8629-469c6bcfd912 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 200 len: 1320 microversion: 2.1 time: 0.496838 Oct 12 13:24:58.538650 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 391/822] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:58 2022] GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 1320 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:58.543708 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-f4585b2a-7325-4a8b-ac52-801cde9bc6ca req-00ae5a3f-277c-4622-b118-3d6036e75aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd5df96-d739-4e05-a503-2cfcab635cc8", "name": "network-vif-plugged", "status": "completed", "tag": "2bb7ff4c-4357-40c1-b7ad-e5260fdb5014"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:58.557564 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-f4585b2a-7325-4a8b-ac52-801cde9bc6ca req-00ae5a3f-277c-4622-b118-3d6036e75aea service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:58.558937 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-f4585b2a-7325-4a8b-ac52-801cde9bc6ca req-00ae5a3f-277c-4622-b118-3d6036e75aea service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:58.559612 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-f4585b2a-7325-4a8b-ac52-801cde9bc6ca req-00ae5a3f-277c-4622-b118-3d6036e75aea service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:58.572861 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-f4585b2a-7325-4a8b-ac52-801cde9bc6ca req-00ae5a3f-277c-4622-b118-3d6036e75aea service nova] Creating event network-vif-plugged:2bb7ff4c-4357-40c1-b7ad-e5260fdb5014 for instance fdd5df96-d739-4e05-a503-2cfcab635cc8 on n-h1-861076-2 Oct 12 13:24:58.576262 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9d7f7bd7-a7b8-4f15-8d4e-1d19b29ffac6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:58.583009 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-f4585b2a-7325-4a8b-ac52-801cde9bc6ca req-00ae5a3f-277c-4622-b118-3d6036e75aea service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042695 Oct 12 13:24:58.586276 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 392/823] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:24:58.588432 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9d7f7bd7-a7b8-4f15-8d4e-1d19b29ffac6 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f" status: 200 len: 1469 microversion: 2.1 time: 1.028631 Oct 12 13:24:58.601687 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 432/824] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:57 2022] GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f => generated 1469 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:58.601875 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-49ded9bc-7fed-45e0-a975-a67b0cbf8b3e tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Calling method '.version_select at 0x7f8aa02fbdc0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:58.614865 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4758a0eb-b63b-4209-9828-a9cc8a7493a4 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:58.615488 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-4758a0eb-b63b-4209-9828-a9cc8a7493a4 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fdd5df96-d739-4e05-a503-2cfcab635cc8] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:58.628481 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4758a0eb-b63b-4209-9828-a9cc8a7493a4 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:58.631353 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4758a0eb-b63b-4209-9828-a9cc8a7493a4 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:58.631353 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4758a0eb-b63b-4209-9828-a9cc8a7493a4 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:58.631353 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4758a0eb-b63b-4209-9828-a9cc8a7493a4 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:58.631353 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4758a0eb-b63b-4209-9828-a9cc8a7493a4 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:58.631981 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4758a0eb-b63b-4209-9828-a9cc8a7493a4 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:58.744460 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-49ded9bc-7fed-45e0-a975-a67b0cbf8b3e tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417439275" status: 202 len: 0 microversion: 2.1 time: 0.154609 Oct 12 13:24:58.745088 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 393/825] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 12 13:24:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417439275 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:24:58.763168 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ef21a2c1-db19-4aef-8cb1-cbeb53ffb366 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:24:58.763921 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ef21a2c1-db19-4aef-8cb1-cbeb53ffb366 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: 981cf996-0c9a-4e4a-8ec0-53ca023742eb] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:58.765969 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:58.789463 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ef21a2c1-db19-4aef-8cb1-cbeb53ffb366 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:58.789463 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ef21a2c1-db19-4aef-8cb1-cbeb53ffb366 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:58.789925 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ef21a2c1-db19-4aef-8cb1-cbeb53ffb366 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:58.790623 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ef21a2c1-db19-4aef-8cb1-cbeb53ffb366 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:58.791080 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ef21a2c1-db19-4aef-8cb1-cbeb53ffb366 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:58.791506 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ef21a2c1-db19-4aef-8cb1-cbeb53ffb366 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:59.702189 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-ef21a2c1-db19-4aef-8cb1-cbeb53ffb366 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:24:59.710102 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:24:59.723060 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ef21a2c1-db19-4aef-8cb1-cbeb53ffb366 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb" status: 200 len: 1321 microversion: 2.1 time: 0.963920 Oct 12 13:24:59.725773 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 394/826] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:58 2022] GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb => generated 1321 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:24:59.741476 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-360f4156-ab84-47b1-910e-9473b42a4995 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-525838588"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:24:59.745511 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-360f4156-ab84-47b1-910e-9473b42a4995 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:24:59.769700 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-360f4156-ab84-47b1-910e-9473b42a4995 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:59.770233 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-360f4156-ab84-47b1-910e-9473b42a4995 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:59.776323 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-360f4156-ab84-47b1-910e-9473b42a4995 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:24:59.776323 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-360f4156-ab84-47b1-910e-9473b42a4995 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:24:59.776853 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-360f4156-ab84-47b1-910e-9473b42a4995 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:24:59.777976 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-360f4156-ab84-47b1-910e-9473b42a4995 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:00.057950 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-4758a0eb-b63b-4209-9828-a9cc8a7493a4 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:00.076353 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4758a0eb-b63b-4209-9828-a9cc8a7493a4 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8" status: 200 len: 1318 microversion: 2.1 time: 1.485891 Oct 12 13:25:00.082830 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 433/827] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:24:58 2022] GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8 => generated 1318 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:00.088151 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-da45e0e9-1123-4c52-ba71-fc8aa511d83a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:00.095693 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-da45e0e9-1123-4c52-ba71-fc8aa511d83a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:00.111860 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da45e0e9-1123-4c52-ba71-fc8aa511d83a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:00.115513 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da45e0e9-1123-4c52-ba71-fc8aa511d83a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:00.116252 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da45e0e9-1123-4c52-ba71-fc8aa511d83a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:00.118753 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da45e0e9-1123-4c52-ba71-fc8aa511d83a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:00.119619 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da45e0e9-1123-4c52-ba71-fc8aa511d83a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:00.122423 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da45e0e9-1123-4c52-ba71-fc8aa511d83a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:00.320626 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-da45e0e9-1123-4c52-ba71-fc8aa511d83a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:00.337784 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-da45e0e9-1123-4c52-ba71-fc8aa511d83a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:00.344594 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-da45e0e9-1123-4c52-ba71-fc8aa511d83a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:00.357669 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-da45e0e9-1123-4c52-ba71-fc8aa511d83a tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1553 microversion: 2.91 time: 0.273186 Oct 12 13:25:00.361534 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 434/828] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:25:00 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1553 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:25:00.377599 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5e4785df-cfec-4e18-8e1d-cfe258a3f40a tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Action: 'create', calling method: .version_select at 0x7f8a9bf561f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2055142094", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyK3R6G5SB0H6F45v/kVjkVR5qJDcHFqQ2wXWyqDex/a50txEdUqj5rgqvqbtkg1Wq122q4ugnrMEZigMtrrgo0C9v9Xr1Fl1vemkRnBeJunWN7va5/MCacsrpX36el+Q=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:00.397839 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-5e4785df-cfec-4e18-8e1d-cfe258a3f40a tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Getting quotas for project 21701cafbb134af6946aa5eade164aa7. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:25:00.410721 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-5e4785df-cfec-4e18-8e1d-cfe258a3f40a tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Getting quotas for user 22f672ea5f9b4b3f9fc87cb44452bae3 and project 21701cafbb134af6946aa5eade164aa7. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:25:00.554768 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-360f4156-ab84-47b1-910e-9473b42a4995 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "POST /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d/action" status: 202 len: 0 microversion: 2.1 time: 0.824646 Oct 12 13:25:00.562844 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5e4785df-cfec-4e18-8e1d-cfe258a3f40a tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.197920 Oct 12 13:25:00.563577 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 435/829] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:25:00 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:00.569029 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-93d8d23a-451c-448e-a329-4720e8d85967 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:00.569736 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 395/830] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:24:59 2022] POST /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d/action => generated 0 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 13:25:00.570777 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-93d8d23a-451c-448e-a329-4720e8d85967 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:00.580285 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5b44f33a-8e37-4f79-b0f5-1b513ebbea5f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:00.586164 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5b44f33a-8e37-4f79-b0f5-1b513ebbea5f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:00.592494 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-93d8d23a-451c-448e-a329-4720e8d85967 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:00.593920 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-93d8d23a-451c-448e-a329-4720e8d85967 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:00.598746 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-93d8d23a-451c-448e-a329-4720e8d85967 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:00.599559 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-93d8d23a-451c-448e-a329-4720e8d85967 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:00.600042 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-93d8d23a-451c-448e-a329-4720e8d85967 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:00.602064 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5b44f33a-8e37-4f79-b0f5-1b513ebbea5f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:00.604960 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5b44f33a-8e37-4f79-b0f5-1b513ebbea5f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:00.605681 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5b44f33a-8e37-4f79-b0f5-1b513ebbea5f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:00.605794 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-93d8d23a-451c-448e-a329-4720e8d85967 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:00.606766 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5b44f33a-8e37-4f79-b0f5-1b513ebbea5f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:00.607463 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5b44f33a-8e37-4f79-b0f5-1b513ebbea5f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:00.608116 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5b44f33a-8e37-4f79-b0f5-1b513ebbea5f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:00.941670 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-5b44f33a-8e37-4f79-b0f5-1b513ebbea5f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:01.017936 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5b44f33a-8e37-4f79-b0f5-1b513ebbea5f tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f" status: 200 len: 1427 microversion: 2.1 time: 0.445284 Oct 12 13:25:01.030247 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 396/831] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:00 2022] GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f => generated 1427 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:01.085795 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-60e8573d-e2a6-48e1-ad55-d90289834b75 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9be70280>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:01.203180 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-60e8573d-e2a6-48e1-ad55-d90289834b75 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.119939 Oct 12 13:25:01.203180 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 397/832] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:01 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:01.203180 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3c3710f3-28fc-478d-82a4-c671ec9b5129 tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Action: 'create', calling method: .version_select at 0x7f8aa040f160>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1880623066", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOyo99LVdqZKIuTQK20uENAb9xOfcvaQcJeMzyrMJ9ETjfvzy/WQc/OTtB28dQLTSR13JbV0nd998aFdaux79+cyieRZ9dkSTa/zZ4a/ZCIl1Og1VbtGHhjrQUlR4Y8tw=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:01.203180 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-3c3710f3-28fc-478d-82a4-c671ec9b5129 tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Getting quotas for project 21701cafbb134af6946aa5eade164aa7. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:25:01.219251 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-3c3710f3-28fc-478d-82a4-c671ec9b5129 tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Getting quotas for user 22f672ea5f9b4b3f9fc87cb44452bae3 and project 21701cafbb134af6946aa5eade164aa7. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:25:01.314089 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-93d8d23a-451c-448e-a329-4720e8d85967 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:01.324557 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-93d8d23a-451c-448e-a329-4720e8d85967 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 200 len: 1320 microversion: 2.1 time: 0.759664 Oct 12 13:25:01.325306 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 436/833] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:00 2022] GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 1320 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:01.331406 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3e5ce91a-9148-4ea6-ac6d-98e4c7d7035e tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:01.332997 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-3e5ce91a-9148-4ea6-ac6d-98e4c7d7035e tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: 981cf996-0c9a-4e4a-8ec0-53ca023742eb] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:01.343090 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e5ce91a-9148-4ea6-ac6d-98e4c7d7035e tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:01.343665 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e5ce91a-9148-4ea6-ac6d-98e4c7d7035e tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:01.344859 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e5ce91a-9148-4ea6-ac6d-98e4c7d7035e tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:01.345935 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e5ce91a-9148-4ea6-ac6d-98e4c7d7035e tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:01.346703 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e5ce91a-9148-4ea6-ac6d-98e4c7d7035e tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:01.347340 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e5ce91a-9148-4ea6-ac6d-98e4c7d7035e tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:01.556653 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-3e5ce91a-9148-4ea6-ac6d-98e4c7d7035e tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:01.565650 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3e5ce91a-9148-4ea6-ac6d-98e4c7d7035e tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb" status: 200 len: 1321 microversion: 2.1 time: 0.238413 Oct 12 13:25:01.566867 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 437/834] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:01 2022] GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:01.571981 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-7c1ca032-f66a-4bc9-9e62-f63894f5ff95 req-d562f4fb-5c9c-46a8-9f64-3fc2522f0dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981cf996-0c9a-4e4a-8ec0-53ca023742eb", "name": "network-vif-plugged", "status": "completed", "tag": "bbd1fd9d-4fd1-45fc-969b-d8977c2bdd5a"}, {"server_uuid": "d144e260-baa1-4006-9e14-31be90b931ed", "name": "network-vif-plugged", "status": "completed", "tag": "3cf7861f-e727-4460-a639-40684297cc11"}, {"server_uuid": "14676667-3743-4d37-8ff9-f8d161a483d4", "name": "network-vif-unplugged", "status": "completed", "tag": "5170297d-0d3f-4e69-aa8a-6c0e40750532"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:01.583805 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-7c1ca032-f66a-4bc9-9e62-f63894f5ff95 req-d562f4fb-5c9c-46a8-9f64-3fc2522f0dac service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:01.584409 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-7c1ca032-f66a-4bc9-9e62-f63894f5ff95 req-d562f4fb-5c9c-46a8-9f64-3fc2522f0dac service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:01.584926 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-7c1ca032-f66a-4bc9-9e62-f63894f5ff95 req-d562f4fb-5c9c-46a8-9f64-3fc2522f0dac service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:01.602748 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-7c1ca032-f66a-4bc9-9e62-f63894f5ff95 req-d562f4fb-5c9c-46a8-9f64-3fc2522f0dac service nova] Creating event network-vif-plugged:bbd1fd9d-4fd1-45fc-969b-d8977c2bdd5a for instance 981cf996-0c9a-4e4a-8ec0-53ca023742eb on n-h1-861076-2 Oct 12 13:25:01.603496 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-7c1ca032-f66a-4bc9-9e62-f63894f5ff95 req-d562f4fb-5c9c-46a8-9f64-3fc2522f0dac service nova] Creating event network-vif-plugged:3cf7861f-e727-4460-a639-40684297cc11 for instance d144e260-baa1-4006-9e14-31be90b931ed on n-h2-861076-2 Oct 12 13:25:01.604070 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-7c1ca032-f66a-4bc9-9e62-f63894f5ff95 req-d562f4fb-5c9c-46a8-9f64-3fc2522f0dac service nova] Creating event network-vif-unplugged:5170297d-0d3f-4e69-aa8a-6c0e40750532 for instance 14676667-3743-4d37-8ff9-f8d161a483d4 on n-h2-861076-2 Oct 12 13:25:01.616822 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-7c1ca032-f66a-4bc9-9e62-f63894f5ff95 req-d562f4fb-5c9c-46a8-9f64-3fc2522f0dac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.048178 Oct 12 13:25:01.617569 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 438/835] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:01.629862 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-740cde0e-a722-4a81-9e95-6aa61b98c4bc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:01.630530 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-740cde0e-a722-4a81-9e95-6aa61b98c4bc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fdd5df96-d739-4e05-a503-2cfcab635cc8] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:01.638251 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-740cde0e-a722-4a81-9e95-6aa61b98c4bc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:01.638748 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-740cde0e-a722-4a81-9e95-6aa61b98c4bc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:01.639192 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-740cde0e-a722-4a81-9e95-6aa61b98c4bc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:01.640068 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-740cde0e-a722-4a81-9e95-6aa61b98c4bc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:01.640566 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-740cde0e-a722-4a81-9e95-6aa61b98c4bc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:01.641075 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-740cde0e-a722-4a81-9e95-6aa61b98c4bc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:01.945695 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-740cde0e-a722-4a81-9e95-6aa61b98c4bc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:01.949276 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=100 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:25:01.953921 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-740cde0e-a722-4a81-9e95-6aa61b98c4bc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8" status: 200 len: 1318 microversion: 2.1 time: 0.333804 Oct 12 13:25:01.954495 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 439/836] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:01 2022] GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8 => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:01.959100 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-2ac10cac-379d-4456-a938-abf2523b8750 req-c7402410-5be7-4860-8fe6-ac6a2fa01350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "085c7252-d302-4b81-a7f1-15311733615f", "name": "network-vif-deleted", "tag": "209cb5fd-6431-4f81-a541-b318f2cee471"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:01.968650 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-2ac10cac-379d-4456-a938-abf2523b8750 req-c7402410-5be7-4860-8fe6-ac6a2fa01350 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:01.969378 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-2ac10cac-379d-4456-a938-abf2523b8750 req-c7402410-5be7-4860-8fe6-ac6a2fa01350 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:01.970005 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-2ac10cac-379d-4456-a938-abf2523b8750 req-c7402410-5be7-4860-8fe6-ac6a2fa01350 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:01.981717 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-2ac10cac-379d-4456-a938-abf2523b8750 req-c7402410-5be7-4860-8fe6-ac6a2fa01350 service nova] Creating event network-vif-deleted:209cb5fd-6431-4f81-a541-b318f2cee471 for instance 085c7252-d302-4b81-a7f1-15311733615f on n-h1-861076-2 Oct 12 13:25:01.986587 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-2ac10cac-379d-4456-a938-abf2523b8750 req-c7402410-5be7-4860-8fe6-ac6a2fa01350 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030823 Oct 12 13:25:01.987184 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 440/837] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:01.992418 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6b817e32-037a-44f5-93bd-084a81104c52 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:01.993180 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-6b817e32-037a-44f5-93bd-084a81104c52 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:02.000484 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6b817e32-037a-44f5-93bd-084a81104c52 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:02.000589 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6b817e32-037a-44f5-93bd-084a81104c52 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:02.000992 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6b817e32-037a-44f5-93bd-084a81104c52 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:02.001827 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6b817e32-037a-44f5-93bd-084a81104c52 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:02.002166 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6b817e32-037a-44f5-93bd-084a81104c52 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:02.002607 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6b817e32-037a-44f5-93bd-084a81104c52 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:02.073283 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-6b817e32-037a-44f5-93bd-084a81104c52 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:02.083105 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3c3710f3-28fc-478d-82a4-c671ec9b5129 tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.913943 Oct 12 13:25:02.083665 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-6b817e32-037a-44f5-93bd-084a81104c52 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:02.092397 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 398/838] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:25:01 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:02.103827 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-6b817e32-037a-44f5-93bd-084a81104c52 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:02.104003 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-13d7a861-cf8d-4017-a792-9f1def3cedd1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:02.104003 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-13d7a861-cf8d-4017-a792-9f1def3cedd1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:02.104171 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6b817e32-037a-44f5-93bd-084a81104c52 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1553 microversion: 2.91 time: 0.104391 Oct 12 13:25:02.104171 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 441/839] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:25:01 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1553 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:25:02.104340 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-13d7a861-cf8d-4017-a792-9f1def3cedd1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:02.104340 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-13d7a861-cf8d-4017-a792-9f1def3cedd1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:02.104340 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-13d7a861-cf8d-4017-a792-9f1def3cedd1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:02.104340 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-13d7a861-cf8d-4017-a792-9f1def3cedd1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:02.104640 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-13d7a861-cf8d-4017-a792-9f1def3cedd1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:02.104640 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-13d7a861-cf8d-4017-a792-9f1def3cedd1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:02.104784 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-979e75c8-3e8f-4376-82b0-eb30e9599556 tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Action: 'create', calling method: .version_select at 0x7f8aa002a700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-534558383", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXOUYceh/0dQfYnzaKCYrTypVfnrxaHN8pw3LpROp55v0MqAATuQkrsUVSMt4TuwwwtxPn58eksP1gHsrJnGeUbe7FhHmvyksZqAxry+ksqjrpx2lo2PjlXnHHgCPti+g=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:02.128332 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-979e75c8-3e8f-4376-82b0-eb30e9599556 tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Getting quotas for project 21701cafbb134af6946aa5eade164aa7. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:25:02.137133 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-979e75c8-3e8f-4376-82b0-eb30e9599556 tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Getting quotas for user 22f672ea5f9b4b3f9fc87cb44452bae3 and project 21701cafbb134af6946aa5eade164aa7. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:25:02.211360 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-13d7a861-cf8d-4017-a792-9f1def3cedd1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:02.234682 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-13d7a861-cf8d-4017-a792-9f1def3cedd1 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f" status: 200 len: 1427 microversion: 2.1 time: 0.148220 Oct 12 13:25:02.254682 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 399/840] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:02 2022] GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f => generated 1427 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:02.269746 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ad1ffbda-53ea-4a83-b9f8-bf5ce11f9946 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9be531f0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:02.290819 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-979e75c8-3e8f-4376-82b0-eb30e9599556 tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.194843 Oct 12 13:25:02.291579 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 442/841] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:25:02 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:02.301979 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c218b175-549e-4251-8320-c7143ee81748 tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Calling method '.version_select at 0x7f8a9bf0ae50>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:02.305925 n-d-861076-2 devstack@n-api.service[120933]: WARNING oslo_db.sqlalchemy.utils [None req-c218b175-549e-4251-8320-c7143ee81748 tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 13:25:02.324246 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c218b175-549e-4251-8320-c7143ee81748 tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.025948 Oct 12 13:25:02.327975 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 443/842] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:25:02 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:25:02.337322 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cbfa4898-edd4-464a-90ec-fc753c1e6135 tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Calling method '.version_select at 0x7f8a9be7cc10>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:02.348261 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ad1ffbda-53ea-4a83-b9f8-bf5ce11f9946 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.089902 Oct 12 13:25:02.356688 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 400/843] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:02 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:02.374628 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-876d5ff0-05fb-476f-aacf-be15f842a730 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:02.375157 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-876d5ff0-05fb-476f-aacf-be15f842a730 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:02.382573 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-876d5ff0-05fb-476f-aacf-be15f842a730 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:02.394635 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-876d5ff0-05fb-476f-aacf-be15f842a730 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:02.394635 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-876d5ff0-05fb-476f-aacf-be15f842a730 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:02.394635 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-876d5ff0-05fb-476f-aacf-be15f842a730 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:02.394635 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-876d5ff0-05fb-476f-aacf-be15f842a730 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:02.395068 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-876d5ff0-05fb-476f-aacf-be15f842a730 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:02.467694 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-cbfa4898-edd4-464a-90ec-fc753c1e6135 tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-534558383" status: 202 len: 0 microversion: 2.1 time: 0.134076 Oct 12 13:25:02.470963 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 444/844] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 12 13:25:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-534558383 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 13:25:02.478604 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4179c86d-1f4b-4124-bb96-f3c9a3ac54c4 tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Calling method '.version_select at 0x7f8aa0045d30>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:02.564807 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-876d5ff0-05fb-476f-aacf-be15f842a730 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:02.577658 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-876d5ff0-05fb-476f-aacf-be15f842a730 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 200 len: 1320 microversion: 2.1 time: 0.205844 Oct 12 13:25:02.578169 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 401/845] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:02 2022] GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 1320 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:02.583786 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4179c86d-1f4b-4124-bb96-f3c9a3ac54c4 tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1880623066" status: 202 len: 0 microversion: 2.1 time: 0.108922 Oct 12 13:25:02.585524 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 445/846] 10.222.0.52 () {58 vars in 1278 bytes} [Wed Oct 12 13:25:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1880623066 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 13:25:02.595504 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fad2ff68-5f70-4ac1-9f28-9d30898686e3 tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] Calling method '.version_select at 0x7f8aa002aa60>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:02.602847 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-eeeccde3-09e7-4678-adc8-f9808b798613 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:02.604781 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-eeeccde3-09e7-4678-adc8-f9808b798613 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: 981cf996-0c9a-4e4a-8ec0-53ca023742eb] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:02.613661 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eeeccde3-09e7-4678-adc8-f9808b798613 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:02.614806 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eeeccde3-09e7-4678-adc8-f9808b798613 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:02.615577 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eeeccde3-09e7-4678-adc8-f9808b798613 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:02.618161 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eeeccde3-09e7-4678-adc8-f9808b798613 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:02.619166 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eeeccde3-09e7-4678-adc8-f9808b798613 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:02.619824 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eeeccde3-09e7-4678-adc8-f9808b798613 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:02.689117 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fad2ff68-5f70-4ac1-9f28-9d30898686e3 tempest-KeyPairsV2TestJSON-711473943 tempest-KeyPairsV2TestJSON-711473943-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2055142094" status: 202 len: 0 microversion: 2.1 time: 0.098439 Oct 12 13:25:02.689775 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 446/847] 10.222.0.52 () {58 vars in 1278 bytes} [Wed Oct 12 13:25:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2055142094 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:25:02.817106 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-eeeccde3-09e7-4678-adc8-f9808b798613 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:02.826613 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-eeeccde3-09e7-4678-adc8-f9808b798613 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb" status: 200 len: 1321 microversion: 2.1 time: 0.228333 Oct 12 13:25:02.828344 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 402/848] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:02 2022] GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:02.977365 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e51e049d-aede-424f-91bf-c90b50795a2c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:02.978025 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-e51e049d-aede-424f-91bf-c90b50795a2c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fdd5df96-d739-4e05-a503-2cfcab635cc8] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:02.983888 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e51e049d-aede-424f-91bf-c90b50795a2c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:02.984377 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e51e049d-aede-424f-91bf-c90b50795a2c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:02.984815 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e51e049d-aede-424f-91bf-c90b50795a2c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:02.985560 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e51e049d-aede-424f-91bf-c90b50795a2c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:02.986018 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e51e049d-aede-424f-91bf-c90b50795a2c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:02.986450 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e51e049d-aede-424f-91bf-c90b50795a2c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:03.113922 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e51e049d-aede-424f-91bf-c90b50795a2c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:03.122392 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e51e049d-aede-424f-91bf-c90b50795a2c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8" status: 200 len: 1467 microversion: 2.1 time: 0.149127 Oct 12 13:25:03.122970 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 447/849] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:02 2022] GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8 => generated 1467 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:03.130399 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3c3a1ad0-d853-455e-85fb-3b953f33a7f8 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:03.131010 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3c3a1ad0-d853-455e-85fb-3b953f33a7f8 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:03.138089 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3c3a1ad0-d853-455e-85fb-3b953f33a7f8 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:03.138572 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3c3a1ad0-d853-455e-85fb-3b953f33a7f8 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:03.139008 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3c3a1ad0-d853-455e-85fb-3b953f33a7f8 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:03.139692 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3c3a1ad0-d853-455e-85fb-3b953f33a7f8 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:03.140318 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3c3a1ad0-d853-455e-85fb-3b953f33a7f8 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:03.140742 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3c3a1ad0-d853-455e-85fb-3b953f33a7f8 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:03.144865 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7bd16d87-210f-4af4-b6f6-86109aa08bd5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:03.145519 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7bd16d87-210f-4af4-b6f6-86109aa08bd5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: d9e25817-4f35-4244-afa0-543c63840ad2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:03.152540 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7bd16d87-210f-4af4-b6f6-86109aa08bd5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:03.153110 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7bd16d87-210f-4af4-b6f6-86109aa08bd5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:03.153601 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7bd16d87-210f-4af4-b6f6-86109aa08bd5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:03.154327 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7bd16d87-210f-4af4-b6f6-86109aa08bd5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:03.154800 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7bd16d87-210f-4af4-b6f6-86109aa08bd5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:03.155232 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7bd16d87-210f-4af4-b6f6-86109aa08bd5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:03.218101 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-3c3a1ad0-d853-455e-85fb-3b953f33a7f8 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:03.226298 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-3c3a1ad0-d853-455e-85fb-3b953f33a7f8 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:03.227731 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-3c3a1ad0-d853-455e-85fb-3b953f33a7f8 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:03.234843 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3c3a1ad0-d853-455e-85fb-3b953f33a7f8 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1553 microversion: 2.91 time: 0.108207 Oct 12 13:25:03.248823 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 403/850] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:25:03 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1553 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:25:03.263450 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-79ce49f7-d976-4968-a860-b9eecea7f878 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:03.264081 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-79ce49f7-d976-4968-a860-b9eecea7f878 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:03.270131 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79ce49f7-d976-4968-a860-b9eecea7f878 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:03.270625 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79ce49f7-d976-4968-a860-b9eecea7f878 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:03.271072 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79ce49f7-d976-4968-a860-b9eecea7f878 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:03.271772 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79ce49f7-d976-4968-a860-b9eecea7f878 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:03.272232 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79ce49f7-d976-4968-a860-b9eecea7f878 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:03.272663 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79ce49f7-d976-4968-a860-b9eecea7f878 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:03.309825 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79ce49f7-d976-4968-a860-b9eecea7f878 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:03.310324 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79ce49f7-d976-4968-a860-b9eecea7f878 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:03.310865 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79ce49f7-d976-4968-a860-b9eecea7f878 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:03.311319 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-79ce49f7-d976-4968-a860-b9eecea7f878 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lazy-loading 'fault' on Instance uuid 085c7252-d302-4b81-a7f1-15311733615f {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:25:03.317376 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-7bd16d87-210f-4af4-b6f6-86109aa08bd5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:03.327617 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-7bd16d87-210f-4af4-b6f6-86109aa08bd5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e25817-4f35-4244-afa0-543c63840ad2" status: 200 len: 1467 microversion: 2.1 time: 0.186518 Oct 12 13:25:03.329404 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 448/851] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:03 2022] GET /compute/v2.1/servers/d9e25817-4f35-4244-afa0-543c63840ad2 => generated 1467 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:25:03.349863 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a946b1f2-3083-4bf2-ac81-71f4df47bf42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:03.355300 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a946b1f2-3083-4bf2-ac81-71f4df47bf42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:03.363895 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a946b1f2-3083-4bf2-ac81-71f4df47bf42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Searching by: {'reservation_id': 'r-zvu5la6u', 'deleted': False, 'project_id': 'be50900be6b246aa9289de6ec5d366f9'} {{(pid=120933) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 13:25:03.364697 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-79ce49f7-d976-4968-a860-b9eecea7f878 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:03.364814 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a946b1f2-3083-4bf2-ac81-71f4df47bf42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:03.365313 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a946b1f2-3083-4bf2-ac81-71f4df47bf42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:03.365929 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a946b1f2-3083-4bf2-ac81-71f4df47bf42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:03.366833 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a946b1f2-3083-4bf2-ac81-71f4df47bf42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:03.367610 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a946b1f2-3083-4bf2-ac81-71f4df47bf42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:03.368198 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a946b1f2-3083-4bf2-ac81-71f4df47bf42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:03.374968 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-79ce49f7-d976-4968-a860-b9eecea7f878 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f" status: 200 len: 1303 microversion: 2.1 time: 0.115282 Oct 12 13:25:03.375555 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 404/852] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:03 2022] GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:25:03.380543 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-81e940a2-d1d3-49f4-8254-8830812a232d tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa026f940>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:03.430816 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-81e940a2-d1d3-49f4-8254-8830812a232d tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.053958 Oct 12 13:25:03.431614 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 405/853] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:03 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:03.485792 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.multi_cell_list [None req-a946b1f2-3083-4bf2-ac81-71f4df47bf42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120933) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 13:25:03.591287 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a946b1f2-3083-4bf2-ac81-71f4df47bf42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:03.597438 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a946b1f2-3083-4bf2-ac81-71f4df47bf42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:03.598021 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a946b1f2-3083-4bf2-ac81-71f4df47bf42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:03.598531 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a946b1f2-3083-4bf2-ac81-71f4df47bf42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:03.600108 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2f422e13-3ecc-442d-82ef-f392ccda9996 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:03.600711 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2f422e13-3ecc-442d-82ef-f392ccda9996 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:03.619280 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f422e13-3ecc-442d-82ef-f392ccda9996 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:03.619788 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f422e13-3ecc-442d-82ef-f392ccda9996 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:03.620237 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f422e13-3ecc-442d-82ef-f392ccda9996 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:03.620980 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f422e13-3ecc-442d-82ef-f392ccda9996 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:03.621447 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f422e13-3ecc-442d-82ef-f392ccda9996 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:03.621909 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f422e13-3ecc-442d-82ef-f392ccda9996 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:03.964695 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a946b1f2-3083-4bf2-ac81-71f4df47bf42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?reservation_id=r-zvu5la6u" status: 200 len: 2927 microversion: 2.1 time: 0.618560 Oct 12 13:25:03.971575 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 449/854] 10.222.0.52 () {58 vars in 1197 bytes} [Wed Oct 12 13:25:03 2022] GET /compute/v2.1/servers/detail?reservation_id=r-zvu5la6u => generated 2927 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:25:03.971992 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-2f422e13-3ecc-442d-82ef-f392ccda9996 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:03.975444 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a7ef56ac-2ad2-4e65-9e0c-f1a256b82a56 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:03.976187 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a7ef56ac-2ad2-4e65-9e0c-f1a256b82a56 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: 981cf996-0c9a-4e4a-8ec0-53ca023742eb] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:03.978400 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2f422e13-3ecc-442d-82ef-f392ccda9996 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 200 len: 1320 microversion: 2.1 time: 0.382005 Oct 12 13:25:03.978975 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 406/855] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:03 2022] GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 1320 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:25:03.993653 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a7ef56ac-2ad2-4e65-9e0c-f1a256b82a56 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:03.993653 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a7ef56ac-2ad2-4e65-9e0c-f1a256b82a56 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:03.993653 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a7ef56ac-2ad2-4e65-9e0c-f1a256b82a56 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:03.993653 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a7ef56ac-2ad2-4e65-9e0c-f1a256b82a56 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:03.994011 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a7ef56ac-2ad2-4e65-9e0c-f1a256b82a56 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:03.994011 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a7ef56ac-2ad2-4e65-9e0c-f1a256b82a56 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:04.000766 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f278fd5a-2859-494f-8427-9c2d5ba0d46f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:04.017786 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.compute.server_groups [None req-f278fd5a-2859-494f-8427-9c2d5ba0d46f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Querying cell c7d37a9d-54da-4741-8e88-e51a0f3ae3d5(cell1) for 2 instances {{(pid=120932) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 12 13:25:04.020770 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f278fd5a-2859-494f-8427-9c2d5ba0d46f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:04.025230 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f278fd5a-2859-494f-8427-9c2d5ba0d46f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:04.026641 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f278fd5a-2859-494f-8427-9c2d5ba0d46f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:04.051674 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f278fd5a-2859-494f-8427-9c2d5ba0d46f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/cd2995b2-cabe-4f7a-96e7-30ec9ebc56fd" status: 200 len: 270 microversion: 2.1 time: 0.056244 Oct 12 13:25:04.058720 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 407/856] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 12 13:25:03 2022] GET /compute/v2.1/os-server-groups/cd2995b2-cabe-4f7a-96e7-30ec9ebc56fd => generated 270 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:04.066281 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-04199ccf-ed6e-4e8a-9c4e-9a96884eaaee tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:04.067060 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-04199ccf-ed6e-4e8a-9c4e-9a96884eaaee tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] [instance: fdd5df96-d739-4e05-a503-2cfcab635cc8] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:04.076263 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04199ccf-ed6e-4e8a-9c4e-9a96884eaaee tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:04.076954 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04199ccf-ed6e-4e8a-9c4e-9a96884eaaee tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:04.077288 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04199ccf-ed6e-4e8a-9c4e-9a96884eaaee tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:04.078517 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04199ccf-ed6e-4e8a-9c4e-9a96884eaaee tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:04.078517 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04199ccf-ed6e-4e8a-9c4e-9a96884eaaee tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:04.079742 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04199ccf-ed6e-4e8a-9c4e-9a96884eaaee tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:04.290566 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a7ef56ac-2ad2-4e65-9e0c-f1a256b82a56 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:04.299386 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a7ef56ac-2ad2-4e65-9e0c-f1a256b82a56 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb" status: 200 len: 1471 microversion: 2.1 time: 0.331913 Oct 12 13:25:04.300261 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 450/857] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:03 2022] GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb => generated 1471 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:04.304966 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b4859f92-80f8-4790-9d79-c0a02e3ca371 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:04.305881 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-b4859f92-80f8-4790-9d79-c0a02e3ca371 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:04.311783 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4859f92-80f8-4790-9d79-c0a02e3ca371 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:04.312762 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4859f92-80f8-4790-9d79-c0a02e3ca371 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:04.312933 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4859f92-80f8-4790-9d79-c0a02e3ca371 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:04.313900 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4859f92-80f8-4790-9d79-c0a02e3ca371 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:04.314627 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4859f92-80f8-4790-9d79-c0a02e3ca371 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:04.315142 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4859f92-80f8-4790-9d79-c0a02e3ca371 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:04.368512 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-04199ccf-ed6e-4e8a-9c4e-9a96884eaaee tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8" status: 200 len: 1618 microversion: 2.1 time: 0.309164 Oct 12 13:25:04.370722 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 408/858] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:04 2022] GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8 => generated 1618 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:04.419096 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b4859f92-80f8-4790-9d79-c0a02e3ca371 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:04.430115 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b4859f92-80f8-4790-9d79-c0a02e3ca371 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:04.434770 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b4859f92-80f8-4790-9d79-c0a02e3ca371 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:04.439990 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:25:04.441835 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b4859f92-80f8-4790-9d79-c0a02e3ca371 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1553 microversion: 2.91 time: 0.140541 Oct 12 13:25:04.442822 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 451/859] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:25:04 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1553 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:25:04.448251 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e744c34c-8102-414b-8704-a9bd9e14b8c4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:04.449077 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-e744c34c-8102-414b-8704-a9bd9e14b8c4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:04.456891 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e744c34c-8102-414b-8704-a9bd9e14b8c4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:04.457727 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e744c34c-8102-414b-8704-a9bd9e14b8c4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:04.458341 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e744c34c-8102-414b-8704-a9bd9e14b8c4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:04.459069 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e744c34c-8102-414b-8704-a9bd9e14b8c4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:04.459528 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e744c34c-8102-414b-8704-a9bd9e14b8c4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:04.459955 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e744c34c-8102-414b-8704-a9bd9e14b8c4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:04.522335 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e744c34c-8102-414b-8704-a9bd9e14b8c4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:04.522970 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e744c34c-8102-414b-8704-a9bd9e14b8c4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:04.523638 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e744c34c-8102-414b-8704-a9bd9e14b8c4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:04.524858 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-e744c34c-8102-414b-8704-a9bd9e14b8c4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lazy-loading 'fault' on Instance uuid 085c7252-d302-4b81-a7f1-15311733615f {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:25:04.583439 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e744c34c-8102-414b-8704-a9bd9e14b8c4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df255f194e54dfb8781b982c2c60a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92cdc745c654b538146a4a64f5f4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:04.591811 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e744c34c-8102-414b-8704-a9bd9e14b8c4 tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f" status: 200 len: 1303 microversion: 2.1 time: 0.147746 Oct 12 13:25:04.592538 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 452/860] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:04 2022] GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f => generated 1303 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:04.597110 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3e6e5f93-0b33-49a7-84d7-aa831c8b0012 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:04.597834 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-3e6e5f93-0b33-49a7-84d7-aa831c8b0012 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] [instance: d9e25817-4f35-4244-afa0-543c63840ad2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:04.603634 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e6e5f93-0b33-49a7-84d7-aa831c8b0012 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:04.604222 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e6e5f93-0b33-49a7-84d7-aa831c8b0012 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:04.604731 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e6e5f93-0b33-49a7-84d7-aa831c8b0012 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:04.605508 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e6e5f93-0b33-49a7-84d7-aa831c8b0012 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:04.606022 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e6e5f93-0b33-49a7-84d7-aa831c8b0012 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:04.609163 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3e6e5f93-0b33-49a7-84d7-aa831c8b0012 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:04.646193 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e353d1bb-0cd2-4125-8256-074ed9d3f05a tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:04.646756 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e353d1bb-0cd2-4125-8256-074ed9d3f05a tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] [instance: e79b3f5f-9b5d-427a-8b0b-112c55269b67] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:04.652403 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-e353d1bb-0cd2-4125-8256-074ed9d3f05a tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] HTTP exception thrown: Instance e79b3f5f-9b5d-427a-8b0b-112c55269b67 could not be found. Oct 12 13:25:04.657867 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e353d1bb-0cd2-4125-8256-074ed9d3f05a tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Request method failure captured: Oct 12 13:25:04.657867 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers/e79b3f5f-9b5d-427a-8b0b-112c55269b67/action HTTP/1.1 Oct 12 13:25:04.657867 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:25:04.657867 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:25:04.657867 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:25:04.657867 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 15 Oct 12 13:25:04.657867 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:25:04.657867 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:25:04.657867 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:25:04.657867 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:04.657867 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsAT28ek4MsScjtTBGI8Ms8LAC8fj4MDuDrMEpVTijlEMk6cP5EDOu11KzhH_uHNU7v1CdXUoctpDSiE7Q1XM7F3lV4E7lSRSu2nhkqsXwBRBs7Ri3-TB4Gmceqb1RQiScAh4kS4nLf5A7bTzGk1ZfRJ6p0d5UjRBxU84R6oQeLjgug Oct 12 13:25:04.657867 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:25:04.657867 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:25:04.657867 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:25:04.657867 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:25:04.657867 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:25:04.657867 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:25:04.657867 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 8d3e7a06b07c472f9622139256b6f979 Oct 12 13:25:04.657867 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-419437385 Oct 12 13:25:04.657867 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,admin,reader Oct 12 13:25:04.657867 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,admin,reader Oct 12 13:25:04.659289 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d3e7a06b07c472f9622139256b6f979"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d3e7a06b07c472f9622139256b6f979"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d3e7a06b07c472f9622139256b6f979"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d3e7a06b07c472f9622139256b6f979"}]}] Oct 12 13:25:04.659289 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServersAdminNegativeTestJSON-419437385 Oct 12 13:25:04.659289 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 8d3e7a06b07c472f9622139256b6f979 Oct 12 13:25:04.659289 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-419437385 Oct 12 13:25:04.659289 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServersAdminNegativeTestJSON-419437385-project-admin Oct 12 13:25:04.659289 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:25:04.659289 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:25:04.659289 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: facfbc21985745999c14297a645e3b44 Oct 12 13:25:04.659289 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServersAdminNegativeTestJSON-419437385-project-admin Oct 12 13:25:04.659289 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:25:04.659289 n-d-861076-2 devstack@n-api.service[120932]: {"migrate": {}} Oct 12 13:25:04.659289 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:25:04.659289 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance e79b3f5f-9b5d-427a-8b0b-112c55269b67 could not be found. Oct 12 13:25:04.660245 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'e79b3f5f-9b5d-427a-8b0b-112c55269b67', 'body': {'migrate': {}}} Oct 12 13:25:04.660245 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:04.660245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:04.660245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:25:04.660245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:25:04.660245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:25:04.660245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:25:04.660245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 13:25:04.660245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 13:25:04.660245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e79b3f5f-9b5d-427a-8b0b-112c55269b67 could not be found. Oct 12 13:25:04.660245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:04.660245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:04.660245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:04.660245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:04.660245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:04.660245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:04.660245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:04.660245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:04.660245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:04.660245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:04.661566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:04.661566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:04.661566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 12 13:25:04.661566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 12 13:25:04.661566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:25:04.661566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:25:04.661566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e79b3f5f-9b5d-427a-8b0b-112c55269b67 could not be found. Oct 12 13:25:04.661566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:04.661566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:04.661566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:04.661566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:04.661566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:04.661566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:04.661566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:04.661566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:04.661566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e79b3f5f-9b5d-427a-8b0b-112c55269b67 could not be found. Oct 12 13:25:04.661566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:04.662958 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e353d1bb-0cd2-4125-8256-074ed9d3f05a tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Returning 404 to user: Instance e79b3f5f-9b5d-427a-8b0b-112c55269b67 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:04.662958 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e353d1bb-0cd2-4125-8256-074ed9d3f05a tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/e79b3f5f-9b5d-427a-8b0b-112c55269b67/action" status: 404 len: 111 microversion: 2.1 time: 0.285825 Oct 12 13:25:04.662958 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 409/861] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:25:04 2022] POST /compute/v2.1/servers/e79b3f5f-9b5d-427a-8b0b-112c55269b67/action => generated 111 bytes in 287 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:25:04.662958 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7bd335b6-6e25-4a32-bc51-ac43b74d927d tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa026f040>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:04.720548 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7bd335b6-6e25-4a32-bc51-ac43b74d927d tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.062891 Oct 12 13:25:04.728718 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 410/862] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:04 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:04.782365 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3e6e5f93-0b33-49a7-84d7-aa831c8b0012 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d9e25817-4f35-4244-afa0-543c63840ad2" status: 200 len: 1618 microversion: 2.1 time: 0.188687 Oct 12 13:25:04.783153 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 453/863] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:04 2022] GET /compute/v2.1/servers/d9e25817-4f35-4244-afa0-543c63840ad2 => generated 1618 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:04.809589 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b680f2d3-1df8-4f1c-831b-257959c514d1 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2057951946", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:04.870224 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-b680f2d3-1df8-4f1c-831b-257959c514d1 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] validate_networks() for None {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:25:05.006581 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cb9b2f3b-c172-41a2-adfe-0c53e6fb34fc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:05.007612 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-cb9b2f3b-c172-41a2-adfe-0c53e6fb34fc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:05.028008 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cb9b2f3b-c172-41a2-adfe-0c53e6fb34fc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:05.029187 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cb9b2f3b-c172-41a2-adfe-0c53e6fb34fc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:05.029902 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cb9b2f3b-c172-41a2-adfe-0c53e6fb34fc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:05.030861 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cb9b2f3b-c172-41a2-adfe-0c53e6fb34fc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:05.031424 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cb9b2f3b-c172-41a2-adfe-0c53e6fb34fc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:05.032070 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cb9b2f3b-c172-41a2-adfe-0c53e6fb34fc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:05.238977 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-b680f2d3-1df8-4f1c-831b-257959c514d1 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:25:05.239506 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-b680f2d3-1df8-4f1c-831b-257959c514d1 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:25:05.239987 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-b680f2d3-1df8-4f1c-831b-257959c514d1 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:25:05.240462 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-b680f2d3-1df8-4f1c-831b-257959c514d1 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:25:05.241119 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-b680f2d3-1df8-4f1c-831b-257959c514d1 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:25:05.252425 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b680f2d3-1df8-4f1c-831b-257959c514d1 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:05.253029 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b680f2d3-1df8-4f1c-831b-257959c514d1 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:05.253594 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b680f2d3-1df8-4f1c-831b-257959c514d1 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:05.254337 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b680f2d3-1df8-4f1c-831b-257959c514d1 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:05.254794 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b680f2d3-1df8-4f1c-831b-257959c514d1 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:05.255226 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b680f2d3-1df8-4f1c-831b-257959c514d1 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:05.262565 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-cb9b2f3b-c172-41a2-adfe-0c53e6fb34fc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:05.271915 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-cb9b2f3b-c172-41a2-adfe-0c53e6fb34fc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 200 len: 1470 microversion: 2.1 time: 0.269771 Oct 12 13:25:05.273415 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-b680f2d3-1df8-4f1c-831b-257959c514d1 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Getting quotas for project 7afd8d44b48d4ec0b54a400fd73ca770. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:25:05.283625 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-b680f2d3-1df8-4f1c-831b-257959c514d1 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Getting quotas for user 27540849dbc344a384a1f24a6cc32175 and project 7afd8d44b48d4ec0b54a400fd73ca770. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:25:05.293113 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b680f2d3-1df8-4f1c-831b-257959c514d1 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:25:05.296153 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b680f2d3-1df8-4f1c-831b-257959c514d1 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:25:05.297825 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 454/864] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:05 2022] GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 1470 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:05.302890 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-027d9b58-5d25-4a2b-bdd6-2e366bcc471d tempest-DeleteServersAdminTestJSON-1393324785 tempest-DeleteServersAdminTestJSON-1393324785-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:05.305360 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-027d9b58-5d25-4a2b-bdd6-2e366bcc471d tempest-DeleteServersAdminTestJSON-1393324785 tempest-DeleteServersAdminTestJSON-1393324785-project-admin] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:05.311848 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-027d9b58-5d25-4a2b-bdd6-2e366bcc471d tempest-DeleteServersAdminTestJSON-1393324785 tempest-DeleteServersAdminTestJSON-1393324785-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:05.312526 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-027d9b58-5d25-4a2b-bdd6-2e366bcc471d tempest-DeleteServersAdminTestJSON-1393324785 tempest-DeleteServersAdminTestJSON-1393324785-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:05.312817 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-027d9b58-5d25-4a2b-bdd6-2e366bcc471d tempest-DeleteServersAdminTestJSON-1393324785 tempest-DeleteServersAdminTestJSON-1393324785-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:05.313621 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-027d9b58-5d25-4a2b-bdd6-2e366bcc471d tempest-DeleteServersAdminTestJSON-1393324785 tempest-DeleteServersAdminTestJSON-1393324785-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:05.314111 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-027d9b58-5d25-4a2b-bdd6-2e366bcc471d tempest-DeleteServersAdminTestJSON-1393324785 tempest-DeleteServersAdminTestJSON-1393324785-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:05.314692 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-027d9b58-5d25-4a2b-bdd6-2e366bcc471d tempest-DeleteServersAdminTestJSON-1393324785 tempest-DeleteServersAdminTestJSON-1393324785-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:05.614647 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b680f2d3-1df8-4f1c-831b-257959c514d1 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.811233 Oct 12 13:25:05.615345 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 411/865] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:25:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 13:25:05.619826 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-194fcc74-3132-40be-b4b5-52047e436aa2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-274328056", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "9443e943-93c1-4a5f-aad4-da32545368fa"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:05.671581 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-194fcc74-3132-40be-b4b5-52047e436aa2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] validate_networks() for None {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:25:05.904276 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-027d9b58-5d25-4a2b-bdd6-2e366bcc471d tempest-DeleteServersAdminTestJSON-1393324785 tempest-DeleteServersAdminTestJSON-1393324785-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed/action" status: 202 len: 0 microversion: 2.1 time: 0.605100 Oct 12 13:25:05.905075 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 455/866] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:25:05 2022] POST /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:25:05.910511 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f6487664-978a-412d-8ce1-ee2752cd5f51 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:05.916327 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f6487664-978a-412d-8ce1-ee2752cd5f51 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:05.917732 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f6487664-978a-412d-8ce1-ee2752cd5f51 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:05.918376 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f6487664-978a-412d-8ce1-ee2752cd5f51 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:05.918941 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f6487664-978a-412d-8ce1-ee2752cd5f51 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:05.919915 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f6487664-978a-412d-8ce1-ee2752cd5f51 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:05.920621 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f6487664-978a-412d-8ce1-ee2752cd5f51 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:05.921290 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f6487664-978a-412d-8ce1-ee2752cd5f51 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:05.949126 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-194fcc74-3132-40be-b4b5-52047e436aa2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:25:05.949545 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-194fcc74-3132-40be-b4b5-52047e436aa2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:25:05.950044 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-194fcc74-3132-40be-b4b5-52047e436aa2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:25:05.951276 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-194fcc74-3132-40be-b4b5-52047e436aa2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:25:05.951690 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-194fcc74-3132-40be-b4b5-52047e436aa2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:25:05.960507 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-194fcc74-3132-40be-b4b5-52047e436aa2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:05.961036 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-194fcc74-3132-40be-b4b5-52047e436aa2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:05.961474 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-194fcc74-3132-40be-b4b5-52047e436aa2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:05.962189 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-194fcc74-3132-40be-b4b5-52047e436aa2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:05.962638 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-194fcc74-3132-40be-b4b5-52047e436aa2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:05.963058 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-194fcc74-3132-40be-b4b5-52047e436aa2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:05.984684 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-194fcc74-3132-40be-b4b5-52047e436aa2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for project be50900be6b246aa9289de6ec5d366f9. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:25:05.986133 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f6487664-978a-412d-8ce1-ee2752cd5f51 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:05.990151 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-194fcc74-3132-40be-b4b5-52047e436aa2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for user a0fd9458bb2842829a1e13ac93fade30 and project be50900be6b246aa9289de6ec5d366f9. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:25:05.995178 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f6487664-978a-412d-8ce1-ee2752cd5f51 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:05.996626 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f6487664-978a-412d-8ce1-ee2752cd5f51 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:06.002620 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f6487664-978a-412d-8ce1-ee2752cd5f51 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1535 microversion: 2.91 time: 0.096508 Oct 12 13:25:06.003389 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 456/867] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:25:05 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1535 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:25:06.008167 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-450e66b9-e215-4e68-b5d1-5a319b813a2e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:06.009150 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-450e66b9-e215-4e68-b5d1-5a319b813a2e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] [instance: 085c7252-d302-4b81-a7f1-15311733615f] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:06.015786 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-450e66b9-e215-4e68-b5d1-5a319b813a2e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:06.016458 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-450e66b9-e215-4e68-b5d1-5a319b813a2e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:06.017125 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-450e66b9-e215-4e68-b5d1-5a319b813a2e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:06.018020 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-450e66b9-e215-4e68-b5d1-5a319b813a2e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:06.018637 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-450e66b9-e215-4e68-b5d1-5a319b813a2e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:06.019218 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-450e66b9-e215-4e68-b5d1-5a319b813a2e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:06.023447 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-194fcc74-3132-40be-b4b5-52047e436aa2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:25:06.030161 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-194fcc74-3132-40be-b4b5-52047e436aa2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:25:06.036193 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-450e66b9-e215-4e68-b5d1-5a319b813a2e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] HTTP exception thrown: Instance 085c7252-d302-4b81-a7f1-15311733615f could not be found. Oct 12 13:25:06.037915 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-450e66b9-e215-4e68-b5d1-5a319b813a2e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Request method failure captured: Oct 12 13:25:06.037915 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f HTTP/1.1 Oct 12 13:25:06.037915 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:25:06.037915 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:25:06.037915 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:25:06.037915 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:25:06.037915 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:25:06.037915 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:25:06.037915 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:25:06.037915 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:06.037915 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr-Uy7R0-vO84LNBAwxPsssPvLLJJvDLLoKGFa8vBBM7F1Mf1vlFFzFToaRgPGnPKfPfeQQEWDVwjA-kXG2ItKpreMCd93oSqbLTmiWoKKoCe0M_BbZ4_liwNDN0-6wBzZaO_Moy7e6iBmO_tj-vMYydnf_VGtaHbljYhF2p-bsDVq4 Oct 12 13:25:06.037915 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:25:06.037915 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:25:06.037915 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:25:06.037915 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:25:06.037915 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:25:06.037915 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:25:06.037915 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: b92cdc745c654b538146a4a64f5f4b6f Oct 12 13:25:06.037915 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-MigrationsAdminTest-933851851 Oct 12 13:25:06.037915 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:25:06.037915 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:25:06.039615 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b92cdc745c654b538146a4a64f5f4b6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b92cdc745c654b538146a4a64f5f4b6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b92cdc745c654b538146a4a64f5f4b6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b92cdc745c654b538146a4a64f5f4b6f"}]}] Oct 12 13:25:06.039615 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-MigrationsAdminTest-933851851 Oct 12 13:25:06.039615 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: b92cdc745c654b538146a4a64f5f4b6f Oct 12 13:25:06.039615 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-MigrationsAdminTest-933851851 Oct 12 13:25:06.039615 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-MigrationsAdminTest-933851851-project Oct 12 13:25:06.039615 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:25:06.039615 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:25:06.039615 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 0df255f194e54dfb8781b982c2c60a98 Oct 12 13:25:06.039615 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-MigrationsAdminTest-933851851-project Oct 12 13:25:06.039615 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:25:06.039615 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance 085c7252-d302-4b81-a7f1-15311733615f could not be found. Oct 12 13:25:06.039615 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '085c7252-d302-4b81-a7f1-15311733615f'} Oct 12 13:25:06.040381 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:06.040381 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:06.040381 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:25:06.040381 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:25:06.040381 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:25:06.040381 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:25:06.040381 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:25:06.040381 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:25:06.040381 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:25:06.040381 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:25:06.040381 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 085c7252-d302-4b81-a7f1-15311733615f could not be found. Oct 12 13:25:06.040381 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:06.040381 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:06.040381 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:06.040381 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:06.040381 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:06.040381 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:06.040381 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:06.040381 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:06.040381 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:06.041683 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:06.041683 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:25:06.041683 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:25:06.041683 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:25:06.041683 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:25:06.041683 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:25:06.041683 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:25:06.041683 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 085c7252-d302-4b81-a7f1-15311733615f could not be found. Oct 12 13:25:06.041683 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:06.041683 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:06.041683 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:06.041683 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:06.041683 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:06.041683 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:06.041683 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:06.041683 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:06.041683 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 085c7252-d302-4b81-a7f1-15311733615f could not be found. Oct 12 13:25:06.041683 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:06.054946 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-450e66b9-e215-4e68-b5d1-5a319b813a2e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] Returning 404 to user: Instance 085c7252-d302-4b81-a7f1-15311733615f could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:06.054946 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-450e66b9-e215-4e68-b5d1-5a319b813a2e tempest-MigrationsAdminTest-933851851 tempest-MigrationsAdminTest-933851851-project] 10.222.0.52 "GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f" status: 404 len: 111 microversion: 2.1 time: 0.040297 Oct 12 13:25:06.054946 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 457/868] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:06 2022] GET /compute/v2.1/servers/085c7252-d302-4b81-a7f1-15311733615f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:25:06.054946 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-80f29bae-d303-4ab0-9185-d893af05588c tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:06.054946 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-80f29bae-d303-4ab0-9185-d893af05588c tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:06.120754 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-80f29bae-d303-4ab0-9185-d893af05588c tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:06.122963 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-80f29bae-d303-4ab0-9185-d893af05588c tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1222 microversion: 2.1 time: 0.076003 Oct 12 13:25:06.123548 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 458/869] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:06 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1222 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:06.129578 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b89e06c2-23ba-4df6-8cf5-8e5edc1bd97c tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9be7cee0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:06.187478 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b89e06c2-23ba-4df6-8cf5-8e5edc1bd97c tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.051679 Oct 12 13:25:06.187478 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 459/870] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:06 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:06.187478 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-296632e1-a4a4-4ae9-9449-0b872f21effa tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:06.187478 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-296632e1-a4a4-4ae9-9449-0b872f21effa tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:06.191077 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-296632e1-a4a4-4ae9-9449-0b872f21effa tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:06.191573 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-296632e1-a4a4-4ae9-9449-0b872f21effa tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:06.192017 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-296632e1-a4a4-4ae9-9449-0b872f21effa tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:06.192728 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-296632e1-a4a4-4ae9-9449-0b872f21effa tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:06.193217 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-296632e1-a4a4-4ae9-9449-0b872f21effa tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:06.193655 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-296632e1-a4a4-4ae9-9449-0b872f21effa tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:06.225741 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-296632e1-a4a4-4ae9-9449-0b872f21effa tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:06.228006 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-296632e1-a4a4-4ae9-9449-0b872f21effa tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:06.228006 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-296632e1-a4a4-4ae9-9449-0b872f21effa tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:06.228006 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-296632e1-a4a4-4ae9-9449-0b872f21effa tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lazy-loading 'fault' on Instance uuid d144e260-baa1-4006-9e14-31be90b931ed {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:25:06.337048 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-194fcc74-3132-40be-b4b5-52047e436aa2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720088 Oct 12 13:25:06.337589 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 412/871] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:25:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 13:25:06.348396 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f51c0881-a4ec-4dbe-b003-380a4a9c6cb9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:06.349190 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f51c0881-a4ec-4dbe-b003-380a4a9c6cb9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:06.350261 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-296632e1-a4a4-4ae9-9449-0b872f21effa tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:06.359235 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-296632e1-a4a4-4ae9-9449-0b872f21effa tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 200 len: 1453 microversion: 2.1 time: 0.179907 Oct 12 13:25:06.361779 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 460/872] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:06 2022] GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 1453 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:06.384235 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5695c20b-fcdb-4ec4-8d28-f196d5993af3 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:06.384805 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-5695c20b-fcdb-4ec4-8d28-f196d5993af3 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:06.391447 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5695c20b-fcdb-4ec4-8d28-f196d5993af3 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:06.392037 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5695c20b-fcdb-4ec4-8d28-f196d5993af3 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:06.392566 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5695c20b-fcdb-4ec4-8d28-f196d5993af3 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:06.393375 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5695c20b-fcdb-4ec4-8d28-f196d5993af3 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:06.393906 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5695c20b-fcdb-4ec4-8d28-f196d5993af3 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:06.394405 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5695c20b-fcdb-4ec4-8d28-f196d5993af3 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:06.421098 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f51c0881-a4ec-4dbe-b003-380a4a9c6cb9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:06.421260 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-5695c20b-fcdb-4ec4-8d28-f196d5993af3 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Going to try to terminate instance {{(pid=120933) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:25:06.428123 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f51c0881-a4ec-4dbe-b003-380a4a9c6cb9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1216 microversion: 2.1 time: 0.083521 Oct 12 13:25:06.428715 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 413/873] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:06 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1216 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:25:06.437008 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:25:06.940481 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5695c20b-fcdb-4ec4-8d28-f196d5993af3 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 204 len: 0 microversion: 2.1 time: 0.560708 Oct 12 13:25:06.941095 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 461/874] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:25:06 2022] DELETE /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 13:25:06.949627 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-814db8b5-2466-46d4-b56d-94c10da87005 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:06.958083 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-814db8b5-2466-46d4-b56d-94c10da87005 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:06.978284 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-814db8b5-2466-46d4-b56d-94c10da87005 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:06.979033 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-814db8b5-2466-46d4-b56d-94c10da87005 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:06.980221 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-814db8b5-2466-46d4-b56d-94c10da87005 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:06.981569 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-814db8b5-2466-46d4-b56d-94c10da87005 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:06.983043 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-814db8b5-2466-46d4-b56d-94c10da87005 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:06.983480 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-814db8b5-2466-46d4-b56d-94c10da87005 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:07.036805 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-45219131-3ea7-461c-b474-7b31c7da5bf1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:07.037827 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-45219131-3ea7-461c-b474-7b31c7da5bf1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:07.041859 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-814db8b5-2466-46d4-b56d-94c10da87005 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:07.048191 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-814db8b5-2466-46d4-b56d-94c10da87005 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:07.048191 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-814db8b5-2466-46d4-b56d-94c10da87005 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:07.048191 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-814db8b5-2466-46d4-b56d-94c10da87005 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lazy-loading 'fault' on Instance uuid d144e260-baa1-4006-9e14-31be90b931ed {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:25:07.075144 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-45219131-3ea7-461c-b474-7b31c7da5bf1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:07.080420 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-45219131-3ea7-461c-b474-7b31c7da5bf1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:07.080420 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-45219131-3ea7-461c-b474-7b31c7da5bf1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:07.080420 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-45219131-3ea7-461c-b474-7b31c7da5bf1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:07.080420 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-45219131-3ea7-461c-b474-7b31c7da5bf1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:07.081453 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-45219131-3ea7-461c-b474-7b31c7da5bf1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:07.190508 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-45219131-3ea7-461c-b474-7b31c7da5bf1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:07.204974 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-45219131-3ea7-461c-b474-7b31c7da5bf1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:07.213077 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-45219131-3ea7-461c-b474-7b31c7da5bf1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71c81ca6d9a04eceaf753a9e5bfcbb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5273399261154672b801633e535ee5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:07.220350 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-45219131-3ea7-461c-b474-7b31c7da5bf1 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 200 len: 1538 microversion: 2.91 time: 0.191336 Oct 12 13:25:07.221285 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 462/875] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:25:07 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 1538 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:25:07.226716 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b69a0991-4b57-4d91-b2b7-b6aab40d5677 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:07.227430 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-b69a0991-4b57-4d91-b2b7-b6aab40d5677 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:07.233514 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b69a0991-4b57-4d91-b2b7-b6aab40d5677 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:07.234877 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b69a0991-4b57-4d91-b2b7-b6aab40d5677 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:07.235396 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b69a0991-4b57-4d91-b2b7-b6aab40d5677 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:07.236186 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b69a0991-4b57-4d91-b2b7-b6aab40d5677 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:07.236720 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b69a0991-4b57-4d91-b2b7-b6aab40d5677 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:07.237234 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b69a0991-4b57-4d91-b2b7-b6aab40d5677 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:07.240872 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-814db8b5-2466-46d4-b56d-94c10da87005 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:07.250879 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-814db8b5-2466-46d4-b56d-94c10da87005 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 200 len: 1459 microversion: 2.1 time: 0.305336 Oct 12 13:25:07.251452 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 414/876] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:06 2022] GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 1459 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:25:07.256409 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ec8a20c0-443e-490c-92e3-ff1a59ac7c78 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bd92430>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:07.313991 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ec8a20c0-443e-490c-92e3-ff1a59ac7c78 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.060901 Oct 12 13:25:07.321339 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 415/877] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:07 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:07.321339 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d28c4880-5464-4c88-8dc1-bd57d562cda2 tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-861076-2"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:07.323660 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d28c4880-5464-4c88-8dc1-bd57d562cda2 tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:07.340861 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d28c4880-5464-4c88-8dc1-bd57d562cda2 tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:07.341971 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d28c4880-5464-4c88-8dc1-bd57d562cda2 tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:07.342662 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d28c4880-5464-4c88-8dc1-bd57d562cda2 tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:07.344072 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d28c4880-5464-4c88-8dc1-bd57d562cda2 tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:07.344703 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d28c4880-5464-4c88-8dc1-bd57d562cda2 tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:07.348548 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d28c4880-5464-4c88-8dc1-bd57d562cda2 tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:07.348660 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b69a0991-4b57-4d91-b2b7-b6aab40d5677 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:07.360633 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b69a0991-4b57-4d91-b2b7-b6aab40d5677 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1226 microversion: 2.1 time: 0.135003 Oct 12 13:25:07.366788 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 463/878] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:07 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1226 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:07.452683 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ceaf6c84-828d-42f9-b852-7769bfe46494 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:07.453401 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-ceaf6c84-828d-42f9-b852-7769bfe46494 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:07.480761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-d28c4880-5464-4c88-8dc1-bd57d562cda2 tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a412418c-a654-44f3-8f53-cac49fd60592) Oct 12 13:25:07.480761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:07.480761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:07.480761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:07.480761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:07.480761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:07.480761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:07.480761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:07.480761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 12 13:25:07.480761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 12 13:25:07.480761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 12 13:25:07.480761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 12 13:25:07.480761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 12 13:25:07.480761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 12 13:25:07.480761 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:25:07.482113 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:25:07.482113 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:25:07.482113 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:25:07.482113 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:25:07.482113 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:25:07.482113 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:07.482113 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:07.482113 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:25:07.482113 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:25:07.482113 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:07.482113 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:07.482113 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:25:07.482113 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:25:07.482113 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:07.482113 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:07.482113 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:25:07.482113 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:25:07.482113 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:07.482113 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:07.483522 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:25:07.483522 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:25:07.483522 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:25:07.483522 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:25:07.483522 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:25:07.483522 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:25:07.483522 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:25:07.483522 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:25:07.483522 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:25:07.483522 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:25:07.483522 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:25:07.483522 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:25:07.483522 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:25:07.483522 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:25:07.483522 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:25:07.483522 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:25:07.484702 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:25:07.484702 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:25:07.484702 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:25:07.484702 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:25:07.484702 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:25:07.484702 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:25:07.484702 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:25:07.484702 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:25:07.484702 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:25:07.484702 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:25:07.484702 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a412418c-a654-44f3-8f53-cac49fd60592) Oct 12 13:25:07.484702 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:07.486477 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-d28c4880-5464-4c88-8dc1-bd57d562cda2 tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:07.486477 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:25:07.488031 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d28c4880-5464-4c88-8dc1-bd57d562cda2 tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Request method failure captured: Oct 12 13:25:07.488031 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b/action HTTP/1.1 Oct 12 13:25:07.488031 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:25:07.488031 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:25:07.488031 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:25:07.488031 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 39 Oct 12 13:25:07.488031 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:25:07.488031 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:25:07.488031 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:25:07.488031 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:07.488031 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr_qqEG1bzN6GZ2Pze5VoJxfxiAb_us8P-zqt7FYagnCoPMMzXz8Gh6TCiMllJYWyYvvALhRKLPX5vyOJBZWh-SQEbrLYFX5LLVc3pzwENlN1BUIo5JRVgaEi8isdADgVpwppruWWjRlCf5p53VNbzvPNoFWqevVucqMb374kGOxsOo Oct 12 13:25:07.488031 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:25:07.488031 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:25:07.488031 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:25:07.488031 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:25:07.488031 n-d-861076-2 devstack@n-api.service[120932]: X-Openstack-Nova-Api-Version: 2.91 Oct 12 13:25:07.488031 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:25:07.488031 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:25:07.488031 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 9f077c4b041d428faabd74b4742f5118 Oct 12 13:25:07.488031 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-816842689 Oct 12 13:25:07.488031 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,admin,reader Oct 12 13:25:07.488031 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,admin,reader Oct 12 13:25:07.490730 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f077c4b041d428faabd74b4742f5118"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f077c4b041d428faabd74b4742f5118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f077c4b041d428faabd74b4742f5118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f077c4b041d428faabd74b4742f5118"}]}] Oct 12 13:25:07.490730 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-816842689 Oct 12 13:25:07.490730 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 9f077c4b041d428faabd74b4742f5118 Oct 12 13:25:07.490730 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-816842689 Oct 12 13:25:07.490730 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-UnshelveToHostMultiNodesTest-816842689-project-admin Oct 12 13:25:07.490730 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:25:07.490730 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:25:07.490730 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: cf924318fd394c55999174603112019b Oct 12 13:25:07.490730 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-816842689-project-admin Oct 12 13:25:07.490730 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:25:07.490730 n-d-861076-2 devstack@n-api.service[120932]: {"unshelve": {"host": "n-h1-861076-2"}} Oct 12 13:25:07.490730 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:25:07.493959 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:07.493959 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:25:07.493959 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b', 'body': {'unshelve': {'host': 'n-h1-861076-2'}}} Oct 12 13:25:07.493959 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:07.493959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:07.493959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:07.493959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:07.493959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:07.493959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:07.493959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:07.493959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:07.493959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 12 13:25:07.493959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 12 13:25:07.493959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 12 13:25:07.493959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 12 13:25:07.493959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 12 13:25:07.493959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 12 13:25:07.493959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:25:07.493959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:25:07.496521 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:25:07.496521 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:25:07.496521 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:25:07.496521 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:25:07.496521 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:07.496521 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:07.496521 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:25:07.496521 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:25:07.496521 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:07.496521 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:07.496521 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:25:07.496521 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:25:07.496521 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:07.496521 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:07.496521 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:25:07.496521 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:25:07.496521 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:07.496521 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:07.510628 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:25:07.510628 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:25:07.510628 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:25:07.510628 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:25:07.510628 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:25:07.510628 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:25:07.510628 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:25:07.510628 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:25:07.510628 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:25:07.510628 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:25:07.510628 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:25:07.510628 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:25:07.510628 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:25:07.510628 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:25:07.510628 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:25:07.510628 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:25:07.512124 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:25:07.512124 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:25:07.512124 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:25:07.512124 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:25:07.512124 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:25:07.512124 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:25:07.512124 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:25:07.512124 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:25:07.512124 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:25:07.512124 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:25:07.512124 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a412418c-a654-44f3-8f53-cac49fd60592) Oct 12 13:25:07.512124 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:07.512124 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:07.512124 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:07.512124 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:07.512124 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:07.512124 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:07.513938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:07.513938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:07.513938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:25:07.513938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:25:07.513938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:07.513938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:07.513938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:07.513938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:07.513938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:07.513938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:07.513938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:07.513938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:07.513938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:07.513938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:07.513938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:07.513938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:07.513938 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:07.516065 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d28c4880-5464-4c88-8dc1-bd57d562cda2 tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:07.516065 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:07.516065 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d28c4880-5464-4c88-8dc1-bd57d562cda2 tempest-UnshelveToHostMultiNodesTest-816842689 tempest-UnshelveToHostMultiNodesTest-816842689-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b/action" status: 500 len: 214 microversion: 2.91 time: 0.173035 Oct 12 13:25:07.516065 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 416/879] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Oct 12 13:25:07 2022] POST /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b/action => generated 214 bytes in 174 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Oct 12 13:25:07.516065 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-41ec8bff-128f-4a54-a304-521ea698b62f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:07.516065 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-41ec8bff-128f-4a54-a304-521ea698b62f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:07.516987 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-41ec8bff-128f-4a54-a304-521ea698b62f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:07.516987 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-41ec8bff-128f-4a54-a304-521ea698b62f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:07.516987 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-41ec8bff-128f-4a54-a304-521ea698b62f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:07.516987 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-41ec8bff-128f-4a54-a304-521ea698b62f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:07.517545 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-41ec8bff-128f-4a54-a304-521ea698b62f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:07.518160 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-ceaf6c84-828d-42f9-b852-7769bfe46494 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:07.523096 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-41ec8bff-128f-4a54-a304-521ea698b62f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:07.526342 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ceaf6c84-828d-42f9-b852-7769bfe46494 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1216 microversion: 2.1 time: 0.077721 Oct 12 13:25:07.527114 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 464/880] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:07 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1216 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:07.563463 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-41ec8bff-128f-4a54-a304-521ea698b62f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:25:07.569690 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.compute.api [None req-41ec8bff-128f-4a54-a304-521ea698b62f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Working on deleting snapshot 4b900aff-fa1f-4f84-b073-a7784fcd47e7 from shelved instance... Oct 12 13:25:08.274587 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1d3e2425-5d33-4469-bb9e-555cabdab02a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:08.275212 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-1d3e2425-5d33-4469-bb9e-555cabdab02a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:08.282155 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d3e2425-5d33-4469-bb9e-555cabdab02a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:08.283199 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d3e2425-5d33-4469-bb9e-555cabdab02a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:08.283199 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d3e2425-5d33-4469-bb9e-555cabdab02a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:08.283782 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d3e2425-5d33-4469-bb9e-555cabdab02a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:08.284240 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d3e2425-5d33-4469-bb9e-555cabdab02a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:08.284674 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d3e2425-5d33-4469-bb9e-555cabdab02a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:08.322726 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d3e2425-5d33-4469-bb9e-555cabdab02a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:08.323316 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d3e2425-5d33-4469-bb9e-555cabdab02a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:08.323817 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1d3e2425-5d33-4469-bb9e-555cabdab02a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:08.324362 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-1d3e2425-5d33-4469-bb9e-555cabdab02a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lazy-loading 'fault' on Instance uuid d144e260-baa1-4006-9e14-31be90b931ed {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:25:08.446111 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-1d3e2425-5d33-4469-bb9e-555cabdab02a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:08.454310 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1d3e2425-5d33-4469-bb9e-555cabdab02a tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 200 len: 1459 microversion: 2.1 time: 0.183710 Oct 12 13:25:08.455017 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 465/881] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:08 2022] GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 1459 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:25:08.459399 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c909a4ef-4c9b-4851-9698-49b8a000a0eb tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa017bca0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:08.502730 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c909a4ef-4c9b-4851-9698-49b8a000a0eb tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.046773 Oct 12 13:25:08.503531 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 466/882] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:08 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:08.511820 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a70648a5-2ee2-4a86-9851-92a7b51edd9f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:08.511820 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a70648a5-2ee2-4a86-9851-92a7b51edd9f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:08.514732 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a70648a5-2ee2-4a86-9851-92a7b51edd9f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:08.515215 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a70648a5-2ee2-4a86-9851-92a7b51edd9f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:08.515653 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a70648a5-2ee2-4a86-9851-92a7b51edd9f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:08.516431 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a70648a5-2ee2-4a86-9851-92a7b51edd9f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:08.516891 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a70648a5-2ee2-4a86-9851-92a7b51edd9f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:08.517334 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a70648a5-2ee2-4a86-9851-92a7b51edd9f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:08.577222 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a70648a5-2ee2-4a86-9851-92a7b51edd9f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:08.584683 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a70648a5-2ee2-4a86-9851-92a7b51edd9f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1226 microversion: 2.1 time: 0.080293 Oct 12 13:25:08.585278 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 467/883] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:08 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:08.589763 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1b955cc5-4fbb-4b90-90c8-668ca70c6264 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:08.590366 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-1b955cc5-4fbb-4b90-90c8-668ca70c6264 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:08.595929 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1b955cc5-4fbb-4b90-90c8-668ca70c6264 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:08.615386 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1b955cc5-4fbb-4b90-90c8-668ca70c6264 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:08.615386 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1b955cc5-4fbb-4b90-90c8-668ca70c6264 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:08.615386 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1b955cc5-4fbb-4b90-90c8-668ca70c6264 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:08.615386 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1b955cc5-4fbb-4b90-90c8-668ca70c6264 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:08.615785 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1b955cc5-4fbb-4b90-90c8-668ca70c6264 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:08.659534 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-1b955cc5-4fbb-4b90-90c8-668ca70c6264 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:08.667295 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1b955cc5-4fbb-4b90-90c8-668ca70c6264 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1220 microversion: 2.1 time: 0.081087 Oct 12 13:25:08.667858 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 468/884] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:08 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:09.121427 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-1f874ce4-55d1-43a3-83f5-13bb9eb13362 req-99df67f9-d42a-4015-a384-43778be2ef7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb212be-202b-4e4d-993a-80dfa753aa9d", "name": "network-vif-plugged", "status": "completed", "tag": "59a191b0-d550-4432-be96-95cccb474ded"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:09.121427 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-1f874ce4-55d1-43a3-83f5-13bb9eb13362 req-99df67f9-d42a-4015-a384-43778be2ef7b service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:09.121427 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-1f874ce4-55d1-43a3-83f5-13bb9eb13362 req-99df67f9-d42a-4015-a384-43778be2ef7b service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:09.121427 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-1f874ce4-55d1-43a3-83f5-13bb9eb13362 req-99df67f9-d42a-4015-a384-43778be2ef7b service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:09.121807 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-1f874ce4-55d1-43a3-83f5-13bb9eb13362 req-99df67f9-d42a-4015-a384-43778be2ef7b service nova] Creating event network-vif-plugged:59a191b0-d550-4432-be96-95cccb474ded for instance 5fb212be-202b-4e4d-993a-80dfa753aa9d on n-h2-861076-2 Oct 12 13:25:09.123041 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-1f874ce4-55d1-43a3-83f5-13bb9eb13362 req-99df67f9-d42a-4015-a384-43778be2ef7b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031394 Oct 12 13:25:09.123655 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 469/885] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:25:09.482811 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fd84e63b-2700-4b01-b89b-76a82996798d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:09.483614 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-fd84e63b-2700-4b01-b89b-76a82996798d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:09.489825 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fd84e63b-2700-4b01-b89b-76a82996798d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:09.490311 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fd84e63b-2700-4b01-b89b-76a82996798d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:09.490883 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fd84e63b-2700-4b01-b89b-76a82996798d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:09.494352 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fd84e63b-2700-4b01-b89b-76a82996798d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:09.495059 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fd84e63b-2700-4b01-b89b-76a82996798d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:09.508509 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fd84e63b-2700-4b01-b89b-76a82996798d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:09.555140 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fd84e63b-2700-4b01-b89b-76a82996798d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:09.555636 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fd84e63b-2700-4b01-b89b-76a82996798d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:09.556068 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fd84e63b-2700-4b01-b89b-76a82996798d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:09.556524 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-fd84e63b-2700-4b01-b89b-76a82996798d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lazy-loading 'fault' on Instance uuid d144e260-baa1-4006-9e14-31be90b931ed {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:25:09.741333 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-fd84e63b-2700-4b01-b89b-76a82996798d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:09.762485 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fd84e63b-2700-4b01-b89b-76a82996798d tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 200 len: 1459 microversion: 2.1 time: 0.277702 Oct 12 13:25:09.767334 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 470/886] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:09 2022] GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 1459 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:25:09.780673 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-19be112f-32b9-47c8-bc63-714130b308df tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa01d6940>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:09.849458 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-19be112f-32b9-47c8-bc63-714130b308df tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.080858 Oct 12 13:25:09.850330 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 471/887] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:09 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:09.857289 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3080bfa4-fab5-4d82-9b71-69b104e740e5 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:09.858232 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-3080bfa4-fab5-4d82-9b71-69b104e740e5 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:09.866324 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3080bfa4-fab5-4d82-9b71-69b104e740e5 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:09.867029 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3080bfa4-fab5-4d82-9b71-69b104e740e5 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:09.867891 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3080bfa4-fab5-4d82-9b71-69b104e740e5 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:09.871726 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3080bfa4-fab5-4d82-9b71-69b104e740e5 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:09.871726 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3080bfa4-fab5-4d82-9b71-69b104e740e5 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:09.871726 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3080bfa4-fab5-4d82-9b71-69b104e740e5 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:09.941497 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-3080bfa4-fab5-4d82-9b71-69b104e740e5 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:09.949890 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3080bfa4-fab5-4d82-9b71-69b104e740e5 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1274 microversion: 2.1 time: 0.097644 Oct 12 13:25:09.950461 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 472/888] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:09 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1274 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:09.955133 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0f52c054-6255-4a45-9a1b-713c3b418fe6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:09.955733 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-0f52c054-6255-4a45-9a1b-713c3b418fe6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:09.967708 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0f52c054-6255-4a45-9a1b-713c3b418fe6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:09.968187 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0f52c054-6255-4a45-9a1b-713c3b418fe6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:09.968620 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0f52c054-6255-4a45-9a1b-713c3b418fe6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:09.969353 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0f52c054-6255-4a45-9a1b-713c3b418fe6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:09.969801 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0f52c054-6255-4a45-9a1b-713c3b418fe6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:09.970221 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0f52c054-6255-4a45-9a1b-713c3b418fe6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:10.033685 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-0f52c054-6255-4a45-9a1b-713c3b418fe6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:10.042331 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0f52c054-6255-4a45-9a1b-713c3b418fe6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1212 microversion: 2.1 time: 0.090771 Oct 12 13:25:10.042924 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 473/889] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:09 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1212 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:10.144853 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-c714884e-cc8e-4ddb-a50c-9f31520ca075 req-7e2ff0c6-5f9f-4be7-b556-fa919a1e3a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d144e260-baa1-4006-9e14-31be90b931ed", "name": "network-vif-deleted", "tag": "3cf7861f-e727-4460-a639-40684297cc11"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:10.165989 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-c714884e-cc8e-4ddb-a50c-9f31520ca075 req-7e2ff0c6-5f9f-4be7-b556-fa919a1e3a90 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:10.166844 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-c714884e-cc8e-4ddb-a50c-9f31520ca075 req-7e2ff0c6-5f9f-4be7-b556-fa919a1e3a90 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:10.167860 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-c714884e-cc8e-4ddb-a50c-9f31520ca075 req-7e2ff0c6-5f9f-4be7-b556-fa919a1e3a90 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:10.181520 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-c714884e-cc8e-4ddb-a50c-9f31520ca075 req-7e2ff0c6-5f9f-4be7-b556-fa919a1e3a90 service nova] Creating event network-vif-deleted:3cf7861f-e727-4460-a639-40684297cc11 for instance d144e260-baa1-4006-9e14-31be90b931ed on n-h2-861076-2 Oct 12 13:25:10.190641 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-c714884e-cc8e-4ddb-a50c-9f31520ca075 req-7e2ff0c6-5f9f-4be7-b556-fa919a1e3a90 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048992 Oct 12 13:25:10.191489 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 474/890] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:10.795846 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8ceca097-c6ce-4c58-a380-28f18f19efef tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:10.796936 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-8ceca097-c6ce-4c58-a380-28f18f19efef tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:10.804324 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8ceca097-c6ce-4c58-a380-28f18f19efef tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:10.804811 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8ceca097-c6ce-4c58-a380-28f18f19efef tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:10.806079 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8ceca097-c6ce-4c58-a380-28f18f19efef tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:10.806079 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8ceca097-c6ce-4c58-a380-28f18f19efef tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:10.806414 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8ceca097-c6ce-4c58-a380-28f18f19efef tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:10.807518 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8ceca097-c6ce-4c58-a380-28f18f19efef tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:10.840201 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-41ec8bff-128f-4a54-a304-521ea698b62f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Doing local delete in cell c7d37a9d-54da-4741-8e88-e51a0f3ae3d5(cell1) {{(pid=120932) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 12 13:25:10.842315 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-41ec8bff-128f-4a54-a304-521ea698b62f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:10.843161 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-41ec8bff-128f-4a54-a304-521ea698b62f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:10.844832 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-41ec8bff-128f-4a54-a304-521ea698b62f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:10.847758 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.compute.api [None req-41ec8bff-128f-4a54-a304-521ea698b62f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 12 13:25:10.852402 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-41ec8bff-128f-4a54-a304-521ea698b62f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] deallocate_for_instance() {{(pid=120932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 12 13:25:10.875025 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8ceca097-c6ce-4c58-a380-28f18f19efef tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:10.875514 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8ceca097-c6ce-4c58-a380-28f18f19efef tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:10.875953 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8ceca097-c6ce-4c58-a380-28f18f19efef tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:10.886890 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-8ceca097-c6ce-4c58-a380-28f18f19efef tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lazy-loading 'fault' on Instance uuid d144e260-baa1-4006-9e14-31be90b931ed {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:25:10.914307 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-41ec8bff-128f-4a54-a304-521ea698b62f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Instance cache missing network info. {{(pid=120932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3300}} Oct 12 13:25:10.943433 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-41ec8bff-128f-4a54-a304-521ea698b62f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Updating instance_info_cache with network_info: [] {{(pid=120932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 13:25:10.954879 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:25:10.960720 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-8ceca097-c6ce-4c58-a380-28f18f19efef tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:10.974929 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-8ceca097-c6ce-4c58-a380-28f18f19efef tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 200 len: 1288 microversion: 2.1 time: 0.186102 Oct 12 13:25:10.978526 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 475/891] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:10 2022] GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 1288 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:25:10.985638 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-29a11bfd-5e35-48c4-b0b1-75696984fff2 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa0321670>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:11.033472 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-29a11bfd-5e35-48c4-b0b1-75696984fff2 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.053774 Oct 12 13:25:11.034039 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 476/892] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:10 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:11.038568 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0e2f7ad1-3c3d-4a08-bcba-282cdeb978e9 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:11.039104 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-0e2f7ad1-3c3d-4a08-bcba-282cdeb978e9 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:11.045862 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0e2f7ad1-3c3d-4a08-bcba-282cdeb978e9 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:11.046347 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0e2f7ad1-3c3d-4a08-bcba-282cdeb978e9 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:11.048866 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0e2f7ad1-3c3d-4a08-bcba-282cdeb978e9 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:11.049692 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0e2f7ad1-3c3d-4a08-bcba-282cdeb978e9 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:11.050172 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0e2f7ad1-3c3d-4a08-bcba-282cdeb978e9 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:11.050599 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0e2f7ad1-3c3d-4a08-bcba-282cdeb978e9 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:11.182298 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-0e2f7ad1-3c3d-4a08-bcba-282cdeb978e9 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:11.198935 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0e2f7ad1-3c3d-4a08-bcba-282cdeb978e9 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1274 microversion: 2.1 time: 0.163835 Oct 12 13:25:11.200390 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 477/893] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:11 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1274 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:11.206102 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f738521c-6cce-4052-a111-7026e7cddd9a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:11.207553 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f738521c-6cce-4052-a111-7026e7cddd9a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:11.214457 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f738521c-6cce-4052-a111-7026e7cddd9a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:11.215128 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f738521c-6cce-4052-a111-7026e7cddd9a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:11.215973 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f738521c-6cce-4052-a111-7026e7cddd9a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:11.216569 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f738521c-6cce-4052-a111-7026e7cddd9a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:11.217610 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f738521c-6cce-4052-a111-7026e7cddd9a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:11.218045 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f738521c-6cce-4052-a111-7026e7cddd9a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:11.374620 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f738521c-6cce-4052-a111-7026e7cddd9a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:11.404507 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f738521c-6cce-4052-a111-7026e7cddd9a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1268 microversion: 2.1 time: 0.202971 Oct 12 13:25:11.423800 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 478/894] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:11 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1268 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:11.768173 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-41ec8bff-128f-4a54-a304-521ea698b62f tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 204 len: 0 microversion: 2.91 time: 4.266213 Oct 12 13:25:11.769453 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 417/895] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 12 13:25:07 2022] DELETE /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 0 bytes in 4268 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 12 13:25:11.778397 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7a787cef-5aaf-44d7-b9f1-c948b4e7f214 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:11.779005 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7a787cef-5aaf-44d7-b9f1-c948b4e7f214 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] [instance: 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:11.789385 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7a787cef-5aaf-44d7-b9f1-c948b4e7f214 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:11.790595 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7a787cef-5aaf-44d7-b9f1-c948b4e7f214 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:11.793459 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7a787cef-5aaf-44d7-b9f1-c948b4e7f214 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:11.794389 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7a787cef-5aaf-44d7-b9f1-c948b4e7f214 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:11.795948 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7a787cef-5aaf-44d7-b9f1-c948b4e7f214 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:11.801249 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7a787cef-5aaf-44d7-b9f1-c948b4e7f214 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:11.834303 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-7a787cef-5aaf-44d7-b9f1-c948b4e7f214 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] HTTP exception thrown: Instance 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b could not be found. Oct 12 13:25:11.840482 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7a787cef-5aaf-44d7-b9f1-c948b4e7f214 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Request method failure captured: Oct 12 13:25:11.840482 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b HTTP/1.1 Oct 12 13:25:11.840482 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:25:11.840482 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:25:11.840482 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:25:11.840482 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:25:11.840482 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:25:11.840482 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:25:11.840482 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:25:11.840482 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:11.840482 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr_oFeOqaHCGXOdSa_zTJYTphF-QO_MLfg5myOy77LhILZ-jwlwzIkkxe3lM2BA89U7clWV0BlKrNSQFS7kOkYwLz8OSyGXZB9Hv71ZtK2HylY9JyQhn4NdL-tGx-4PylB6-TI9zXhvlfDHJfAMXIfsWvINQzCiVpmypLU5P481tBxc Oct 12 13:25:11.840482 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:25:11.840482 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:25:11.840482 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:25:11.840482 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:25:11.840482 n-d-861076-2 devstack@n-api.service[120933]: X-Openstack-Nova-Api-Version: 2.91 Oct 12 13:25:11.840482 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:25:11.840482 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:25:11.840482 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 5273399261154672b801633e535ee5e7 Oct 12 13:25:11.840482 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1402879014 Oct 12 13:25:11.840482 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:25:11.840482 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:25:11.842207 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5273399261154672b801633e535ee5e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5273399261154672b801633e535ee5e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5273399261154672b801633e535ee5e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5273399261154672b801633e535ee5e7"}]}] Oct 12 13:25:11.842207 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1402879014 Oct 12 13:25:11.842207 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 5273399261154672b801633e535ee5e7 Oct 12 13:25:11.842207 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1402879014 Oct 12 13:25:11.842207 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-UnshelveToHostMultiNodesTest-1402879014-project Oct 12 13:25:11.842207 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:25:11.842207 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:25:11.842207 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 71c81ca6d9a04eceaf753a9e5bfcbb84 Oct 12 13:25:11.842207 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1402879014-project Oct 12 13:25:11.842207 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:25:11.842207 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b could not be found. Oct 12 13:25:11.842207 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b'} Oct 12 13:25:11.843542 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:11.843542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:11.843542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:25:11.843542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:25:11.843542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:25:11.843542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:25:11.843542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:25:11.843542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:25:11.843542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:25:11.843542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:25:11.843542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b could not be found. Oct 12 13:25:11.843542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:11.843542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:11.843542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:11.843542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:11.843542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:11.843542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:11.843542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:11.843542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:11.843542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:11.844702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:11.844702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:25:11.844702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:25:11.844702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:25:11.844702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:25:11.844702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:25:11.844702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:25:11.844702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b could not be found. Oct 12 13:25:11.844702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:11.844702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:11.844702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:11.844702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:11.844702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:11.844702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:11.844702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:11.844702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:11.844702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b could not be found. Oct 12 13:25:11.844702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:11.848184 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7a787cef-5aaf-44d7-b9f1-c948b4e7f214 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] Returning 404 to user: Instance 1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:11.848184 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-7a787cef-5aaf-44d7-b9f1-c948b4e7f214 tempest-UnshelveToHostMultiNodesTest-1402879014 tempest-UnshelveToHostMultiNodesTest-1402879014-project] 10.222.0.52 "GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b" status: 404 len: 111 microversion: 2.91 time: 0.068504 Oct 12 13:25:11.848184 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 479/896] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:25:11 2022] GET /compute/v2.1/servers/1a57fbaa-ed8c-4f43-b59a-06dd805a9f7b => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:25:12.000760 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-949dd48f-ab75-4a99-aeeb-6ab4d0180872 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:12.001759 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-949dd48f-ab75-4a99-aeeb-6ab4d0180872 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:12.008254 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-949dd48f-ab75-4a99-aeeb-6ab4d0180872 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:12.008863 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-949dd48f-ab75-4a99-aeeb-6ab4d0180872 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:12.010578 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-949dd48f-ab75-4a99-aeeb-6ab4d0180872 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:12.011731 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-949dd48f-ab75-4a99-aeeb-6ab4d0180872 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:12.012307 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-949dd48f-ab75-4a99-aeeb-6ab4d0180872 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:12.012853 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-949dd48f-ab75-4a99-aeeb-6ab4d0180872 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:12.049728 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ef7d5a2e-68ec-4274-8331-97febcfba4ed tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa038ca60>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:12.049929 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-949dd48f-ab75-4a99-aeeb-6ab4d0180872 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:12.050413 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-949dd48f-ab75-4a99-aeeb-6ab4d0180872 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:12.050955 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-949dd48f-ab75-4a99-aeeb-6ab4d0180872 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:12.051558 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-949dd48f-ab75-4a99-aeeb-6ab4d0180872 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lazy-loading 'fault' on Instance uuid d144e260-baa1-4006-9e14-31be90b931ed {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:25:12.159801 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ef7d5a2e-68ec-4274-8331-97febcfba4ed tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.114557 Oct 12 13:25:12.170815 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 480/897] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:12 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:12.222078 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-dcc81596-0d5c-46c4-98cc-bf265627dc89 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:12.223834 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-dcc81596-0d5c-46c4-98cc-bf265627dc89 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:12.228031 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-949dd48f-ab75-4a99-aeeb-6ab4d0180872 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:12.236516 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dcc81596-0d5c-46c4-98cc-bf265627dc89 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:12.239870 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dcc81596-0d5c-46c4-98cc-bf265627dc89 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:12.240343 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dcc81596-0d5c-46c4-98cc-bf265627dc89 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:12.242324 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dcc81596-0d5c-46c4-98cc-bf265627dc89 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:12.243006 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dcc81596-0d5c-46c4-98cc-bf265627dc89 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:12.243136 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-949dd48f-ab75-4a99-aeeb-6ab4d0180872 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 200 len: 1310 microversion: 2.1 time: 0.246661 Oct 12 13:25:12.243454 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dcc81596-0d5c-46c4-98cc-bf265627dc89 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:12.263127 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 418/898] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:11 2022] GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 1310 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:12.453871 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-68b52da8-42c5-4baa-8558-f8fb98ce3fb3 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:12.454479 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-68b52da8-42c5-4baa-8558-f8fb98ce3fb3 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:12.490906 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-68b52da8-42c5-4baa-8558-f8fb98ce3fb3 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:12.492801 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-68b52da8-42c5-4baa-8558-f8fb98ce3fb3 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:12.502159 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-68b52da8-42c5-4baa-8558-f8fb98ce3fb3 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:12.504470 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-68b52da8-42c5-4baa-8558-f8fb98ce3fb3 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:12.505920 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-68b52da8-42c5-4baa-8558-f8fb98ce3fb3 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:12.507625 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-68b52da8-42c5-4baa-8558-f8fb98ce3fb3 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:12.815482 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-dcc81596-0d5c-46c4-98cc-bf265627dc89 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:12.828399 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-dcc81596-0d5c-46c4-98cc-bf265627dc89 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1280 microversion: 2.1 time: 0.611128 Oct 12 13:25:12.830305 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 481/899] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:12 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1280 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:12.904787 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-68b52da8-42c5-4baa-8558-f8fb98ce3fb3 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:12.917758 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-68b52da8-42c5-4baa-8558-f8fb98ce3fb3 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1276 microversion: 2.1 time: 0.467644 Oct 12 13:25:12.921334 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 419/900] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:12 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1276 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:13.176133 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-82899c50-5f7f-4965-a739-3b91033179cc tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa017b280>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:13.275671 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-82899c50-5f7f-4965-a739-3b91033179cc tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.103662 Oct 12 13:25:13.276049 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2d16921b-5731-4073-b872-95634f6b6a6c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:13.277548 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2d16921b-5731-4073-b872-95634f6b6a6c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:13.280693 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:25:13.282526 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 482/901] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:13 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:13.298447 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2d16921b-5731-4073-b872-95634f6b6a6c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:13.302078 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2d16921b-5731-4073-b872-95634f6b6a6c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:13.302619 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2d16921b-5731-4073-b872-95634f6b6a6c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:13.303442 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2d16921b-5731-4073-b872-95634f6b6a6c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:13.313626 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2d16921b-5731-4073-b872-95634f6b6a6c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:13.314198 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2d16921b-5731-4073-b872-95634f6b6a6c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:13.380092 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2d16921b-5731-4073-b872-95634f6b6a6c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:13.387184 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2d16921b-5731-4073-b872-95634f6b6a6c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:13.387184 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2d16921b-5731-4073-b872-95634f6b6a6c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:13.387184 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-2d16921b-5731-4073-b872-95634f6b6a6c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lazy-loading 'fault' on Instance uuid d144e260-baa1-4006-9e14-31be90b931ed {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:25:13.437601 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:25:13.526799 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-2d16921b-5731-4073-b872-95634f6b6a6c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685195d760b9401685e9017725fe9d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6244b389164297b219fa7356b46ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:13.542340 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2d16921b-5731-4073-b872-95634f6b6a6c tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 200 len: 1310 microversion: 2.1 time: 0.270852 Oct 12 13:25:13.544322 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 420/902] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:13 2022] GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 1310 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:25:13.778783 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-11ad2a1e-d9c0-4423-8ae3-58ca4d46702f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-331322012", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:13.866658 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-92821e46-1021-49ad-8503-9b913a8f6517 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:13.867302 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-92821e46-1021-49ad-8503-9b913a8f6517 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:13.877512 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92821e46-1021-49ad-8503-9b913a8f6517 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:13.878014 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92821e46-1021-49ad-8503-9b913a8f6517 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:13.878462 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92821e46-1021-49ad-8503-9b913a8f6517 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:13.879174 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92821e46-1021-49ad-8503-9b913a8f6517 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:13.879635 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92821e46-1021-49ad-8503-9b913a8f6517 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:13.880067 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92821e46-1021-49ad-8503-9b913a8f6517 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:13.899876 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-11ad2a1e-d9c0-4423-8ae3-58ca4d46702f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] validate_networks() for None {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:25:15.366847 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-92821e46-1021-49ad-8503-9b913a8f6517 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:15.384340 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-92821e46-1021-49ad-8503-9b913a8f6517 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1322 microversion: 2.1 time: 1.524982 Oct 12 13:25:15.405113 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 421/903] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:13 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1322 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:25:15.418369 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-efd4ddb6-d93f-423b-a45c-601c4c69d758 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:15.422405 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-efd4ddb6-d93f-423b-a45c-601c4c69d758 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:15.440799 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-efd4ddb6-d93f-423b-a45c-601c4c69d758 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:15.441712 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-efd4ddb6-d93f-423b-a45c-601c4c69d758 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:15.442407 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-efd4ddb6-d93f-423b-a45c-601c4c69d758 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:15.445590 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-efd4ddb6-d93f-423b-a45c-601c4c69d758 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:15.445590 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-efd4ddb6-d93f-423b-a45c-601c4c69d758 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:15.445590 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-efd4ddb6-d93f-423b-a45c-601c4c69d758 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:15.974056 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-efd4ddb6-d93f-423b-a45c-601c4c69d758 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:15.981432 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:25:15.987190 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-11ad2a1e-d9c0-4423-8ae3-58ca4d46702f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:25:15.988222 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-11ad2a1e-d9c0-4423-8ae3-58ca4d46702f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:25:15.988882 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-11ad2a1e-d9c0-4423-8ae3-58ca4d46702f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:25:15.990868 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-11ad2a1e-d9c0-4423-8ae3-58ca4d46702f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:25:15.991716 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-11ad2a1e-d9c0-4423-8ae3-58ca4d46702f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:25:16.015791 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-efd4ddb6-d93f-423b-a45c-601c4c69d758 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1274 microversion: 2.1 time: 0.606990 Oct 12 13:25:16.038608 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 422/904] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:15 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1274 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:16.047199 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-11ad2a1e-d9c0-4423-8ae3-58ca4d46702f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:16.049022 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-11ad2a1e-d9c0-4423-8ae3-58ca4d46702f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:16.054421 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-11ad2a1e-d9c0-4423-8ae3-58ca4d46702f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:16.056729 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-11ad2a1e-d9c0-4423-8ae3-58ca4d46702f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:16.058548 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-28ab8f16-a7de-46d0-bd3f-e083554889df tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa0512310>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:16.061009 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-11ad2a1e-d9c0-4423-8ae3-58ca4d46702f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:16.062800 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-11ad2a1e-d9c0-4423-8ae3-58ca4d46702f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:16.108004 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-11ad2a1e-d9c0-4423-8ae3-58ca4d46702f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Getting quotas for project 36da01f1b35e43be9c4a96d6cc118d70. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:25:16.115183 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-11ad2a1e-d9c0-4423-8ae3-58ca4d46702f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Getting quotas for user d19a5a43471b49fc9dac1aa301c50d08 and project 36da01f1b35e43be9c4a96d6cc118d70. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:25:16.135539 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-11ad2a1e-d9c0-4423-8ae3-58ca4d46702f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Going to run 1 instances... {{(pid=120933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:25:16.139352 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-11ad2a1e-d9c0-4423-8ae3-58ca4d46702f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] [instance: 182dba37-e456-46a8-8ee6-255a657bcd6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:25:16.176119 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-28ab8f16-a7de-46d0-bd3f-e083554889df tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.130587 Oct 12 13:25:16.181357 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 423/905] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:16 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:16.199563 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-694a7651-715f-4f8d-9d1d-8ee03f4bcce5 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:16.201746 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-694a7651-715f-4f8d-9d1d-8ee03f4bcce5 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:16.217126 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-694a7651-715f-4f8d-9d1d-8ee03f4bcce5 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:16.218343 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-694a7651-715f-4f8d-9d1d-8ee03f4bcce5 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:16.221303 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-694a7651-715f-4f8d-9d1d-8ee03f4bcce5 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:16.222862 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-694a7651-715f-4f8d-9d1d-8ee03f4bcce5 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:16.226144 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-694a7651-715f-4f8d-9d1d-8ee03f4bcce5 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:16.226854 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-694a7651-715f-4f8d-9d1d-8ee03f4bcce5 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:16.257427 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-694a7651-715f-4f8d-9d1d-8ee03f4bcce5 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] HTTP exception thrown: Instance d144e260-baa1-4006-9e14-31be90b931ed could not be found. Oct 12 13:25:16.259462 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-694a7651-715f-4f8d-9d1d-8ee03f4bcce5 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Request method failure captured: Oct 12 13:25:16.259462 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed HTTP/1.1 Oct 12 13:25:16.259462 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:25:16.259462 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:25:16.259462 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:25:16.259462 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:25:16.259462 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:25:16.259462 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:25:16.259462 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:25:16.259462 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:16.259462 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr_fvJoyTSs7WO2_Iw4uP0Z2_F14g2aLvTYWrc1RYensHajPuwGcg78PGS8UDkSPy4-UNg6TtCQ8p6g0i3jwwtlSd0ytnvWOHoyn7wKcTqsjYeQzwoNDLc3DamDRHuirUh7j0tKaXDk4jkZqifo90H26Dxvn3J4935xRkSF6t7PmkfU Oct 12 13:25:16.259462 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:25:16.259462 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:25:16.259462 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:25:16.259462 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:25:16.259462 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:25:16.259462 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:25:16.259462 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 8a6244b389164297b219fa7356b46ffe Oct 12 13:25:16.259462 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-DeleteServersAdminTestJSON-824206404 Oct 12 13:25:16.259462 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:25:16.259462 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:25:16.260883 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8a6244b389164297b219fa7356b46ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8a6244b389164297b219fa7356b46ffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a6244b389164297b219fa7356b46ffe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a6244b389164297b219fa7356b46ffe"}]}] Oct 12 13:25:16.260883 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-DeleteServersAdminTestJSON-824206404 Oct 12 13:25:16.260883 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 8a6244b389164297b219fa7356b46ffe Oct 12 13:25:16.260883 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-824206404 Oct 12 13:25:16.260883 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-DeleteServersAdminTestJSON-824206404-project Oct 12 13:25:16.260883 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:25:16.260883 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:25:16.260883 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 685195d760b9401685e9017725fe9d0a Oct 12 13:25:16.260883 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-DeleteServersAdminTestJSON-824206404-project Oct 12 13:25:16.260883 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:25:16.260883 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance d144e260-baa1-4006-9e14-31be90b931ed could not be found. Oct 12 13:25:16.260883 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'd144e260-baa1-4006-9e14-31be90b931ed'} Oct 12 13:25:16.261658 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:16.261658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:16.261658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:25:16.261658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:25:16.261658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:25:16.261658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:25:16.261658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:25:16.261658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:25:16.261658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:25:16.261658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:25:16.261658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d144e260-baa1-4006-9e14-31be90b931ed could not be found. Oct 12 13:25:16.261658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:16.261658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:16.261658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:16.261658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:16.261658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:16.261658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:16.261658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:16.261658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:16.261658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:16.262841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:16.262841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:25:16.262841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:25:16.262841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:25:16.262841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:25:16.262841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:25:16.262841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:25:16.262841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d144e260-baa1-4006-9e14-31be90b931ed could not be found. Oct 12 13:25:16.262841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:16.262841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:16.262841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:16.262841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:16.262841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:16.262841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:16.262841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:16.262841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:16.262841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d144e260-baa1-4006-9e14-31be90b931ed could not be found. Oct 12 13:25:16.262841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:16.283930 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-694a7651-715f-4f8d-9d1d-8ee03f4bcce5 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Returning 404 to user: Instance d144e260-baa1-4006-9e14-31be90b931ed could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:16.283930 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-694a7651-715f-4f8d-9d1d-8ee03f4bcce5 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 404 len: 111 microversion: 2.1 time: 0.088774 Oct 12 13:25:16.283930 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 424/906] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:16 2022] GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:25:16.300156 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-125b6439-bf7f-4063-9c3b-87e223c5d0e4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:16.302058 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-125b6439-bf7f-4063-9c3b-87e223c5d0e4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:16.321258 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-125b6439-bf7f-4063-9c3b-87e223c5d0e4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:16.322125 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-125b6439-bf7f-4063-9c3b-87e223c5d0e4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:16.323737 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-125b6439-bf7f-4063-9c3b-87e223c5d0e4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:16.327004 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-125b6439-bf7f-4063-9c3b-87e223c5d0e4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:16.327735 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-125b6439-bf7f-4063-9c3b-87e223c5d0e4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:16.329317 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-125b6439-bf7f-4063-9c3b-87e223c5d0e4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:16.382790 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-125b6439-bf7f-4063-9c3b-87e223c5d0e4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] HTTP exception thrown: Instance d144e260-baa1-4006-9e14-31be90b931ed could not be found. Oct 12 13:25:16.391413 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-125b6439-bf7f-4063-9c3b-87e223c5d0e4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Request method failure captured: Oct 12 13:25:16.391413 n-d-861076-2 devstack@n-api.service[120932]: request: DELETE /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed HTTP/1.1 Oct 12 13:25:16.391413 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:25:16.391413 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:25:16.391413 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:25:16.391413 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:25:16.391413 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:25:16.391413 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:25:16.391413 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:25:16.391413 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:16.391413 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr_fvJoyTSs7WO2_Iw4uP0Z2_F14g2aLvTYWrc1RYensHajPuwGcg78PGS8UDkSPy4-UNg6TtCQ8p6g0i3jwwtlSd0ytnvWOHoyn7wKcTqsjYeQzwoNDLc3DamDRHuirUh7j0tKaXDk4jkZqifo90H26Dxvn3J4935xRkSF6t7PmkfU Oct 12 13:25:16.391413 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:25:16.391413 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:25:16.391413 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:25:16.391413 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:25:16.391413 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:25:16.391413 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:25:16.391413 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 8a6244b389164297b219fa7356b46ffe Oct 12 13:25:16.391413 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-DeleteServersAdminTestJSON-824206404 Oct 12 13:25:16.391413 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:25:16.391413 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:25:16.393033 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8a6244b389164297b219fa7356b46ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8a6244b389164297b219fa7356b46ffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a6244b389164297b219fa7356b46ffe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a6244b389164297b219fa7356b46ffe"}]}] Oct 12 13:25:16.393033 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-DeleteServersAdminTestJSON-824206404 Oct 12 13:25:16.393033 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 8a6244b389164297b219fa7356b46ffe Oct 12 13:25:16.393033 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-824206404 Oct 12 13:25:16.393033 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-DeleteServersAdminTestJSON-824206404-project Oct 12 13:25:16.393033 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:25:16.393033 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:25:16.393033 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 685195d760b9401685e9017725fe9d0a Oct 12 13:25:16.393033 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-DeleteServersAdminTestJSON-824206404-project Oct 12 13:25:16.393033 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:25:16.393033 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance d144e260-baa1-4006-9e14-31be90b931ed could not be found. Oct 12 13:25:16.393033 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'd144e260-baa1-4006-9e14-31be90b931ed'} Oct 12 13:25:16.393879 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:16.393879 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:16.393879 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:25:16.393879 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:25:16.393879 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:25:16.393879 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:25:16.393879 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:25:16.393879 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:25:16.393879 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:25:16.393879 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:25:16.393879 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d144e260-baa1-4006-9e14-31be90b931ed could not be found. Oct 12 13:25:16.393879 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:16.393879 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:16.393879 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:16.393879 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:16.393879 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:16.393879 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:16.393879 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:16.393879 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:16.393879 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:16.395255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:16.395255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 13:25:16.395255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 13:25:16.395255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 13:25:16.395255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 13:25:16.395255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:25:16.395255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:25:16.395255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:25:16.395255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:25:16.395255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d144e260-baa1-4006-9e14-31be90b931ed could not be found. Oct 12 13:25:16.395255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:16.395255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:16.395255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:16.395255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:16.395255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:16.395255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:16.395255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:16.395255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:16.395255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d144e260-baa1-4006-9e14-31be90b931ed could not be found. Oct 12 13:25:16.395255 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:16.403063 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-125b6439-bf7f-4063-9c3b-87e223c5d0e4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Returning 404 to user: Instance d144e260-baa1-4006-9e14-31be90b931ed could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:16.404193 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-125b6439-bf7f-4063-9c3b-87e223c5d0e4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 404 len: 111 microversion: 2.1 time: 0.120292 Oct 12 13:25:16.407744 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 425/907] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:25:16 2022] DELETE /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:25:16.427422 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f342fe7a-eaf5-4abf-8478-e5c1024e87e6 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:16.430646 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f342fe7a-eaf5-4abf-8478-e5c1024e87e6 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:16.446483 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-11ad2a1e-d9c0-4423-8ae3-58ca4d46702f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.009556 Oct 12 13:25:16.451574 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=22 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:25:16.455556 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f342fe7a-eaf5-4abf-8478-e5c1024e87e6 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:16.459777 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 483/908] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:25:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 13:25:16.459952 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f342fe7a-eaf5-4abf-8478-e5c1024e87e6 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:16.471676 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f342fe7a-eaf5-4abf-8478-e5c1024e87e6 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:16.471676 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f342fe7a-eaf5-4abf-8478-e5c1024e87e6 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:16.471676 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f342fe7a-eaf5-4abf-8478-e5c1024e87e6 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:16.471676 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f342fe7a-eaf5-4abf-8478-e5c1024e87e6 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:16.478635 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-42a77e14-4a40-43f7-8fdf-385e73cfc9dc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:16.480585 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-42a77e14-4a40-43f7-8fdf-385e73cfc9dc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: d144e260-baa1-4006-9e14-31be90b931ed] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:16.501792 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42a77e14-4a40-43f7-8fdf-385e73cfc9dc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:16.502674 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42a77e14-4a40-43f7-8fdf-385e73cfc9dc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:16.504510 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42a77e14-4a40-43f7-8fdf-385e73cfc9dc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:16.508027 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42a77e14-4a40-43f7-8fdf-385e73cfc9dc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:16.508830 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42a77e14-4a40-43f7-8fdf-385e73cfc9dc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:16.510351 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42a77e14-4a40-43f7-8fdf-385e73cfc9dc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:16.553962 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-42a77e14-4a40-43f7-8fdf-385e73cfc9dc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] HTTP exception thrown: Instance d144e260-baa1-4006-9e14-31be90b931ed could not be found. Oct 12 13:25:16.559593 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-42a77e14-4a40-43f7-8fdf-385e73cfc9dc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Request method failure captured: Oct 12 13:25:16.559593 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed HTTP/1.1 Oct 12 13:25:16.559593 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:25:16.559593 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:25:16.559593 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:25:16.559593 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:25:16.559593 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:25:16.559593 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:25:16.559593 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:25:16.559593 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:16.559593 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr_fvJoyTSs7WO2_Iw4uP0Z2_F14g2aLvTYWrc1RYensHajPuwGcg78PGS8UDkSPy4-UNg6TtCQ8p6g0i3jwwtlSd0ytnvWOHoyn7wKcTqsjYeQzwoNDLc3DamDRHuirUh7j0tKaXDk4jkZqifo90H26Dxvn3J4935xRkSF6t7PmkfU Oct 12 13:25:16.559593 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:25:16.559593 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:25:16.559593 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:25:16.559593 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:25:16.559593 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:25:16.559593 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:25:16.559593 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 8a6244b389164297b219fa7356b46ffe Oct 12 13:25:16.559593 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-DeleteServersAdminTestJSON-824206404 Oct 12 13:25:16.559593 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:25:16.559593 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:25:16.561235 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8a6244b389164297b219fa7356b46ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8a6244b389164297b219fa7356b46ffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a6244b389164297b219fa7356b46ffe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a6244b389164297b219fa7356b46ffe"}]}] Oct 12 13:25:16.561235 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-DeleteServersAdminTestJSON-824206404 Oct 12 13:25:16.561235 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 8a6244b389164297b219fa7356b46ffe Oct 12 13:25:16.561235 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-824206404 Oct 12 13:25:16.561235 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-DeleteServersAdminTestJSON-824206404-project Oct 12 13:25:16.561235 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:25:16.561235 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:25:16.561235 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 685195d760b9401685e9017725fe9d0a Oct 12 13:25:16.561235 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-DeleteServersAdminTestJSON-824206404-project Oct 12 13:25:16.561235 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:25:16.561235 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance d144e260-baa1-4006-9e14-31be90b931ed could not be found. Oct 12 13:25:16.561235 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'd144e260-baa1-4006-9e14-31be90b931ed'} Oct 12 13:25:16.562109 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:16.562109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:16.562109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:25:16.562109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:25:16.562109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:25:16.562109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:25:16.562109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:25:16.562109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:25:16.562109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:25:16.562109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:25:16.562109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d144e260-baa1-4006-9e14-31be90b931ed could not be found. Oct 12 13:25:16.562109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:16.562109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:16.562109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:16.562109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:16.562109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:16.562109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:16.562109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:16.562109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:16.562109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:16.563357 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:16.563357 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:25:16.563357 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:25:16.563357 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:25:16.563357 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:25:16.563357 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:25:16.563357 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:25:16.563357 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d144e260-baa1-4006-9e14-31be90b931ed could not be found. Oct 12 13:25:16.563357 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:16.563357 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:16.563357 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:16.563357 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:16.563357 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:16.563357 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:16.563357 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:16.563357 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:16.563357 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d144e260-baa1-4006-9e14-31be90b931ed could not be found. Oct 12 13:25:16.563357 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:16.566697 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-42a77e14-4a40-43f7-8fdf-385e73cfc9dc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Returning 404 to user: Instance d144e260-baa1-4006-9e14-31be90b931ed could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:16.568285 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-42a77e14-4a40-43f7-8fdf-385e73cfc9dc tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed" status: 404 len: 111 microversion: 2.1 time: 0.105931 Oct 12 13:25:16.573810 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 484/909] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:16 2022] GET /compute/v2.1/servers/d144e260-baa1-4006-9e14-31be90b931ed => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:25:16.587825 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9f1e3ea0-5a55-4d96-ae90-718904781c6c tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:16.590007 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-9f1e3ea0-5a55-4d96-ae90-718904781c6c tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] [instance: 182dba37-e456-46a8-8ee6-255a657bcd6b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:17.054470 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9f1e3ea0-5a55-4d96-ae90-718904781c6c tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a5a43471b49fc9dac1aa301c50d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36da01f1b35e43be9c4a96d6cc118d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:17.068667 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9f1e3ea0-5a55-4d96-ae90-718904781c6c tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] 10.222.0.52 "GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b" status: 200 len: 1222 microversion: 2.1 time: 0.491231 Oct 12 13:25:17.069491 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 485/910] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:16 2022] GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b => generated 1222 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:17.121538 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5068bf32-edcc-49ba-925e-f766f9c325c4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:17.123011 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-5068bf32-edcc-49ba-925e-f766f9c325c4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:17.142247 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5068bf32-edcc-49ba-925e-f766f9c325c4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:17.144675 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5068bf32-edcc-49ba-925e-f766f9c325c4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:17.145360 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5068bf32-edcc-49ba-925e-f766f9c325c4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:17.150409 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5068bf32-edcc-49ba-925e-f766f9c325c4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:17.151864 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5068bf32-edcc-49ba-925e-f766f9c325c4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:17.152500 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5068bf32-edcc-49ba-925e-f766f9c325c4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:17.197598 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-5068bf32-edcc-49ba-925e-f766f9c325c4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] HTTP exception thrown: Instance 551f2f8d-4679-4647-a8dd-ece2be8eac33 could not be found. Oct 12 13:25:17.201813 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5068bf32-edcc-49ba-925e-f766f9c325c4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Request method failure captured: Oct 12 13:25:17.201813 n-d-861076-2 devstack@n-api.service[120933]: request: DELETE /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 HTTP/1.1 Oct 12 13:25:17.201813 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:25:17.201813 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:25:17.201813 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:25:17.201813 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:25:17.201813 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:25:17.201813 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:25:17.201813 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:25:17.201813 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:17.201813 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr_fvJoyTSs7WO2_Iw4uP0Z2_F14g2aLvTYWrc1RYensHajPuwGcg78PGS8UDkSPy4-UNg6TtCQ8p6g0i3jwwtlSd0ytnvWOHoyn7wKcTqsjYeQzwoNDLc3DamDRHuirUh7j0tKaXDk4jkZqifo90H26Dxvn3J4935xRkSF6t7PmkfU Oct 12 13:25:17.201813 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:25:17.201813 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:25:17.201813 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:25:17.201813 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:25:17.201813 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:25:17.201813 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:25:17.201813 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 8a6244b389164297b219fa7356b46ffe Oct 12 13:25:17.201813 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-DeleteServersAdminTestJSON-824206404 Oct 12 13:25:17.201813 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:25:17.201813 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:25:17.207151 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8a6244b389164297b219fa7356b46ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8a6244b389164297b219fa7356b46ffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a6244b389164297b219fa7356b46ffe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a6244b389164297b219fa7356b46ffe"}]}] Oct 12 13:25:17.207151 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-DeleteServersAdminTestJSON-824206404 Oct 12 13:25:17.207151 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 8a6244b389164297b219fa7356b46ffe Oct 12 13:25:17.207151 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-824206404 Oct 12 13:25:17.207151 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-DeleteServersAdminTestJSON-824206404-project Oct 12 13:25:17.207151 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:25:17.207151 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:25:17.207151 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 685195d760b9401685e9017725fe9d0a Oct 12 13:25:17.207151 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-DeleteServersAdminTestJSON-824206404-project Oct 12 13:25:17.207151 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:25:17.207151 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance 551f2f8d-4679-4647-a8dd-ece2be8eac33 could not be found. Oct 12 13:25:17.207151 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '551f2f8d-4679-4647-a8dd-ece2be8eac33'} Oct 12 13:25:17.207877 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:17.207877 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:17.207877 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:25:17.207877 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:25:17.207877 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:25:17.207877 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:25:17.207877 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:25:17.207877 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:25:17.207877 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:25:17.207877 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:25:17.207877 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 551f2f8d-4679-4647-a8dd-ece2be8eac33 could not be found. Oct 12 13:25:17.207877 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:17.207877 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:17.207877 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:17.207877 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:17.207877 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:17.207877 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:17.207877 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:17.207877 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:17.207877 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:17.209101 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:17.209101 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 13:25:17.209101 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 13:25:17.209101 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 13:25:17.209101 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 13:25:17.209101 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:25:17.209101 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:25:17.209101 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:25:17.209101 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:25:17.209101 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 551f2f8d-4679-4647-a8dd-ece2be8eac33 could not be found. Oct 12 13:25:17.209101 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:17.209101 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:17.209101 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:17.209101 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:17.209101 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:17.209101 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:17.209101 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:17.209101 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:17.209101 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 551f2f8d-4679-4647-a8dd-ece2be8eac33 could not be found. Oct 12 13:25:17.209101 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:17.210267 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5068bf32-edcc-49ba-925e-f766f9c325c4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Returning 404 to user: Instance 551f2f8d-4679-4647-a8dd-ece2be8eac33 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:17.212618 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5068bf32-edcc-49ba-925e-f766f9c325c4 tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "DELETE /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 404 len: 111 microversion: 2.1 time: 0.114023 Oct 12 13:25:17.216148 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 486/911] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:25:17 2022] DELETE /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:25:17.225380 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-472ecb68-c722-40b0-824f-37bcf9ae8019 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:17.226000 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-472ecb68-c722-40b0-824f-37bcf9ae8019 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:17.239897 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:25:17.251764 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-472ecb68-c722-40b0-824f-37bcf9ae8019 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:17.252704 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-472ecb68-c722-40b0-824f-37bcf9ae8019 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:17.256363 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-472ecb68-c722-40b0-824f-37bcf9ae8019 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:17.256363 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-472ecb68-c722-40b0-824f-37bcf9ae8019 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:17.256363 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-472ecb68-c722-40b0-824f-37bcf9ae8019 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:17.258805 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-472ecb68-c722-40b0-824f-37bcf9ae8019 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:17.316683 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:25:17.763231 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-472ecb68-c722-40b0-824f-37bcf9ae8019 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:17.771330 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-472ecb68-c722-40b0-824f-37bcf9ae8019 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1316 microversion: 2.1 time: 0.555701 Oct 12 13:25:17.777644 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 487/912] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:17 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1316 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:17.782842 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fdbc59b4-7a05-4d68-9173-4e91a5917568 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bf0a790>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:17.840860 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f342fe7a-eaf5-4abf-8478-e5c1024e87e6 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:17.840860 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f342fe7a-eaf5-4abf-8478-e5c1024e87e6 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1322 microversion: 2.1 time: 1.430213 Oct 12 13:25:17.847059 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 426/913] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:16 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1322 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:17.853181 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4efeeab8-78f2-4272-9e8b-1c1eb98622dd tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:17.857742 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-4efeeab8-78f2-4272-9e8b-1c1eb98622dd tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] [instance: 551f2f8d-4679-4647-a8dd-ece2be8eac33] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:17.881328 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4efeeab8-78f2-4272-9e8b-1c1eb98622dd tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:17.882095 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4efeeab8-78f2-4272-9e8b-1c1eb98622dd tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:17.882784 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4efeeab8-78f2-4272-9e8b-1c1eb98622dd tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:17.892085 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fdbc59b4-7a05-4d68-9173-4e91a5917568 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.113228 Oct 12 13:25:17.893044 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 488/914] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:17 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:17.893400 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4efeeab8-78f2-4272-9e8b-1c1eb98622dd tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:17.894230 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4efeeab8-78f2-4272-9e8b-1c1eb98622dd tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:17.900048 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4efeeab8-78f2-4272-9e8b-1c1eb98622dd tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:17.927326 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-4efeeab8-78f2-4272-9e8b-1c1eb98622dd tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] HTTP exception thrown: Instance 551f2f8d-4679-4647-a8dd-ece2be8eac33 could not be found. Oct 12 13:25:17.935359 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4efeeab8-78f2-4272-9e8b-1c1eb98622dd tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Request method failure captured: Oct 12 13:25:17.935359 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 HTTP/1.1 Oct 12 13:25:17.935359 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:25:17.935359 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:25:17.935359 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:25:17.935359 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:25:17.935359 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:25:17.935359 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:25:17.935359 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:25:17.935359 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:17.935359 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr_fvJoyTSs7WO2_Iw4uP0Z2_F14g2aLvTYWrc1RYensHajPuwGcg78PGS8UDkSPy4-UNg6TtCQ8p6g0i3jwwtlSd0ytnvWOHoyn7wKcTqsjYeQzwoNDLc3DamDRHuirUh7j0tKaXDk4jkZqifo90H26Dxvn3J4935xRkSF6t7PmkfU Oct 12 13:25:17.935359 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:25:17.935359 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:25:17.935359 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:25:17.935359 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:25:17.935359 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:25:17.935359 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:25:17.935359 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 8a6244b389164297b219fa7356b46ffe Oct 12 13:25:17.935359 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-DeleteServersAdminTestJSON-824206404 Oct 12 13:25:17.935359 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:25:17.935359 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:25:17.937677 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8a6244b389164297b219fa7356b46ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8a6244b389164297b219fa7356b46ffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a6244b389164297b219fa7356b46ffe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a6244b389164297b219fa7356b46ffe"}]}] Oct 12 13:25:17.937677 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-DeleteServersAdminTestJSON-824206404 Oct 12 13:25:17.937677 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 8a6244b389164297b219fa7356b46ffe Oct 12 13:25:17.937677 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-824206404 Oct 12 13:25:17.937677 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-DeleteServersAdminTestJSON-824206404-project Oct 12 13:25:17.937677 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:25:17.937677 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:25:17.937677 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 685195d760b9401685e9017725fe9d0a Oct 12 13:25:17.937677 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-DeleteServersAdminTestJSON-824206404-project Oct 12 13:25:17.937677 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:25:17.937677 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance 551f2f8d-4679-4647-a8dd-ece2be8eac33 could not be found. Oct 12 13:25:17.937677 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '551f2f8d-4679-4647-a8dd-ece2be8eac33'} Oct 12 13:25:17.938950 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:17.938950 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:17.938950 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:25:17.938950 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:25:17.938950 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:25:17.938950 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:25:17.938950 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:25:17.938950 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:25:17.938950 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:25:17.938950 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:25:17.938950 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 551f2f8d-4679-4647-a8dd-ece2be8eac33 could not be found. Oct 12 13:25:17.938950 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:17.938950 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:17.938950 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:17.938950 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:17.938950 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:17.938950 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:17.938950 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:17.938950 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:17.938950 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:17.940252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:17.940252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:25:17.940252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:25:17.940252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:25:17.940252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:25:17.940252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:25:17.940252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:25:17.940252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 551f2f8d-4679-4647-a8dd-ece2be8eac33 could not be found. Oct 12 13:25:17.940252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:17.940252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:17.940252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:17.940252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:17.940252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:17.940252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:17.940252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:17.940252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:17.940252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 551f2f8d-4679-4647-a8dd-ece2be8eac33 could not be found. Oct 12 13:25:17.940252 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:17.943246 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4efeeab8-78f2-4272-9e8b-1c1eb98622dd tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] Returning 404 to user: Instance 551f2f8d-4679-4647-a8dd-ece2be8eac33 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:17.944379 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4efeeab8-78f2-4272-9e8b-1c1eb98622dd tempest-DeleteServersAdminTestJSON-824206404 tempest-DeleteServersAdminTestJSON-824206404-project] 10.222.0.52 "GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33" status: 404 len: 111 microversion: 2.1 time: 0.095097 Oct 12 13:25:17.945525 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 427/915] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:17 2022] GET /compute/v2.1/servers/551f2f8d-4679-4647-a8dd-ece2be8eac33 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:25:18.098913 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-012c704b-3d40-4d39-bc29-0d9a0844fef6 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:18.101868 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-012c704b-3d40-4d39-bc29-0d9a0844fef6 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] [instance: 182dba37-e456-46a8-8ee6-255a657bcd6b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:18.379871 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-012c704b-3d40-4d39-bc29-0d9a0844fef6 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a5a43471b49fc9dac1aa301c50d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36da01f1b35e43be9c4a96d6cc118d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:18.396957 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-012c704b-3d40-4d39-bc29-0d9a0844fef6 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] 10.222.0.52 "GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b" status: 200 len: 1222 microversion: 2.1 time: 0.302042 Oct 12 13:25:18.401727 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 489/916] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:18 2022] GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b => generated 1222 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:18.810057 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fc314e5e-efc8-4764-98f6-732cf5ebaf9a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:18.810973 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fc314e5e-efc8-4764-98f6-732cf5ebaf9a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:18.833701 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc314e5e-efc8-4764-98f6-732cf5ebaf9a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:18.834275 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc314e5e-efc8-4764-98f6-732cf5ebaf9a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:18.834991 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc314e5e-efc8-4764-98f6-732cf5ebaf9a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:18.839119 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc314e5e-efc8-4764-98f6-732cf5ebaf9a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:18.841128 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc314e5e-efc8-4764-98f6-732cf5ebaf9a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:18.842167 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc314e5e-efc8-4764-98f6-732cf5ebaf9a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:18.868455 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9247ce12-6f16-4cb7-be7f-2f64ef228a14 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:18.868455 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-9247ce12-6f16-4cb7-be7f-2f64ef228a14 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:18.880616 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9247ce12-6f16-4cb7-be7f-2f64ef228a14 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:18.889602 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9247ce12-6f16-4cb7-be7f-2f64ef228a14 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:18.890848 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9247ce12-6f16-4cb7-be7f-2f64ef228a14 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:18.892681 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9247ce12-6f16-4cb7-be7f-2f64ef228a14 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:18.893191 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9247ce12-6f16-4cb7-be7f-2f64ef228a14 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:18.909259 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9247ce12-6f16-4cb7-be7f-2f64ef228a14 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:19.546240 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9247ce12-6f16-4cb7-be7f-2f64ef228a14 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:19.563674 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9247ce12-6f16-4cb7-be7f-2f64ef228a14 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1322 microversion: 2.1 time: 0.701497 Oct 12 13:25:19.565223 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 490/917] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:18 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1322 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:19.582241 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3a2759ed-66a0-48ed-b6f8-0dbe2213269f tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa03f3f70>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:19.657729 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3a2759ed-66a0-48ed-b6f8-0dbe2213269f tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.091093 Oct 12 13:25:19.658399 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 491/918] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:19 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:19.679953 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fa0abecb-c41c-4fda-972b-f25c39b5f44a tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:19.681646 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-fa0abecb-c41c-4fda-972b-f25c39b5f44a tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] [instance: 182dba37-e456-46a8-8ee6-255a657bcd6b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:19.700302 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fa0abecb-c41c-4fda-972b-f25c39b5f44a tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:19.701254 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fa0abecb-c41c-4fda-972b-f25c39b5f44a tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:19.703897 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fa0abecb-c41c-4fda-972b-f25c39b5f44a tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:19.705184 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fa0abecb-c41c-4fda-972b-f25c39b5f44a tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:19.708872 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fa0abecb-c41c-4fda-972b-f25c39b5f44a tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:19.711218 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fa0abecb-c41c-4fda-972b-f25c39b5f44a tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:19.808124 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-fc314e5e-efc8-4764-98f6-732cf5ebaf9a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:19.820771 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fc314e5e-efc8-4764-98f6-732cf5ebaf9a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1316 microversion: 2.1 time: 1.020344 Oct 12 13:25:19.831185 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 428/919] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:18 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1316 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:19.858628 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-fa0abecb-c41c-4fda-972b-f25c39b5f44a tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a5a43471b49fc9dac1aa301c50d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36da01f1b35e43be9c4a96d6cc118d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:19.867148 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fa0abecb-c41c-4fda-972b-f25c39b5f44a tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] 10.222.0.52 "GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b" status: 200 len: 1274 microversion: 2.1 time: 0.204800 Oct 12 13:25:19.892750 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 492/920] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:19 2022] GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b => generated 1274 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:20.173491 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-6c41932f-f107-44a9-a9db-ba623e5768bc req-d4f5be4f-831e-45ee-893c-b418a87ddf57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3676307-e5eb-4e25-ab76-44f29e7a4b21", "tag": "e0775306-4e5e-4e35-948b-06c20220585f"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:20.186797 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-6c41932f-f107-44a9-a9db-ba623e5768bc req-d4f5be4f-831e-45ee-893c-b418a87ddf57 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:20.187533 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-6c41932f-f107-44a9-a9db-ba623e5768bc req-d4f5be4f-831e-45ee-893c-b418a87ddf57 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:20.188185 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-6c41932f-f107-44a9-a9db-ba623e5768bc req-d4f5be4f-831e-45ee-893c-b418a87ddf57 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:20.203326 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-6c41932f-f107-44a9-a9db-ba623e5768bc req-d4f5be4f-831e-45ee-893c-b418a87ddf57 service nova] Creating event network-changed:e0775306-4e5e-4e35-948b-06c20220585f for instance f3676307-e5eb-4e25-ab76-44f29e7a4b21 on n-h2-861076-2 Oct 12 13:25:20.210579 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-6c41932f-f107-44a9-a9db-ba623e5768bc req-d4f5be4f-831e-45ee-893c-b418a87ddf57 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047395 Oct 12 13:25:20.212726 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 429/921] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:20.595611 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cfe3bd26-20ad-42da-a2c9-9be41de52901 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:20.595611 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-cfe3bd26-20ad-42da-a2c9-9be41de52901 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:20.604694 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cfe3bd26-20ad-42da-a2c9-9be41de52901 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:20.605722 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cfe3bd26-20ad-42da-a2c9-9be41de52901 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:20.606469 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cfe3bd26-20ad-42da-a2c9-9be41de52901 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:20.608129 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cfe3bd26-20ad-42da-a2c9-9be41de52901 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:20.609132 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cfe3bd26-20ad-42da-a2c9-9be41de52901 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:20.609938 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cfe3bd26-20ad-42da-a2c9-9be41de52901 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:20.674640 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5926f415-8b00-4b61-ab19-74dc3752bfef tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9ba425e0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:20.756919 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5926f415-8b00-4b61-ab19-74dc3752bfef tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.086658 Oct 12 13:25:20.767872 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 430/922] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:20 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:20.858398 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cce7fd28-ff68-4172-b27e-25c5d31f29b6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:20.859409 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cce7fd28-ff68-4172-b27e-25c5d31f29b6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:20.873362 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cce7fd28-ff68-4172-b27e-25c5d31f29b6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:20.882109 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cce7fd28-ff68-4172-b27e-25c5d31f29b6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:20.882921 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cce7fd28-ff68-4172-b27e-25c5d31f29b6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:20.886478 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cce7fd28-ff68-4172-b27e-25c5d31f29b6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:20.890007 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cce7fd28-ff68-4172-b27e-25c5d31f29b6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:20.893125 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cce7fd28-ff68-4172-b27e-25c5d31f29b6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:21.928734 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-cfe3bd26-20ad-42da-a2c9-9be41de52901 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:21.946905 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-cce7fd28-ff68-4172-b27e-25c5d31f29b6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:22.011808 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cce7fd28-ff68-4172-b27e-25c5d31f29b6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1316 microversion: 2.1 time: 1.129871 Oct 12 13:25:22.012923 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-cfe3bd26-20ad-42da-a2c9-9be41de52901 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1322 microversion: 2.1 time: 1.355829 Oct 12 13:25:22.012923 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 493/923] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:20 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1322 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:22.013434 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 431/924] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:20 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1316 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:22.013539 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-30cab30f-d186-4615-8647-dd0c0860a8d9 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:22.013539 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-30cab30f-d186-4615-8647-dd0c0860a8d9 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] [instance: 182dba37-e456-46a8-8ee6-255a657bcd6b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:22.054709 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-abbfcfe5-6416-4954-bd79-799ebe083d99 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9ba42c10>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:22.057664 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-30cab30f-d186-4615-8647-dd0c0860a8d9 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:22.072400 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-30cab30f-d186-4615-8647-dd0c0860a8d9 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:22.076186 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-30cab30f-d186-4615-8647-dd0c0860a8d9 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:22.116201 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-30cab30f-d186-4615-8647-dd0c0860a8d9 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:22.118537 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-30cab30f-d186-4615-8647-dd0c0860a8d9 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:22.134507 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-30cab30f-d186-4615-8647-dd0c0860a8d9 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:22.243539 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-abbfcfe5-6416-4954-bd79-799ebe083d99 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.249706 Oct 12 13:25:22.244382 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 432/925] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:21 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:22.473277 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-30cab30f-d186-4615-8647-dd0c0860a8d9 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a5a43471b49fc9dac1aa301c50d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36da01f1b35e43be9c4a96d6cc118d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:22.484752 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-30cab30f-d186-4615-8647-dd0c0860a8d9 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] 10.222.0.52 "GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b" status: 200 len: 1280 microversion: 2.1 time: 0.498160 Oct 12 13:25:22.489088 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 494/926] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:21 2022] GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b => generated 1280 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:22.612408 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-9452a937-c55b-4fd2-bcf4-a50fa60fc1d2 req-9ad987b3-96d1-4de6-8572-c929ab1c429d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84665e09-6290-4534-9254-53bc1a6364d2", "tag": "beff24b0-5676-4432-96b9-99712fc212bb"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:22.631025 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-9452a937-c55b-4fd2-bcf4-a50fa60fc1d2 req-9ad987b3-96d1-4de6-8572-c929ab1c429d service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:22.633544 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-9452a937-c55b-4fd2-bcf4-a50fa60fc1d2 req-9ad987b3-96d1-4de6-8572-c929ab1c429d service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:22.634240 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-9452a937-c55b-4fd2-bcf4-a50fa60fc1d2 req-9ad987b3-96d1-4de6-8572-c929ab1c429d service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:22.683952 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-9452a937-c55b-4fd2-bcf4-a50fa60fc1d2 req-9ad987b3-96d1-4de6-8572-c929ab1c429d service nova] Creating event network-changed:beff24b0-5676-4432-96b9-99712fc212bb for instance 84665e09-6290-4534-9254-53bc1a6364d2 on n-h2-861076-2 Oct 12 13:25:22.691997 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-9452a937-c55b-4fd2-bcf4-a50fa60fc1d2 req-9ad987b3-96d1-4de6-8572-c929ab1c429d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083684 Oct 12 13:25:22.705062 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 495/927] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:25:23.031969 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-107988b5-9957-4385-838f-a9bfc51c9c59 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:23.035825 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-107988b5-9957-4385-838f-a9bfc51c9c59 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:23.036326 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-107988b5-9957-4385-838f-a9bfc51c9c59 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:23.036807 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-107988b5-9957-4385-838f-a9bfc51c9c59 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:23.041297 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-107988b5-9957-4385-838f-a9bfc51c9c59 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:23.042681 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-107988b5-9957-4385-838f-a9bfc51c9c59 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:23.044005 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-560d6d2e-830a-4cc5-861b-288716044abe tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:23.044846 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-560d6d2e-830a-4cc5-861b-288716044abe tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:23.045211 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-107988b5-9957-4385-838f-a9bfc51c9c59 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:23.062474 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-560d6d2e-830a-4cc5-861b-288716044abe tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:23.066091 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-560d6d2e-830a-4cc5-861b-288716044abe tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:23.066678 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-560d6d2e-830a-4cc5-861b-288716044abe tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:23.067528 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-560d6d2e-830a-4cc5-861b-288716044abe tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:23.070517 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-560d6d2e-830a-4cc5-861b-288716044abe tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:23.073515 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-560d6d2e-830a-4cc5-861b-288716044abe tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:23.107341 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-107988b5-9957-4385-838f-a9bfc51c9c59 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.526205 Oct 12 13:25:23.109994 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 433/928] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:25:22 2022] GET /compute/v2.1/os-services => generated 944 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:23.115480 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bcc9f8eb-7821-4cb8-bb9d-b29b6d3c55e0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:23.139546 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-bcc9f8eb-7821-4cb8-bb9d-b29b6d3c55e0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:23.162540 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bcc9f8eb-7821-4cb8-bb9d-b29b6d3c55e0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:23.166943 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bcc9f8eb-7821-4cb8-bb9d-b29b6d3c55e0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:23.167648 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bcc9f8eb-7821-4cb8-bb9d-b29b6d3c55e0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:23.168393 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bcc9f8eb-7821-4cb8-bb9d-b29b6d3c55e0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:23.168853 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bcc9f8eb-7821-4cb8-bb9d-b29b6d3c55e0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:23.174663 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bcc9f8eb-7821-4cb8-bb9d-b29b6d3c55e0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:23.616377 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-560d6d2e-830a-4cc5-861b-288716044abe tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:23.624869 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-560d6d2e-830a-4cc5-861b-288716044abe tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1322 microversion: 2.1 time: 0.585950 Oct 12 13:25:23.646676 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-bcc9f8eb-7821-4cb8-bb9d-b29b6d3c55e0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:23.654513 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 496/929] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:23 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1322 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:25:23.663383 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bcc9f8eb-7821-4cb8-bb9d-b29b6d3c55e0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1316 microversion: 2.1 time: 0.551512 Oct 12 13:25:23.694772 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 434/930] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:23 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1316 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:23.701170 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ddba8135-c438-4cf1-b8bf-36705606d6c9 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:23.722053 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ddba8135-c438-4cf1-b8bf-36705606d6c9 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:23.722587 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ddba8135-c438-4cf1-b8bf-36705606d6c9 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:23.723031 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ddba8135-c438-4cf1-b8bf-36705606d6c9 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:23.723809 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ddba8135-c438-4cf1-b8bf-36705606d6c9 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:23.724264 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ddba8135-c438-4cf1-b8bf-36705606d6c9 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:23.724687 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ddba8135-c438-4cf1-b8bf-36705606d6c9 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:23.822634 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7ef032f4-b678-435e-a4fb-fbed6309e2aa tempest-ServerDiskConfigTestJSON-1046146961 tempest-ServerDiskConfigTestJSON-1046146961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-452204168", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "2df6364f-ce5c-482f-b06b-f520fdb78c8f"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:23.848050 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ddba8135-c438-4cf1-b8bf-36705606d6c9 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.192148 Oct 12 13:25:23.861415 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 497/931] 10.222.0.52 () {58 vars in 1170 bytes} [Wed Oct 12 13:25:23 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:23.867039 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2b25c499-e777-4ecb-96af-39eed5e3a22c tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa01d68b0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:23.982148 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2b25c499-e777-4ecb-96af-39eed5e3a22c tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.119325 Oct 12 13:25:23.982491 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-7ef032f4-b678-435e-a4fb-fbed6309e2aa tempest-ServerDiskConfigTestJSON-1046146961 tempest-ServerDiskConfigTestJSON-1046146961-project] validate_networks() for [('2df6364f-ce5c-482f-b06b-f520fdb78c8f', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:25:23.997690 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 498/932] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:23 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:24.010181 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2e970af6-5c97-47db-adda-443aecc962c8 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:24.012110 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-2e970af6-5c97-47db-adda-443aecc962c8 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] [instance: 182dba37-e456-46a8-8ee6-255a657bcd6b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:24.020537 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2e970af6-5c97-47db-adda-443aecc962c8 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:24.021419 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2e970af6-5c97-47db-adda-443aecc962c8 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:24.022094 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2e970af6-5c97-47db-adda-443aecc962c8 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:24.023040 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2e970af6-5c97-47db-adda-443aecc962c8 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:24.023718 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2e970af6-5c97-47db-adda-443aecc962c8 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:24.024386 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2e970af6-5c97-47db-adda-443aecc962c8 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:24.330717 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-2e970af6-5c97-47db-adda-443aecc962c8 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a5a43471b49fc9dac1aa301c50d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36da01f1b35e43be9c4a96d6cc118d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:24.344750 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2e970af6-5c97-47db-adda-443aecc962c8 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] 10.222.0.52 "GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b" status: 200 len: 1280 microversion: 2.1 time: 0.345588 Oct 12 13:25:24.362108 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 499/933] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:23 2022] GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b => generated 1280 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:24.385650 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-31e4a29d-190e-46bf-a10e-838453bd00dd tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:24.391996 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-31e4a29d-190e-46bf-a10e-838453bd00dd tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:24.399921 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-31e4a29d-190e-46bf-a10e-838453bd00dd tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:24.402606 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-31e4a29d-190e-46bf-a10e-838453bd00dd tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:24.403489 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-31e4a29d-190e-46bf-a10e-838453bd00dd tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:24.403974 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-31e4a29d-190e-46bf-a10e-838453bd00dd tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:24.404423 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-31e4a29d-190e-46bf-a10e-838453bd00dd tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:24.536354 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-31e4a29d-190e-46bf-a10e-838453bd00dd tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.172809 Oct 12 13:25:24.537338 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 500/934] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:25:24 2022] GET /compute/v2.1/os-services => generated 944 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:24.552656 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e9ddfcd5-5b35-4960-9456-102799a92b78 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:24.561063 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e9ddfcd5-5b35-4960-9456-102799a92b78 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:24.561882 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e9ddfcd5-5b35-4960-9456-102799a92b78 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:24.562541 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e9ddfcd5-5b35-4960-9456-102799a92b78 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:24.564450 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e9ddfcd5-5b35-4960-9456-102799a92b78 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:24.567652 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e9ddfcd5-5b35-4960-9456-102799a92b78 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:24.568800 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e9ddfcd5-5b35-4960-9456-102799a92b78 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:24.615266 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e9ddfcd5-5b35-4960-9456-102799a92b78 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=n-d-861076-2&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.067473 Oct 12 13:25:24.622688 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 501/935] 10.222.0.52 () {58 vars in 1194 bytes} [Wed Oct 12 13:25:24 2022] GET /compute/v2.1/os-services?host=n-d-861076-2&binary=xxx => generated 16 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:25:24.631933 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5845a058-e03d-4490-97bd-ee99021bd031 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:24.638372 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5845a058-e03d-4490-97bd-ee99021bd031 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:24.640531 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5845a058-e03d-4490-97bd-ee99021bd031 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:24.642735 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5845a058-e03d-4490-97bd-ee99021bd031 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:24.645626 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5845a058-e03d-4490-97bd-ee99021bd031 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:24.646545 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5845a058-e03d-4490-97bd-ee99021bd031 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:24.649440 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5845a058-e03d-4490-97bd-ee99021bd031 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:24.685481 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5845a058-e03d-4490-97bd-ee99021bd031 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.058707 Oct 12 13:25:24.687409 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 502/936] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:25:24 2022] GET /compute/v2.1/os-services => generated 944 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:24.692414 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a5279701-f092-4336-96b2-bc1e33a076c9 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:24.693338 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a5279701-f092-4336-96b2-bc1e33a076c9 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:24.705987 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a5279701-f092-4336-96b2-bc1e33a076c9 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:24.705987 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a5279701-f092-4336-96b2-bc1e33a076c9 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:24.705987 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a5279701-f092-4336-96b2-bc1e33a076c9 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:24.705987 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a5279701-f092-4336-96b2-bc1e33a076c9 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:24.706403 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a5279701-f092-4336-96b2-bc1e33a076c9 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:24.706403 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a5279701-f092-4336-96b2-bc1e33a076c9 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:24.811890 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-7ef032f4-b678-435e-a4fb-fbed6309e2aa tempest-ServerDiskConfigTestJSON-1046146961 tempest-ServerDiskConfigTestJSON-1046146961-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f8259b65-c457-47d0-a6ee-af5824fdacde) Oct 12 13:25:24.811890 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:24.811890 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:24.811890 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:24.811890 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:24.811890 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:24.811890 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:24.811890 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:24.811890 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:24.811890 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:24.811890 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:25:24.811890 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:25:24.811890 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:25:24.811890 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:25:24.811890 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:25:24.811890 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:25:24.813626 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:25:24.813626 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:25:24.813626 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:25:24.813626 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:25:24.813626 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:25:24.813626 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:25:24.813626 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:25:24.813626 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:25:24.813626 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:25:24.813626 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:25:24.813626 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:25:24.813626 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:24.813626 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:24.813626 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:25:24.813626 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:25:24.813626 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:24.813626 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:24.813626 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:25:24.814971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:25:24.814971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:24.814971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:24.814971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:25:24.814971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:25:24.814971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:24.814971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:24.814971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:25:24.814971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:25:24.814971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:25:24.814971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:25:24.814971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:25:24.814971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:25:24.814971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:25:24.814971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:25:24.814971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:25:24.814971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:25:24.814971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:25:24.819316 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:25:24.819316 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:25:24.819316 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:25:24.819316 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:25:24.819316 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:25:24.819316 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:25:24.819316 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:25:24.819316 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:25:24.819316 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:25:24.819316 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:25:24.819316 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:25:24.819316 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:25:24.819316 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:25:24.819316 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:25:24.819316 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:25:24.821479 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f8259b65-c457-47d0-a6ee-af5824fdacde) Oct 12 13:25:24.821479 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:24.821479 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-7ef032f4-b678-435e-a4fb-fbed6309e2aa tempest-ServerDiskConfigTestJSON-1046146961 tempest-ServerDiskConfigTestJSON-1046146961-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:24.821479 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:25:24.822524 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7ef032f4-b678-435e-a4fb-fbed6309e2aa tempest-ServerDiskConfigTestJSON-1046146961 tempest-ServerDiskConfigTestJSON-1046146961-project] Request method failure captured: Oct 12 13:25:24.822524 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:25:24.822524 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:25:24.822524 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:25:24.822524 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:25:24.822524 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 209 Oct 12 13:25:24.822524 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:25:24.822524 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:25:24.822524 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:25:24.822524 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:24.822524 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsBCC8m07hqo_EmKSxtrwshkVr8eFC5MHgciz1QyYAqqTpbV0kALzn8JJWOR94qgvDwrLhjFEUCxG_7kVaUzU9x2epY4h_BISEfdfOxcQIKf5u4kT5Fc-e26o-KR18YOgiOtjvxlqQtVIs0he3hC9VS3mKv_XCAsbyswAr3jUjziig0 Oct 12 13:25:24.822524 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:25:24.822524 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:25:24.822524 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:25:24.822524 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:25:24.822524 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:25:24.822524 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:25:24.822524 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 2fc18be752514e799544693e268783ab Oct 12 13:25:24.822524 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1046146961 Oct 12 13:25:24.822524 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:25:24.822524 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:25:24.825173 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2fc18be752514e799544693e268783ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2fc18be752514e799544693e268783ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2fc18be752514e799544693e268783ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2fc18be752514e799544693e268783ab"}]}] Oct 12 13:25:24.825173 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServerDiskConfigTestJSON-1046146961 Oct 12 13:25:24.825173 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 2fc18be752514e799544693e268783ab Oct 12 13:25:24.825173 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1046146961 Oct 12 13:25:24.825173 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServerDiskConfigTestJSON-1046146961-project Oct 12 13:25:24.825173 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:25:24.825173 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:25:24.825173 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: c668dcd6146848ebb9de7588ec4d904e Oct 12 13:25:24.825173 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServerDiskConfigTestJSON-1046146961-project Oct 12 13:25:24.825173 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:25:24.825173 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-452204168", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "2df6364f-ce5c-482f-b06b-f520fdb78c8f"}]}} Oct 12 13:25:24.826674 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:25:24.826674 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:24.826674 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:25:24.826674 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-452204168', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '2df6364f-ce5c-482f-b06b-f520fdb78c8f'}]}}} Oct 12 13:25:24.826674 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:24.826674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:24.826674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:24.826674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:24.826674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:24.826674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:24.826674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:24.826674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:24.826674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:24.826674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:24.826674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:25:24.826674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:25:24.826674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:25:24.826674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:25:24.826674 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:25:24.830705 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:25:24.830705 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:25:24.830705 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:25:24.830705 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:25:24.830705 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:25:24.830705 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:25:24.830705 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:25:24.830705 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:25:24.830705 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:25:24.830705 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:25:24.830705 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:25:24.830705 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:25:24.830705 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:24.830705 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:24.830705 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:25:24.830705 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:25:24.830705 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:24.830705 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:24.833127 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:25:24.833127 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:25:24.833127 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:24.833127 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:24.833127 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:25:24.833127 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:25:24.833127 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:24.833127 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:24.833127 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:25:24.833127 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:25:24.833127 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:25:24.833127 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:25:24.833127 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:25:24.833127 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:25:24.833127 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:25:24.833127 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:25:24.833127 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:25:24.833127 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:25:24.836200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:25:24.836200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:25:24.836200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:25:24.836200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:25:24.836200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:25:24.836200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:25:24.836200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:25:24.836200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:25:24.836200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:25:24.836200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:25:24.836200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:25:24.836200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:25:24.836200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:25:24.836200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:25:24.836200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:25:24.836200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:25:24.838300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f8259b65-c457-47d0-a6ee-af5824fdacde) Oct 12 13:25:24.838300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:24.838300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:24.838300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:24.838300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:24.838300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:24.838300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:24.838300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:24.838300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:24.838300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:25:24.838300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:25:24.838300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:24.838300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:24.838300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:24.838300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:24.838300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:24.838300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:24.838300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:24.838300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:24.843048 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:24.843048 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:24.843048 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:24.843048 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:24.843048 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:24.843048 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7ef032f4-b678-435e-a4fb-fbed6309e2aa tempest-ServerDiskConfigTestJSON-1046146961 tempest-ServerDiskConfigTestJSON-1046146961-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:24.843048 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:24.843048 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7ef032f4-b678-435e-a4fb-fbed6309e2aa tempest-ServerDiskConfigTestJSON-1046146961 tempest-ServerDiskConfigTestJSON-1046146961-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.142973 Oct 12 13:25:24.843048 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 435/937] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:25:23 2022] POST /compute/v2.1/servers => generated 214 bytes in 1144 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:25:24.846980 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-db6e98de-bb48-43c7-8aa5-b21108bbec03 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:24.848072 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-db6e98de-bb48-43c7-8aa5-b21108bbec03 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:24.884414 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-db6e98de-bb48-43c7-8aa5-b21108bbec03 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:24.886358 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-db6e98de-bb48-43c7-8aa5-b21108bbec03 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:24.887091 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-db6e98de-bb48-43c7-8aa5-b21108bbec03 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:24.888107 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-db6e98de-bb48-43c7-8aa5-b21108bbec03 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:24.891971 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-db6e98de-bb48-43c7-8aa5-b21108bbec03 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:24.892426 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-db6e98de-bb48-43c7-8aa5-b21108bbec03 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:24.943512 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=83,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=13,nova_cell1:DELETE=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:25:25.137622 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a5279701-f092-4336-96b2-bc1e33a076c9 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:25.152146 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a5279701-f092-4336-96b2-bc1e33a076c9 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1322 microversion: 2.1 time: 0.463304 Oct 12 13:25:25.155787 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 503/938] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:24 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1322 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:25.168380 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-719b7c91-1a9e-4359-9148-730cdc7e8a05 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:25.183676 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-719b7c91-1a9e-4359-9148-730cdc7e8a05 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:25.188174 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-719b7c91-1a9e-4359-9148-730cdc7e8a05 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:25.188670 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-719b7c91-1a9e-4359-9148-730cdc7e8a05 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:25.189489 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-719b7c91-1a9e-4359-9148-730cdc7e8a05 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:25.189946 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-719b7c91-1a9e-4359-9148-730cdc7e8a05 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:25.190370 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-719b7c91-1a9e-4359-9148-730cdc7e8a05 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:25.237381 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-719b7c91-1a9e-4359-9148-730cdc7e8a05 tempest-ServicesAdminNegativeTestJSON-1466488276 tempest-ServicesAdminNegativeTestJSON-1466488276-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.080431 Oct 12 13:25:25.238548 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 504/939] 10.222.0.52 () {58 vars in 1198 bytes} [Wed Oct 12 13:25:25 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:25:25.243338 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-20940604-5c98-4ee8-bb4f-3c2b87966e02 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa038c550>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:25.338849 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-20940604-5c98-4ee8-bb4f-3c2b87966e02 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.098981 Oct 12 13:25:25.348780 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 505/940] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:25 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:25.360387 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-557ef8e6-57e7-48d6-b2fc-14275a8f69a6 tempest-ServerDiskConfigTestJSON-1046146961 tempest-ServerDiskConfigTestJSON-1046146961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-924117201", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "2df6364f-ce5c-482f-b06b-f520fdb78c8f"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:25.488464 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-557ef8e6-57e7-48d6-b2fc-14275a8f69a6 tempest-ServerDiskConfigTestJSON-1046146961 tempest-ServerDiskConfigTestJSON-1046146961-project] validate_networks() for [('2df6364f-ce5c-482f-b06b-f520fdb78c8f', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:25:25.642555 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-db6e98de-bb48-43c7-8aa5-b21108bbec03 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:25.654903 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-db6e98de-bb48-43c7-8aa5-b21108bbec03 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1316 microversion: 2.1 time: 0.813463 Oct 12 13:25:25.658626 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 436/941] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:24 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1316 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:26.243835 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-557ef8e6-57e7-48d6-b2fc-14275a8f69a6 tempest-ServerDiskConfigTestJSON-1046146961 tempest-ServerDiskConfigTestJSON-1046146961-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d8b12b24-6b5a-4863-be88-738be162facd) Oct 12 13:25:26.243835 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:26.243835 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:26.243835 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:26.243835 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:26.243835 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:26.243835 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:26.243835 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:26.243835 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:26.243835 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:26.243835 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:25:26.243835 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:25:26.243835 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:25:26.243835 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:25:26.243835 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:25:26.243835 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:25:26.245195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:25:26.245195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:25:26.245195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:25:26.245195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:25:26.245195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:25:26.245195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:25:26.245195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:25:26.245195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:25:26.245195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:25:26.245195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:25:26.245195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:25:26.245195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:26.245195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:26.245195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:25:26.245195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:25:26.245195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:26.245195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:26.245195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:25:26.246510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:25:26.246510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:26.246510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:26.246510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:25:26.246510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:25:26.246510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:26.246510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:26.246510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:25:26.246510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:25:26.246510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:25:26.246510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:25:26.246510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:25:26.246510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:25:26.246510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:25:26.246510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:25:26.246510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:25:26.246510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:25:26.246510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:25:26.247800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:25:26.247800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:25:26.247800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:25:26.247800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:25:26.247800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:25:26.247800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:25:26.247800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:25:26.247800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:25:26.247800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:25:26.247800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:25:26.247800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:25:26.247800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:25:26.247800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:25:26.247800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:25:26.247800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:25:26.248873 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d8b12b24-6b5a-4863-be88-738be162facd) Oct 12 13:25:26.248873 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:26.248873 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-557ef8e6-57e7-48d6-b2fc-14275a8f69a6 tempest-ServerDiskConfigTestJSON-1046146961 tempest-ServerDiskConfigTestJSON-1046146961-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:26.248873 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:25:26.251715 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-557ef8e6-57e7-48d6-b2fc-14275a8f69a6 tempest-ServerDiskConfigTestJSON-1046146961 tempest-ServerDiskConfigTestJSON-1046146961-project] Request method failure captured: Oct 12 13:25:26.251715 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:25:26.251715 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:25:26.251715 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:25:26.251715 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:25:26.251715 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 209 Oct 12 13:25:26.251715 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:25:26.251715 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:25:26.251715 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:25:26.251715 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:26.251715 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsBCC8m07hqo_EmKSxtrwshkVr8eFC5MHgciz1QyYAqqTpbV0kALzn8JJWOR94qgvDwrLhjFEUCxG_7kVaUzU9x2epY4h_BISEfdfOxcQIKf5u4kT5Fc-e26o-KR18YOgiOtjvxlqQtVIs0he3hC9VS3mKv_XCAsbyswAr3jUjziig0 Oct 12 13:25:26.251715 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:25:26.251715 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:25:26.251715 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:25:26.251715 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:25:26.251715 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:25:26.251715 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:25:26.251715 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 2fc18be752514e799544693e268783ab Oct 12 13:25:26.251715 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1046146961 Oct 12 13:25:26.251715 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:25:26.251715 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:25:26.253358 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2fc18be752514e799544693e268783ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2fc18be752514e799544693e268783ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2fc18be752514e799544693e268783ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2fc18be752514e799544693e268783ab"}]}] Oct 12 13:25:26.253358 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServerDiskConfigTestJSON-1046146961 Oct 12 13:25:26.253358 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 2fc18be752514e799544693e268783ab Oct 12 13:25:26.253358 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1046146961 Oct 12 13:25:26.253358 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServerDiskConfigTestJSON-1046146961-project Oct 12 13:25:26.253358 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:25:26.253358 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:25:26.253358 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: c668dcd6146848ebb9de7588ec4d904e Oct 12 13:25:26.253358 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServerDiskConfigTestJSON-1046146961-project Oct 12 13:25:26.253358 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:25:26.253358 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-924117201", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "2df6364f-ce5c-482f-b06b-f520fdb78c8f"}]}} Oct 12 13:25:26.254166 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:25:26.254166 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:26.254166 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:25:26.254166 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-924117201', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '2df6364f-ce5c-482f-b06b-f520fdb78c8f'}]}}} Oct 12 13:25:26.254166 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:26.254166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:26.254166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:26.254166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:26.254166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:26.254166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:26.254166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:26.254166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:26.254166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:26.254166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:26.254166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:25:26.254166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:25:26.254166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:25:26.254166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:25:26.254166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:25:26.255510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:25:26.255510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:25:26.255510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:25:26.255510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:25:26.255510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:25:26.255510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:25:26.255510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:25:26.255510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:25:26.255510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:25:26.255510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:25:26.255510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:25:26.255510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:25:26.255510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:26.255510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:26.255510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:25:26.255510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:25:26.255510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:26.255510 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:26.256777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:25:26.256777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:25:26.256777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:26.256777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:26.256777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:25:26.256777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:25:26.256777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:26.256777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:26.256777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:25:26.256777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:25:26.256777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:25:26.256777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:25:26.256777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:25:26.256777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:25:26.256777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:25:26.256777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:25:26.256777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:25:26.256777 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:25:26.258079 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:25:26.258079 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:25:26.258079 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:25:26.258079 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:25:26.258079 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:25:26.258079 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:25:26.258079 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:25:26.258079 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:25:26.258079 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:25:26.258079 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:25:26.258079 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:25:26.258079 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:25:26.258079 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:25:26.258079 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:25:26.258079 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:25:26.258079 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:25:26.259254 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d8b12b24-6b5a-4863-be88-738be162facd) Oct 12 13:25:26.259254 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:26.259254 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:26.259254 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:26.259254 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:26.259254 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:26.259254 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:26.259254 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:26.259254 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:26.259254 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:25:26.259254 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:25:26.259254 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:26.259254 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:26.259254 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:26.259254 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:26.259254 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:26.259254 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:26.259254 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:26.259254 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:26.260723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:26.260723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:26.260723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:26.260723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:26.260723 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:26.262923 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-557ef8e6-57e7-48d6-b2fc-14275a8f69a6 tempest-ServerDiskConfigTestJSON-1046146961 tempest-ServerDiskConfigTestJSON-1046146961-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:26.262923 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:26.262923 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-557ef8e6-57e7-48d6-b2fc-14275a8f69a6 tempest-ServerDiskConfigTestJSON-1046146961 tempest-ServerDiskConfigTestJSON-1046146961-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.912988 Oct 12 13:25:26.284161 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 506/942] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:25:25 2022] POST /compute/v2.1/servers => generated 214 bytes in 926 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:25:26.405413 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ae52038d-1ff5-443b-a127-070d9e11a6e7 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Action: 'create', calling method: .version_select at 0x7f8a9ba5f310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-862048272", "description": "tempest-description-1716728585"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:26.632729 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c3ac8a13-058f-418a-99db-30a9a28a71c4 tempest-ServicesAdminNegativeTestJSON-621790817 tempest-ServicesAdminNegativeTestJSON-621790817-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:26.639942 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-c3ac8a13-058f-418a-99db-30a9a28a71c4 tempest-ServicesAdminNegativeTestJSON-621790817 tempest-ServicesAdminNegativeTestJSON-621790817-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '3d68371eb7524947b7d7d0cda1e9ae6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20729e15fbb4a89b0809dceb0709374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:26.648362 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c3ac8a13-058f-418a-99db-30a9a28a71c4 tempest-ServicesAdminNegativeTestJSON-621790817 tempest-ServicesAdminNegativeTestJSON-621790817-project] Request method failure captured: Oct 12 13:25:26.648362 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 12 13:25:26.648362 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:25:26.648362 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:25:26.648362 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:25:26.648362 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:25:26.648362 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:25:26.648362 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:25:26.648362 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:25:26.648362 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:26.648362 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsBAnM93NgnYj40aVvZJpgmrinzSkRQL4R-cgvPuP8NnO2pAU2vq3D2i7AfNM9sEwj4YIyQPgXOjylF5epGziDjGOlY7x9SZeh42uaYIFlFQTh6nIUv2R22n6gmz5cmB8SqHa5qh8Zaiw8hTBUqBAWMkjoeTMJ13jt8JnN8u7_c6I8o Oct 12 13:25:26.648362 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:25:26.648362 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:25:26.648362 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:25:26.648362 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:25:26.648362 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:25:26.648362 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:25:26.648362 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: a20729e15fbb4a89b0809dceb0709374 Oct 12 13:25:26.648362 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-621790817 Oct 12 13:25:26.648362 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:25:26.648362 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:25:26.650024 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a20729e15fbb4a89b0809dceb0709374"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a20729e15fbb4a89b0809dceb0709374"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a20729e15fbb4a89b0809dceb0709374"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a20729e15fbb4a89b0809dceb0709374"}]}] Oct 12 13:25:26.650024 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-621790817 Oct 12 13:25:26.650024 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: a20729e15fbb4a89b0809dceb0709374 Oct 12 13:25:26.650024 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-621790817 Oct 12 13:25:26.650024 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServicesAdminNegativeTestJSON-621790817-project Oct 12 13:25:26.650024 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:25:26.650024 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:25:26.650024 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 3d68371eb7524947b7d7d0cda1e9ae6a Oct 12 13:25:26.650024 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-621790817-project Oct 12 13:25:26.650024 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:25:26.650024 n-d-861076-2 devstack@n-api.service[120933]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 13:25:26.650024 n-d-861076-2 devstack@n-api.service[120933]: action_args: {} Oct 12 13:25:26.651001 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:26.651001 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:26.651001 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:26.651001 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:26.651001 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:26.651001 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:26.651001 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 13:25:26.651001 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:26.651001 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 13:25:26.651001 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:26.651001 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:26.651001 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:26.651001 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 12 13:25:26.651001 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 12 13:25:26.651001 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:25:26.651001 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:25:26.651001 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:25:26.651001 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:25:26.651001 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:25:26.652402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:25:26.652402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:25:26.652402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:25:26.652402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:25:26.652402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:25:26.652402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:25:26.652402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:25:26.652402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:25:26.652402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:25:26.652402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 13:25:26.652402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:26.652402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:26.652402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:26.652402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:26.652402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:26.652402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:26.652402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:25:26.652402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:25:26.652402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 13:25:26.652402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:26.658598 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c3ac8a13-058f-418a-99db-30a9a28a71c4 tempest-ServicesAdminNegativeTestJSON-621790817 tempest-ServicesAdminNegativeTestJSON-621790817-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:26.665895 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c3ac8a13-058f-418a-99db-30a9a28a71c4 tempest-ServicesAdminNegativeTestJSON-621790817 tempest-ServicesAdminNegativeTestJSON-621790817-project] 10.222.0.52 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.370384 Oct 12 13:25:26.668821 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 507/943] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:25:26 2022] GET /compute/v2.1/os-services => generated 112 bytes in 382 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:25:26.679372 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5a5f9c76-5cef-4389-bea1-9393e369be41 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:26.681438 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-5a5f9c76-5cef-4389-bea1-9393e369be41 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] [instance: 182dba37-e456-46a8-8ee6-255a657bcd6b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:26.697617 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5a5f9c76-5cef-4389-bea1-9393e369be41 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:26.698476 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5a5f9c76-5cef-4389-bea1-9393e369be41 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:26.699164 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5a5f9c76-5cef-4389-bea1-9393e369be41 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:26.700115 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5a5f9c76-5cef-4389-bea1-9393e369be41 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:26.701437 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5a5f9c76-5cef-4389-bea1-9393e369be41 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:26.706527 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5a5f9c76-5cef-4389-bea1-9393e369be41 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:27.213184 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-5a5f9c76-5cef-4389-bea1-9393e369be41 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a5a43471b49fc9dac1aa301c50d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36da01f1b35e43be9c4a96d6cc118d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:27.233194 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5a5f9c76-5cef-4389-bea1-9393e369be41 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] 10.222.0.52 "GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b" status: 200 len: 1322 microversion: 2.1 time: 0.553213 Oct 12 13:25:27.235493 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 508/944] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:26 2022] GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b => generated 1322 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:27.253202 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-39ca5890-e804-4e87-90ee-4aa1a9343d8e tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:27.254121 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-39ca5890-e804-4e87-90ee-4aa1a9343d8e tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:27.264629 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-39ca5890-e804-4e87-90ee-4aa1a9343d8e tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:27.265408 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-39ca5890-e804-4e87-90ee-4aa1a9343d8e tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:27.269237 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-39ca5890-e804-4e87-90ee-4aa1a9343d8e tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:27.270218 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-39ca5890-e804-4e87-90ee-4aa1a9343d8e tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:27.272102 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-39ca5890-e804-4e87-90ee-4aa1a9343d8e tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:27.274382 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-39ca5890-e804-4e87-90ee-4aa1a9343d8e tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:27.656495 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ae52038d-1ff5-443b-a127-070d9e11a6e7 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.991908 Oct 12 13:25:27.657665 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 437/945] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:25:25 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:27.670533 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d8afe0c7-d8bb-41b2-971a-8981d13a6eae tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9ba51790>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:27.745956 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d8afe0c7-d8bb-41b2-971a-8981d13a6eae tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.087158 Oct 12 13:25:27.746765 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 438/946] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:27 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:27.760101 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-749df3eb-29e3-439a-9c86-b5d804412239 tempest-ServerDiskConfigTestJSON-1046146961 tempest-ServerDiskConfigTestJSON-1046146961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-524920511", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "2df6364f-ce5c-482f-b06b-f520fdb78c8f"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:27.870336 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-749df3eb-29e3-439a-9c86-b5d804412239 tempest-ServerDiskConfigTestJSON-1046146961 tempest-ServerDiskConfigTestJSON-1046146961-project] validate_networks() for [('2df6364f-ce5c-482f-b06b-f520fdb78c8f', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:25:27.955986 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-39ca5890-e804-4e87-90ee-4aa1a9343d8e tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:27.968331 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-39ca5890-e804-4e87-90ee-4aa1a9343d8e tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1322 microversion: 2.1 time: 0.728930 Oct 12 13:25:27.969883 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 509/947] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:27 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1322 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:27.987985 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f1e056f7-a5a5-47e5-807b-226d59892c00 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:27.993217 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f1e056f7-a5a5-47e5-807b-226d59892c00 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:28.005638 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1e056f7-a5a5-47e5-807b-226d59892c00 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:28.008077 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1e056f7-a5a5-47e5-807b-226d59892c00 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:28.009108 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1e056f7-a5a5-47e5-807b-226d59892c00 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:28.010349 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1e056f7-a5a5-47e5-807b-226d59892c00 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:28.011911 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1e056f7-a5a5-47e5-807b-226d59892c00 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:28.016552 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1e056f7-a5a5-47e5-807b-226d59892c00 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:28.385416 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=32 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:25:28.980581 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f1e056f7-a5a5-47e5-807b-226d59892c00 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:28.992217 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f1e056f7-a5a5-47e5-807b-226d59892c00 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1316 microversion: 2.1 time: 1.020405 Oct 12 13:25:28.992742 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 510/948] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:27 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1316 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:29.003650 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-80dcae3e-738f-4a9b-87e2-8f17bded4140 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Action: 'create', calling method: .version_select at 0x7f8aa038c550>, body: {"security_group_rule": {"parent_group_id": "58307622-5a81-45b9-863b-ee09fdc4ce13", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:29.161659 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-749df3eb-29e3-439a-9c86-b5d804412239 tempest-ServerDiskConfigTestJSON-1046146961 tempest-ServerDiskConfigTestJSON-1046146961-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9a2b4a4f-5689-4afa-be88-5e62438504b4) Oct 12 13:25:29.161659 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:29.161659 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:29.161659 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:29.161659 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:29.161659 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:29.161659 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:29.161659 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:29.161659 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:29.161659 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:29.161659 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:25:29.161659 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:25:29.161659 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:25:29.161659 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:25:29.161659 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:25:29.161659 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:25:29.163104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:25:29.163104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:25:29.163104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:25:29.163104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:25:29.163104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:25:29.163104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:25:29.163104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:25:29.163104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:25:29.163104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:25:29.163104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:25:29.163104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:25:29.163104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:29.163104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:29.163104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:25:29.163104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:25:29.163104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:29.163104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:29.163104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:25:29.164484 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:25:29.164484 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:29.164484 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:29.164484 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:25:29.164484 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:25:29.164484 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:29.164484 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:29.164484 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:25:29.164484 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:25:29.164484 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:25:29.164484 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:25:29.164484 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:25:29.164484 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:25:29.164484 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:25:29.164484 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:25:29.164484 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:25:29.164484 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:25:29.164484 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:25:29.166402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:25:29.166402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:25:29.166402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:25:29.166402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:25:29.166402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:25:29.166402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:25:29.166402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:25:29.166402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:25:29.166402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:25:29.166402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:25:29.166402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:25:29.166402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:25:29.166402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:25:29.166402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:25:29.166402 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9a2b4a4f-5689-4afa-be88-5e62438504b4) Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-749df3eb-29e3-439a-9c86-b5d804412239 tempest-ServerDiskConfigTestJSON-1046146961 tempest-ServerDiskConfigTestJSON-1046146961-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-749df3eb-29e3-439a-9c86-b5d804412239 tempest-ServerDiskConfigTestJSON-1046146961 tempest-ServerDiskConfigTestJSON-1046146961-project] Request method failure captured: Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 209 Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsBCC8m07hqo_EmKSxtrwshkVr8eFC5MHgciz1QyYAqqTpbV0kALzn8JJWOR94qgvDwrLhjFEUCxG_7kVaUzU9x2epY4h_BISEfdfOxcQIKf5u4kT5Fc-e26o-KR18YOgiOtjvxlqQtVIs0he3hC9VS3mKv_XCAsbyswAr3jUjziig0 Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 2fc18be752514e799544693e268783ab Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1046146961 Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:25:29.168465 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:25:29.171063 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2fc18be752514e799544693e268783ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2fc18be752514e799544693e268783ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2fc18be752514e799544693e268783ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2fc18be752514e799544693e268783ab"}]}] Oct 12 13:25:29.171063 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServerDiskConfigTestJSON-1046146961 Oct 12 13:25:29.171063 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 2fc18be752514e799544693e268783ab Oct 12 13:25:29.171063 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1046146961 Oct 12 13:25:29.171063 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServerDiskConfigTestJSON-1046146961-project Oct 12 13:25:29.171063 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:25:29.171063 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:25:29.171063 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: c668dcd6146848ebb9de7588ec4d904e Oct 12 13:25:29.171063 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServerDiskConfigTestJSON-1046146961-project Oct 12 13:25:29.171063 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:25:29.171063 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-524920511", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "2df6364f-ce5c-482f-b06b-f520fdb78c8f"}]}} Oct 12 13:25:29.172145 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:25:29.172145 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:29.172145 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:25:29.172145 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-524920511', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '2df6364f-ce5c-482f-b06b-f520fdb78c8f'}]}}} Oct 12 13:25:29.172145 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:29.172145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:29.172145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:29.172145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:29.172145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:29.172145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:29.172145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:29.172145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:29.172145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:29.172145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:29.172145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:25:29.172145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:25:29.172145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:25:29.172145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:25:29.172145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:25:29.175717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:25:29.175717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:25:29.175717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:25:29.175717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:25:29.175717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:25:29.175717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:25:29.175717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:25:29.175717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:25:29.175717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:25:29.175717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:25:29.175717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:25:29.175717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:25:29.175717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:29.175717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:29.175717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:25:29.175717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:25:29.175717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:29.175717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:29.178306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:25:29.178306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:25:29.178306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:29.178306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:29.178306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:25:29.178306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:25:29.178306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:29.178306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:29.178306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:25:29.178306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:25:29.178306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:25:29.178306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:25:29.178306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:25:29.178306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:25:29.178306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:25:29.178306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:25:29.178306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:25:29.178306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:25:29.180967 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:25:29.180967 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:25:29.180967 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:25:29.180967 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:25:29.180967 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:25:29.180967 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:25:29.180967 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:25:29.180967 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:25:29.180967 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:25:29.180967 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:25:29.180967 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:25:29.180967 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:25:29.180967 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:25:29.180967 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:25:29.180967 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:25:29.180967 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:25:29.183955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9a2b4a4f-5689-4afa-be88-5e62438504b4) Oct 12 13:25:29.183955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:29.183955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:29.183955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:29.183955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:29.183955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:29.183955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:29.183955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:29.183955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:29.183955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:25:29.183955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:25:29.183955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:29.183955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:29.183955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:29.183955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:29.183955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:29.183955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:29.183955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:29.183955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:29.189071 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:29.189071 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:29.189071 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:29.189071 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:29.189071 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:29.189071 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-749df3eb-29e3-439a-9c86-b5d804412239 tempest-ServerDiskConfigTestJSON-1046146961 tempest-ServerDiskConfigTestJSON-1046146961-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:29.189071 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:29.189071 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-749df3eb-29e3-439a-9c86-b5d804412239 tempest-ServerDiskConfigTestJSON-1046146961 tempest-ServerDiskConfigTestJSON-1046146961-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.412715 Oct 12 13:25:29.189071 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 439/949] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:25:27 2022] POST /compute/v2.1/servers => generated 214 bytes in 1423 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:25:29.189674 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-984708a8-4572-4960-9867-af1377e76145 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:29.189674 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-984708a8-4572-4960-9867-af1377e76145 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] [instance: 182dba37-e456-46a8-8ee6-255a657bcd6b] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:29.201078 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-984708a8-4572-4960-9867-af1377e76145 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:29.201569 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-984708a8-4572-4960-9867-af1377e76145 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:29.202003 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-984708a8-4572-4960-9867-af1377e76145 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:29.202709 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-984708a8-4572-4960-9867-af1377e76145 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:29.203350 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-984708a8-4572-4960-9867-af1377e76145 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:29.203777 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-984708a8-4572-4960-9867-af1377e76145 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:29.647616 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-984708a8-4572-4960-9867-af1377e76145 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a5a43471b49fc9dac1aa301c50d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36da01f1b35e43be9c4a96d6cc118d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:29.662890 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-984708a8-4572-4960-9867-af1377e76145 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] 10.222.0.52 "GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b" status: 200 len: 1322 microversion: 2.1 time: 0.479885 Oct 12 13:25:29.663543 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 440/950] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:29 2022] GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b => generated 1322 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:29.685913 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4005be19-3d17-484f-b3df-ad6a50599314 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bcf53a0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:29.804244 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4005be19-3d17-484f-b3df-ad6a50599314 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.139608 Oct 12 13:25:29.804831 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 441/951] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:29 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:29.827155 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-54a7e539-9f67-49af-bb1d-42a2e87b647a tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:29.827979 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-54a7e539-9f67-49af-bb1d-42a2e87b647a tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:29.845253 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-54a7e539-9f67-49af-bb1d-42a2e87b647a tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:29.846334 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-54a7e539-9f67-49af-bb1d-42a2e87b647a tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:29.851956 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-54a7e539-9f67-49af-bb1d-42a2e87b647a tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:29.857374 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-54a7e539-9f67-49af-bb1d-42a2e87b647a tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:29.857374 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-54a7e539-9f67-49af-bb1d-42a2e87b647a tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:29.857374 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-54a7e539-9f67-49af-bb1d-42a2e87b647a tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:30.492657 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-54a7e539-9f67-49af-bb1d-42a2e87b647a tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:30.507781 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-54a7e539-9f67-49af-bb1d-42a2e87b647a tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1322 microversion: 2.1 time: 0.701816 Oct 12 13:25:30.509234 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 442/952] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:29 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1322 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:30.561208 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-80dcae3e-738f-4a9b-87e2-8f17bded4140 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.564387 Oct 12 13:25:30.562844 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 511/953] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 12 13:25:28 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:30.568453 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-3d1b3aad-48f1-44f3-8bb7-89fb7ef0f02b req-a5bbd84b-74e8-46f7-a811-b059daffdd84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "182dba37-e456-46a8-8ee6-255a657bcd6b", "tag": "819ba82b-dd17-45b9-b70c-d488542a44e9"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:30.601304 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-3d1b3aad-48f1-44f3-8bb7-89fb7ef0f02b req-a5bbd84b-74e8-46f7-a811-b059daffdd84 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:30.604125 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-3d1b3aad-48f1-44f3-8bb7-89fb7ef0f02b req-a5bbd84b-74e8-46f7-a811-b059daffdd84 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:30.609834 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-3d1b3aad-48f1-44f3-8bb7-89fb7ef0f02b req-a5bbd84b-74e8-46f7-a811-b059daffdd84 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:30.637258 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-3d1b3aad-48f1-44f3-8bb7-89fb7ef0f02b req-a5bbd84b-74e8-46f7-a811-b059daffdd84 service nova] Creating event network-changed:819ba82b-dd17-45b9-b70c-d488542a44e9 for instance 182dba37-e456-46a8-8ee6-255a657bcd6b on n-h1-861076-2 Oct 12 13:25:30.647157 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-3d1b3aad-48f1-44f3-8bb7-89fb7ef0f02b req-a5bbd84b-74e8-46f7-a811-b059daffdd84 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082823 Oct 12 13:25:30.650985 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 512/954] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:30.663760 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-348ec31b-723e-44ff-810f-0abe0dbf735b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:30.678229 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-348ec31b-723e-44ff-810f-0abe0dbf735b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:30.690562 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-348ec31b-723e-44ff-810f-0abe0dbf735b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:30.691080 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-348ec31b-723e-44ff-810f-0abe0dbf735b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:30.691642 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-348ec31b-723e-44ff-810f-0abe0dbf735b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:30.692258 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-348ec31b-723e-44ff-810f-0abe0dbf735b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:30.692720 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-348ec31b-723e-44ff-810f-0abe0dbf735b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:30.698236 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-348ec31b-723e-44ff-810f-0abe0dbf735b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:31.085678 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f955af12-ae17-41a7-8798-a4a2779f03a9 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Calling method '.version_select at 0x7f8a9bd590d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:31.089372 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f955af12-ae17-41a7-8798-a4a2779f03a9 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:31.093741 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f955af12-ae17-41a7-8798-a4a2779f03a9 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:31.094440 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f955af12-ae17-41a7-8798-a4a2779f03a9 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:31.095569 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f955af12-ae17-41a7-8798-a4a2779f03a9 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:31.097993 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f955af12-ae17-41a7-8798-a4a2779f03a9 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:31.099923 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f955af12-ae17-41a7-8798-a4a2779f03a9 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:31.138666 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f955af12-ae17-41a7-8798-a4a2779f03a9 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.628100 Oct 12 13:25:31.146516 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 443/955] 10.222.0.52 () {58 vars in 1128 bytes} [Wed Oct 12 13:25:30 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:31.156136 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-15696243-1503-4763-b819-e97523d6052d tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Action: 'create', calling method: .version_select at 0x7f8a9ba42e50>, body: {"security_group_rule": {"parent_group_id": "58307622-5a81-45b9-863b-ee09fdc4ce13", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:31.287135 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-348ec31b-723e-44ff-810f-0abe0dbf735b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:31.295516 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-348ec31b-723e-44ff-810f-0abe0dbf735b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1316 microversion: 2.1 time: 0.640879 Oct 12 13:25:31.300940 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 513/956] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:30 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1316 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:31.325370 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e9cc7126-0238-401d-b268-8d9e465e6a7e tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:31.326574 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-e9cc7126-0238-401d-b268-8d9e465e6a7e tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] [instance: 182dba37-e456-46a8-8ee6-255a657bcd6b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:31.333617 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e9cc7126-0238-401d-b268-8d9e465e6a7e tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:31.334479 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e9cc7126-0238-401d-b268-8d9e465e6a7e tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:31.335070 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e9cc7126-0238-401d-b268-8d9e465e6a7e tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:31.335957 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e9cc7126-0238-401d-b268-8d9e465e6a7e tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:31.336615 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e9cc7126-0238-401d-b268-8d9e465e6a7e tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:31.337289 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e9cc7126-0238-401d-b268-8d9e465e6a7e tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:31.420643 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-15696243-1503-4763-b819-e97523d6052d tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] HTTP exception thrown: This rule already exists in group 58307622-5a81-45b9-863b-ee09fdc4ce13 Oct 12 13:25:31.420643 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-15696243-1503-4763-b819-e97523d6052d tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Request method failure captured: Oct 12 13:25:31.420643 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 13:25:31.420643 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:25:31.420643 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:25:31.420643 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:25:31.420643 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 138 Oct 12 13:25:31.420643 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:25:31.420643 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:25:31.420643 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:25:31.420643 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:31.420643 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsBEkZZs7Gre384Iv-UKcvb_KTJCmSNSqyb85WjtZRgWgB9P1SVrqtW3kF_xkHZpKDcbkcjUCQ4_1nAbXGtzD9BYVleCRFfiBXwptTGiDECyK19FcwWxbjlw0BUgsPLP1OQrOCGe55u33_-j8i5BiIrq4kPMAcH3OvmpD41DoXn81wI Oct 12 13:25:31.420643 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:25:31.420643 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:25:31.420643 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:25:31.420643 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:25:31.420643 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:25:31.420643 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:25:31.420643 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: acdc5afde34947f9a13b64c4179587d5 Oct 12 13:25:31.420643 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:31.420643 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:25:31.420643 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:25:31.422607 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/acdc5afde34947f9a13b64c4179587d5"}]}] Oct 12 13:25:31.422607 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:31.422607 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: acdc5afde34947f9a13b64c4179587d5 Oct 12 13:25:31.422607 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:31.422607 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-911474027-project Oct 12 13:25:31.422607 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:25:31.422607 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:25:31.422607 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 4549aaa6806b4c138a9bdf54e7b2965e Oct 12 13:25:31.422607 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027-project Oct 12 13:25:31.422607 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:25:31.422607 n-d-861076-2 devstack@n-api.service[120932]: {"security_group_rule": {"parent_group_id": "58307622-5a81-45b9-863b-ee09fdc4ce13", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 12 13:25:31.422607 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:25:31.423480 n-d-861076-2 devstack@n-api.service[120932]: exception: This rule already exists in group 58307622-5a81-45b9-863b-ee09fdc4ce13 Oct 12 13:25:31.423480 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'security_group_rule': {'parent_group_id': '58307622-5a81-45b9-863b-ee09fdc4ce13', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 12 13:25:31.423480 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:31.423480 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:31.423480 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 12 13:25:31.423480 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 12 13:25:31.423480 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 12 13:25:31.423480 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 12 13:25:31.423480 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 58307622-5a81-45b9-863b-ee09fdc4ce13 Oct 12 13:25:31.423480 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:31.423480 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:31.423480 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:31.423480 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:31.423480 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:31.423480 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:31.423480 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:31.423480 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:31.423480 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:25:31.423480 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:25:31.423480 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:31.425117 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:31.425117 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 12 13:25:31.425117 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 13:25:31.425117 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 58307622-5a81-45b9-863b-ee09fdc4ce13 Oct 12 13:25:31.425117 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:31.425117 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:31.425117 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:31.425117 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:31.425117 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:31.425117 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:31.425117 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:31.425117 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:31.425117 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 58307622-5a81-45b9-863b-ee09fdc4ce13 Oct 12 13:25:31.425117 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:31.425117 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-15696243-1503-4763-b819-e97523d6052d tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Returning 400 to user: This rule already exists in group 58307622-5a81-45b9-863b-ee09fdc4ce13 {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:31.426270 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-15696243-1503-4763-b819-e97523d6052d tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.260360 Oct 12 13:25:31.426270 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 444/957] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 12 13:25:31 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 261 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:25:31.426270 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d4fe87d6-0c49-4f4f-ae56-b4cb9f4ef6ad tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bd921f0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:31.471489 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d4fe87d6-0c49-4f4f-ae56-b4cb9f4ef6ad tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.068226 Oct 12 13:25:31.481414 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 445/958] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:31 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:31.488245 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0bd1b90b-f221-49cf-be84-3ce8abdc61da tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Calling method '.version_select at 0x7f8a9be700d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:31.494163 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0bd1b90b-f221-49cf-be84-3ce8abdc61da tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:31.494871 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0bd1b90b-f221-49cf-be84-3ce8abdc61da tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:31.495188 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0bd1b90b-f221-49cf-be84-3ce8abdc61da tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:31.497226 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0bd1b90b-f221-49cf-be84-3ce8abdc61da tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:31.497931 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0bd1b90b-f221-49cf-be84-3ce8abdc61da tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:31.498623 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0bd1b90b-f221-49cf-be84-3ce8abdc61da tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:31.538989 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0bd1b90b-f221-49cf-be84-3ce8abdc61da tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.055465 Oct 12 13:25:31.539892 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 446/959] 10.222.0.52 () {58 vars in 1139 bytes} [Wed Oct 12 13:25:31 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:31.551257 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4cd9b094-a4cd-4106-afca-769d5584e3b6 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Calling method '.version_select at 0x7f8a9ba139d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:31.834003 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e9cc7126-0238-401d-b268-8d9e465e6a7e tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a5a43471b49fc9dac1aa301c50d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36da01f1b35e43be9c4a96d6cc118d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:31.845286 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e9cc7126-0238-401d-b268-8d9e465e6a7e tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] 10.222.0.52 "GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b" status: 200 len: 1322 microversion: 2.1 time: 0.542777 Oct 12 13:25:31.846463 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 514/960] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:31 2022] GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b => generated 1322 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:31.852356 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e146ada8-93b0-4620-9d61-7a6b308ca68d tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:31.855337 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-e146ada8-93b0-4620-9d61-7a6b308ca68d tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:31.871723 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e146ada8-93b0-4620-9d61-7a6b308ca68d tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:31.873495 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e146ada8-93b0-4620-9d61-7a6b308ca68d tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:31.874356 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e146ada8-93b0-4620-9d61-7a6b308ca68d tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:31.875359 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e146ada8-93b0-4620-9d61-7a6b308ca68d tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:31.876050 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e146ada8-93b0-4620-9d61-7a6b308ca68d tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:31.876762 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e146ada8-93b0-4620-9d61-7a6b308ca68d tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:32.302408 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e146ada8-93b0-4620-9d61-7a6b308ca68d tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:32.323505 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e146ada8-93b0-4620-9d61-7a6b308ca68d tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1322 microversion: 2.1 time: 0.474510 Oct 12 13:25:32.324596 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 515/961] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:31 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1322 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:32.343388 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cecd89e1-cbbb-4d64-b6fe-b09b51b3a178 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Calling method '.version_select at 0x7f8aa0321d30>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:32.349317 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cecd89e1-cbbb-4d64-b6fe-b09b51b3a178 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:32.352083 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cecd89e1-cbbb-4d64-b6fe-b09b51b3a178 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:32.352773 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cecd89e1-cbbb-4d64-b6fe-b09b51b3a178 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:32.354216 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cecd89e1-cbbb-4d64-b6fe-b09b51b3a178 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:32.355933 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cecd89e1-cbbb-4d64-b6fe-b09b51b3a178 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:32.356710 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cecd89e1-cbbb-4d64-b6fe-b09b51b3a178 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:32.430962 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-cecd89e1-cbbb-4d64-b6fe-b09b51b3a178 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.105118 Oct 12 13:25:32.433407 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 516/962] 10.222.0.52 () {58 vars in 1145 bytes} [Wed Oct 12 13:25:32 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:25:32.434146 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4cd9b094-a4cd-4106-afca-769d5584e3b6 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-group-rules/2ac272d1-4ece-4335-93b3-aa2ce17a0f41" status: 202 len: 0 microversion: 2.1 time: 0.892846 Oct 12 13:25:32.434992 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 447/963] 10.222.0.52 () {58 vars in 1287 bytes} [Wed Oct 12 13:25:31 2022] DELETE /compute/v2.1/os-security-group-rules/2ac272d1-4ece-4335-93b3-aa2ce17a0f41 => generated 0 bytes in 894 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:25:32.444126 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-569e569c-818d-4c67-98d8-c2c42dc94fd5 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Action: 'create', calling method: .version_select at 0x7f8a9ba51310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-916516268", "description": "tempest-description-844027390"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:32.444597 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d516eae3-2444-4340-af3c-2609cc4ce4bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:32.445504 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-d516eae3-2444-4340-af3c-2609cc4ce4bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:32.474724 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d516eae3-2444-4340-af3c-2609cc4ce4bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:32.484802 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d516eae3-2444-4340-af3c-2609cc4ce4bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:32.486262 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d516eae3-2444-4340-af3c-2609cc4ce4bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:32.499559 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d516eae3-2444-4340-af3c-2609cc4ce4bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:32.499559 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d516eae3-2444-4340-af3c-2609cc4ce4bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:32.499559 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d516eae3-2444-4340-af3c-2609cc4ce4bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:32.511216 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=100 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:25:32.871420 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d516eae3-2444-4340-af3c-2609cc4ce4bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:32.912884 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d516eae3-2444-4340-af3c-2609cc4ce4bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1316 microversion: 2.1 time: 0.474075 Oct 12 13:25:32.926678 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 517/964] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:32 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1316 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:32.955375 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-37275c61-e44b-42f9-9774-b840f2fcccb5 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Calling method '.version_select at 0x7f8aa03b6b80>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:32.964780 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-37275c61-e44b-42f9-9774-b840f2fcccb5 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:32.965306 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-37275c61-e44b-42f9-9774-b840f2fcccb5 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:32.969788 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-37275c61-e44b-42f9-9774-b840f2fcccb5 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:32.982470 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-37275c61-e44b-42f9-9774-b840f2fcccb5 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:32.985826 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-37275c61-e44b-42f9-9774-b840f2fcccb5 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:32.986954 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-37275c61-e44b-42f9-9774-b840f2fcccb5 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:33.085054 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-37275c61-e44b-42f9-9774-b840f2fcccb5 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.163115 Oct 12 13:25:33.085725 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 518/965] 10.222.0.52 () {58 vars in 1128 bytes} [Wed Oct 12 13:25:32 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:33.106040 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-004ab4b5-0162-423d-a3c6-79fdbbe865fe tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa038c1f0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:33.202092 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-004ab4b5-0162-423d-a3c6-79fdbbe865fe tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.115273 Oct 12 13:25:33.203432 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 519/966] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:33 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:33.209888 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-bbe97f3b-c24b-4d13-aa0e-f811eb657be7 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:33.211255 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-bbe97f3b-c24b-4d13-aa0e-f811eb657be7 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] [instance: 182dba37-e456-46a8-8ee6-255a657bcd6b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:33.221969 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bbe97f3b-c24b-4d13-aa0e-f811eb657be7 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:33.221969 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bbe97f3b-c24b-4d13-aa0e-f811eb657be7 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:33.222282 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bbe97f3b-c24b-4d13-aa0e-f811eb657be7 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:33.223482 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bbe97f3b-c24b-4d13-aa0e-f811eb657be7 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:33.223969 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bbe97f3b-c24b-4d13-aa0e-f811eb657be7 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:33.224551 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bbe97f3b-c24b-4d13-aa0e-f811eb657be7 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:33.350635 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-569e569c-818d-4c67-98d8-c2c42dc94fd5 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.910131 Oct 12 13:25:33.351624 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 448/967] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:25:32 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:33.357859 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cbc495a4-38c8-4cfa-87a4-97149278b80c tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Calling method '.version_select at 0x7f8a9ba5f430>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:33.370048 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cbc495a4-38c8-4cfa-87a4-97149278b80c tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:33.372170 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cbc495a4-38c8-4cfa-87a4-97149278b80c tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:33.376686 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cbc495a4-38c8-4cfa-87a4-97149278b80c tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:33.380363 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cbc495a4-38c8-4cfa-87a4-97149278b80c tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:33.380954 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cbc495a4-38c8-4cfa-87a4-97149278b80c tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:33.381591 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cbc495a4-38c8-4cfa-87a4-97149278b80c tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:33.494685 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cbc495a4-38c8-4cfa-87a4-97149278b80c tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.141829 Oct 12 13:25:33.496762 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 449/968] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 12 13:25:33 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:33.511365 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3ce336aa-ab2c-4b73-8a89-67df45f01ce4 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:33.512333 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3ce336aa-ab2c-4b73-8a89-67df45f01ce4 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:33.530823 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ce336aa-ab2c-4b73-8a89-67df45f01ce4 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:33.531354 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ce336aa-ab2c-4b73-8a89-67df45f01ce4 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:33.531811 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ce336aa-ab2c-4b73-8a89-67df45f01ce4 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:33.532551 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ce336aa-ab2c-4b73-8a89-67df45f01ce4 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:33.533057 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ce336aa-ab2c-4b73-8a89-67df45f01ce4 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:33.534040 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ce336aa-ab2c-4b73-8a89-67df45f01ce4 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:34.054748 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-bbe97f3b-c24b-4d13-aa0e-f811eb657be7 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a5a43471b49fc9dac1aa301c50d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36da01f1b35e43be9c4a96d6cc118d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:34.088743 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-bbe97f3b-c24b-4d13-aa0e-f811eb657be7 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] 10.222.0.52 "GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b" status: 200 len: 1322 microversion: 2.1 time: 0.882363 Oct 12 13:25:34.121134 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 520/969] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:33 2022] GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b => generated 1322 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:34.138807 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e07f3e17-3cfe-453c-875a-bdcfe29d9de0 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Action: 'create', calling method: .version_select at 0x7f8aa002a310>, body: {"security_group_rule": {"parent_group_id": "45eae59c-c20d-4985-b84f-f7bda0620e31", "ip_protocol": "tcp", "from_port": 1551681489, "to_port": 22}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:34.144557 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-3ce336aa-ab2c-4b73-8a89-67df45f01ce4 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:34.157329 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3ce336aa-ab2c-4b73-8a89-67df45f01ce4 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1322 microversion: 2.1 time: 0.658726 Oct 12 13:25:34.160524 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 450/970] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:33 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1322 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:34.173672 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-236167dc-8c45-4fba-a268-40208481d76f tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Calling method '.version_select at 0x7f8a9bd590d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:34.183373 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-236167dc-8c45-4fba-a268-40208481d76f tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:34.184382 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-236167dc-8c45-4fba-a268-40208481d76f tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:34.185076 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-236167dc-8c45-4fba-a268-40208481d76f tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:34.187114 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-236167dc-8c45-4fba-a268-40208481d76f tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:34.192507 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-236167dc-8c45-4fba-a268-40208481d76f tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:34.193108 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-236167dc-8c45-4fba-a268-40208481d76f tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:34.258786 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-236167dc-8c45-4fba-a268-40208481d76f tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.096741 Oct 12 13:25:34.265520 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 451/971] 10.222.0.52 () {58 vars in 1128 bytes} [Wed Oct 12 13:25:34 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:34.275297 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-989fdd0b-ff3a-49d7-bee0-9c542cfeadc7 req-403b4f4d-49e8-4b72-83c9-18a33be38e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3676307-e5eb-4e25-ab76-44f29e7a4b21", "name": "network-vif-plugged", "status": "completed", "tag": "e0775306-4e5e-4e35-948b-06c20220585f"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:34.287800 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-989fdd0b-ff3a-49d7-bee0-9c542cfeadc7 req-403b4f4d-49e8-4b72-83c9-18a33be38e7a service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:34.288519 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-989fdd0b-ff3a-49d7-bee0-9c542cfeadc7 req-403b4f4d-49e8-4b72-83c9-18a33be38e7a service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:34.289178 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-989fdd0b-ff3a-49d7-bee0-9c542cfeadc7 req-403b4f4d-49e8-4b72-83c9-18a33be38e7a service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:34.315674 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-989fdd0b-ff3a-49d7-bee0-9c542cfeadc7 req-403b4f4d-49e8-4b72-83c9-18a33be38e7a service nova] Creating event network-vif-plugged:e0775306-4e5e-4e35-948b-06c20220585f for instance f3676307-e5eb-4e25-ab76-44f29e7a4b21 on n-h2-861076-2 Oct 12 13:25:34.327213 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-e07f3e17-3cfe-453c-875a-bdcfe29d9de0 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] HTTP exception thrown: Invalid port range 1551681489:22. Former value cannot be greater than the later Oct 12 13:25:34.330114 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e07f3e17-3cfe-453c-875a-bdcfe29d9de0 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Request method failure captured: Oct 12 13:25:34.330114 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 13:25:34.330114 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:25:34.330114 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:25:34.330114 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:25:34.330114 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 146 Oct 12 13:25:34.330114 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:25:34.330114 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:25:34.330114 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:25:34.330114 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:34.330114 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsBEkZZs7Gre384Iv-UKcvb_KTJCmSNSqyb85WjtZRgWgB9P1SVrqtW3kF_xkHZpKDcbkcjUCQ4_1nAbXGtzD9BYVleCRFfiBXwptTGiDECyK19FcwWxbjlw0BUgsPLP1OQrOCGe55u33_-j8i5BiIrq4kPMAcH3OvmpD41DoXn81wI Oct 12 13:25:34.330114 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:25:34.330114 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:25:34.330114 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:25:34.330114 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:25:34.330114 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:25:34.330114 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:25:34.330114 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: acdc5afde34947f9a13b64c4179587d5 Oct 12 13:25:34.330114 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:34.330114 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:25:34.330114 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:25:34.339093 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/acdc5afde34947f9a13b64c4179587d5"}]}] Oct 12 13:25:34.339093 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:34.339093 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: acdc5afde34947f9a13b64c4179587d5 Oct 12 13:25:34.339093 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:34.339093 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-911474027-project Oct 12 13:25:34.339093 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:25:34.339093 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:25:34.339093 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 4549aaa6806b4c138a9bdf54e7b2965e Oct 12 13:25:34.339093 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027-project Oct 12 13:25:34.339093 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:25:34.339093 n-d-861076-2 devstack@n-api.service[120933]: {"security_group_rule": {"parent_group_id": "45eae59c-c20d-4985-b84f-f7bda0620e31", "ip_protocol": "tcp", "from_port": 1551681489, "to_port": 22}} Oct 12 13:25:34.339093 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:25:34.339846 n-d-861076-2 devstack@n-api.service[120933]: exception: Invalid port range 1551681489:22. Former value cannot be greater than the later Oct 12 13:25:34.339846 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'security_group_rule': {'parent_group_id': '45eae59c-c20d-4985-b84f-f7bda0620e31', 'ip_protocol': 'tcp', 'from_port': 1551681489, 'to_port': 22}}} Oct 12 13:25:34.339846 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:34.339846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:34.339846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 12 13:25:34.339846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 12 13:25:34.339846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 12 13:25:34.339846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 12 13:25:34.339846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 12 13:25:34.339846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 12 13:25:34.339846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 12 13:25:34.339846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 12 13:25:34.339846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1551681489:22. Former value cannot be greater than the later Oct 12 13:25:34.339846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:34.339846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:34.339846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:34.339846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:34.339846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:34.339846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:34.341247 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:34.341247 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:34.341247 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:25:34.341247 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:25:34.341247 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:34.341247 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:34.341247 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 12 13:25:34.341247 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 13:25:34.341247 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1551681489:22. Former value cannot be greater than the later Oct 12 13:25:34.341247 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:34.341247 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:34.341247 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:34.341247 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:34.341247 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:34.341247 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:34.341247 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:34.341247 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:34.341247 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1551681489:22. Former value cannot be greater than the later Oct 12 13:25:34.341247 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:34.342471 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e07f3e17-3cfe-453c-875a-bdcfe29d9de0 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Returning 400 to user: Invalid port range 1551681489:22. Former value cannot be greater than the later {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:34.342471 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e07f3e17-3cfe-453c-875a-bdcfe29d9de0 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.208836 Oct 12 13:25:34.342471 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 521/972] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 12 13:25:34 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 214 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:25:34.347781 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-989fdd0b-ff3a-49d7-bee0-9c542cfeadc7 req-403b4f4d-49e8-4b72-83c9-18a33be38e7a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079258 Oct 12 13:25:34.348770 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 452/973] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:34.363464 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3d4c6211-1756-44c0-af7d-aba4dbf5e2f0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9ba423a0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:34.375528 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b62a0aff-2039-49e3-a8e3-4be782f542ed tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:34.413762 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-b62a0aff-2039-49e3-a8e3-4be782f542ed tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:34.435011 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b62a0aff-2039-49e3-a8e3-4be782f542ed tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:34.435518 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b62a0aff-2039-49e3-a8e3-4be782f542ed tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:34.441192 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b62a0aff-2039-49e3-a8e3-4be782f542ed tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:34.442388 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b62a0aff-2039-49e3-a8e3-4be782f542ed tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:34.446476 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b62a0aff-2039-49e3-a8e3-4be782f542ed tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:34.448694 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3d4c6211-1756-44c0-af7d-aba4dbf5e2f0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.097287 Oct 12 13:25:34.450029 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b62a0aff-2039-49e3-a8e3-4be782f542ed tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:34.457676 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 453/974] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:34 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:34.469148 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a50a9455-cd91-4406-8d41-6cdedfd7e2f8 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Calling method '.version_select at 0x7f8a9ba29b80>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:34.494515 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a50a9455-cd91-4406-8d41-6cdedfd7e2f8 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:34.495009 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a50a9455-cd91-4406-8d41-6cdedfd7e2f8 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:34.495697 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a50a9455-cd91-4406-8d41-6cdedfd7e2f8 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:34.539500 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a50a9455-cd91-4406-8d41-6cdedfd7e2f8 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:34.540303 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a50a9455-cd91-4406-8d41-6cdedfd7e2f8 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:34.544381 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a50a9455-cd91-4406-8d41-6cdedfd7e2f8 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:34.582942 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a50a9455-cd91-4406-8d41-6cdedfd7e2f8 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-h1-861076-2" status: 200 len: 729 microversion: 2.1 time: 0.123768 Oct 12 13:25:34.592455 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 454/975] 10.222.0.52 () {58 vars in 1170 bytes} [Wed Oct 12 13:25:34 2022] GET /compute/v2.1/os-hosts/n-h1-861076-2 => generated 729 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:34.592455 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a391079a-8914-4f27-b366-28dec2e6a052 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Action: 'create', calling method: .version_select at 0x7f8a9ba429d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-778265123", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:34.592455 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-a391079a-8914-4f27-b366-28dec2e6a052 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] HTTP exception thrown: Security group id should be uuid Oct 12 13:25:34.593792 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a391079a-8914-4f27-b366-28dec2e6a052 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Request method failure captured: Oct 12 13:25:34.593792 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 13:25:34.593792 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:25:34.593792 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:25:34.593792 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:25:34.593792 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 130 Oct 12 13:25:34.593792 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:25:34.593792 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:25:34.593792 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:25:34.593792 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:34.593792 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsBEkZZs7Gre384Iv-UKcvb_KTJCmSNSqyb85WjtZRgWgB9P1SVrqtW3kF_xkHZpKDcbkcjUCQ4_1nAbXGtzD9BYVleCRFfiBXwptTGiDECyK19FcwWxbjlw0BUgsPLP1OQrOCGe55u33_-j8i5BiIrq4kPMAcH3OvmpD41DoXn81wI Oct 12 13:25:34.593792 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:25:34.593792 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:25:34.593792 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:25:34.593792 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:25:34.593792 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:25:34.593792 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:25:34.593792 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: acdc5afde34947f9a13b64c4179587d5 Oct 12 13:25:34.593792 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:34.593792 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:25:34.593792 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:25:34.595125 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/acdc5afde34947f9a13b64c4179587d5"}]}] Oct 12 13:25:34.595125 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:34.595125 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: acdc5afde34947f9a13b64c4179587d5 Oct 12 13:25:34.595125 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:34.595125 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-911474027-project Oct 12 13:25:34.595125 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:25:34.595125 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:25:34.595125 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 4549aaa6806b4c138a9bdf54e7b2965e Oct 12 13:25:34.595125 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027-project Oct 12 13:25:34.595125 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:25:34.595125 n-d-861076-2 devstack@n-api.service[120932]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-778265123", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 12 13:25:34.595125 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:25:34.595125 n-d-861076-2 devstack@n-api.service[120932]: exception: Security group id should be uuid Oct 12 13:25:34.595953 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-778265123', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 12 13:25:34.595953 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:34.595953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:34.595953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 12 13:25:34.595953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 12 13:25:34.595953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 12 13:25:34.595953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 12 13:25:34.595953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 12 13:25:34.595953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:34.595953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:34.595953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:34.595953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:34.595953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:34.595953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:34.595953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:34.595953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:34.595953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:25:34.595953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:25:34.595953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:34.595953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:34.597174 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 12 13:25:34.597174 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 13:25:34.597174 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 12 13:25:34.597174 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:34.597174 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:34.597174 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:34.597174 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:34.597174 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:34.597174 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:34.597174 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:34.597174 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:34.597174 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 12 13:25:34.597174 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:34.599387 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a391079a-8914-4f27-b366-28dec2e6a052 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Returning 400 to user: Security group id should be uuid {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:34.600437 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a391079a-8914-4f27-b366-28dec2e6a052 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.015411 Oct 12 13:25:34.601533 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 455/976] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 12 13:25:34 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 13:25:34.606212 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-97b918a7-7693-4647-8e59-fa0e4efbb695 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Calling method '.version_select at 0x7f8a9ba42940>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:34.616740 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97b918a7-7693-4647-8e59-fa0e4efbb695 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:34.617429 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97b918a7-7693-4647-8e59-fa0e4efbb695 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:34.617927 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97b918a7-7693-4647-8e59-fa0e4efbb695 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:34.636723 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97b918a7-7693-4647-8e59-fa0e4efbb695 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:34.637534 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97b918a7-7693-4647-8e59-fa0e4efbb695 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:34.638122 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97b918a7-7693-4647-8e59-fa0e4efbb695 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:34.686234 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-97b918a7-7693-4647-8e59-fa0e4efbb695 tempest-HostsAdminTestJSON-1393355772 tempest-HostsAdminTestJSON-1393355772-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-h2-861076-2" status: 200 len: 729 microversion: 2.1 time: 0.083352 Oct 12 13:25:34.687375 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 456/977] 10.222.0.52 () {58 vars in 1170 bytes} [Wed Oct 12 13:25:34 2022] GET /compute/v2.1/os-hosts/n-h2-861076-2 => generated 729 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:34.698841 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-03433d36-2b1c-4fc4-8415-b61f50944a24 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Action: 'create', calling method: .version_select at 0x7f8a9ba420d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1084597051", "description": "tempest-description-811029198"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:35.056557 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b62a0aff-2039-49e3-a8e3-4be782f542ed tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:35.068458 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b62a0aff-2039-49e3-a8e3-4be782f542ed tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1316 microversion: 2.1 time: 0.729784 Oct 12 13:25:35.069334 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 522/978] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:34 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1316 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:35.114165 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-99bcaecd-1562-4d8a-97b2-72890d83cfa6 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:35.115122 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-99bcaecd-1562-4d8a-97b2-72890d83cfa6 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] [instance: 182dba37-e456-46a8-8ee6-255a657bcd6b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:35.124022 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-99bcaecd-1562-4d8a-97b2-72890d83cfa6 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:35.125595 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-99bcaecd-1562-4d8a-97b2-72890d83cfa6 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:35.136581 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-99bcaecd-1562-4d8a-97b2-72890d83cfa6 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:35.137692 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-99bcaecd-1562-4d8a-97b2-72890d83cfa6 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:35.141200 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-99bcaecd-1562-4d8a-97b2-72890d83cfa6 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:35.141810 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-99bcaecd-1562-4d8a-97b2-72890d83cfa6 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:35.469803 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-99bcaecd-1562-4d8a-97b2-72890d83cfa6 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a5a43471b49fc9dac1aa301c50d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36da01f1b35e43be9c4a96d6cc118d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:35.484116 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-99bcaecd-1562-4d8a-97b2-72890d83cfa6 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] 10.222.0.52 "GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b" status: 200 len: 1322 microversion: 2.1 time: 0.374802 Oct 12 13:25:35.484711 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 523/979] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:35 2022] GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b => generated 1322 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:25:35.494262 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cfbe25dc-eac8-4c11-bdbd-7670c2acba48 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:35.498928 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-cfbe25dc-eac8-4c11-bdbd-7670c2acba48 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:35.506107 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cfbe25dc-eac8-4c11-bdbd-7670c2acba48 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:35.506803 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cfbe25dc-eac8-4c11-bdbd-7670c2acba48 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:35.507581 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cfbe25dc-eac8-4c11-bdbd-7670c2acba48 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:35.508975 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cfbe25dc-eac8-4c11-bdbd-7670c2acba48 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:35.509591 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cfbe25dc-eac8-4c11-bdbd-7670c2acba48 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:35.510175 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cfbe25dc-eac8-4c11-bdbd-7670c2acba48 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:35.654210 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-03433d36-2b1c-4fc4-8415-b61f50944a24 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.965678 Oct 12 13:25:35.654804 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 457/980] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:25:34 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:35.666801 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b537a195-3016-49b9-b291-9ced09cc022e tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9ba29790>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:35.756303 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b537a195-3016-49b9-b291-9ced09cc022e tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.100060 Oct 12 13:25:35.767902 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 458/981] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:35 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:35.793590 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8f9ac3e6-054c-4382-9f61-674cd666a42e tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Action: 'create', calling method: .version_select at 0x7f8a9ba5fc10>, body: {"security_group_rule": {"parent_group_id": "6b39af8b-144a-4b7a-9da3-3cbabdf4c330", "ip_protocol": "tempest-999-275530111", "from_port": 22, "to_port": 22}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:36.267807 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-8f9ac3e6-054c-4382-9f61-674cd666a42e tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] HTTP exception thrown: Invalid IP protocol tempest-999-275530111. Oct 12 13:25:36.270117 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8f9ac3e6-054c-4382-9f61-674cd666a42e tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Request method failure captured: Oct 12 13:25:36.270117 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 13:25:36.270117 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:25:36.270117 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:25:36.270117 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:25:36.270117 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 156 Oct 12 13:25:36.270117 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:25:36.270117 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:25:36.270117 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:25:36.270117 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:36.270117 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsBEkZZs7Gre384Iv-UKcvb_KTJCmSNSqyb85WjtZRgWgB9P1SVrqtW3kF_xkHZpKDcbkcjUCQ4_1nAbXGtzD9BYVleCRFfiBXwptTGiDECyK19FcwWxbjlw0BUgsPLP1OQrOCGe55u33_-j8i5BiIrq4kPMAcH3OvmpD41DoXn81wI Oct 12 13:25:36.270117 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:25:36.270117 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:25:36.270117 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:25:36.270117 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:25:36.270117 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:25:36.270117 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:25:36.270117 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: acdc5afde34947f9a13b64c4179587d5 Oct 12 13:25:36.270117 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:36.270117 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:25:36.270117 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:25:36.271717 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/acdc5afde34947f9a13b64c4179587d5"}]}] Oct 12 13:25:36.271717 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:36.271717 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: acdc5afde34947f9a13b64c4179587d5 Oct 12 13:25:36.271717 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:36.271717 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-911474027-project Oct 12 13:25:36.271717 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:25:36.271717 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:25:36.271717 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 4549aaa6806b4c138a9bdf54e7b2965e Oct 12 13:25:36.271717 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027-project Oct 12 13:25:36.271717 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:25:36.271717 n-d-861076-2 devstack@n-api.service[120932]: {"security_group_rule": {"parent_group_id": "6b39af8b-144a-4b7a-9da3-3cbabdf4c330", "ip_protocol": "tempest-999-275530111", "from_port": 22, "to_port": 22}} Oct 12 13:25:36.271717 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:25:36.272652 n-d-861076-2 devstack@n-api.service[120932]: exception: Invalid IP protocol tempest-999-275530111. Oct 12 13:25:36.272652 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6b39af8b-144a-4b7a-9da3-3cbabdf4c330', 'ip_protocol': 'tempest-999-275530111', 'from_port': 22, 'to_port': 22}}} Oct 12 13:25:36.272652 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:36.272652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:36.272652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 12 13:25:36.272652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 12 13:25:36.272652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 12 13:25:36.272652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 12 13:25:36.272652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 12 13:25:36.272652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 12 13:25:36.272652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 12 13:25:36.272652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 12 13:25:36.272652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-275530111. Oct 12 13:25:36.272652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:36.272652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:36.272652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:36.272652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:36.272652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:36.272652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:36.274485 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:36.274485 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:36.274485 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:25:36.274485 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:25:36.274485 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:36.274485 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:36.274485 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 12 13:25:36.274485 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 13:25:36.274485 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-275530111. Oct 12 13:25:36.274485 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:36.274485 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:36.274485 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:36.274485 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:36.274485 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:36.274485 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:36.274485 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:36.274485 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:36.274485 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-275530111. Oct 12 13:25:36.274485 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:36.275846 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8f9ac3e6-054c-4382-9f61-674cd666a42e tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Returning 400 to user: Invalid IP protocol tempest-999-275530111. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:36.275846 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8f9ac3e6-054c-4382-9f61-674cd666a42e tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.499656 Oct 12 13:25:36.275846 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 459/982] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 12 13:25:35 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 504 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 13:25:36.288214 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b7150ab6-de2a-4ae6-bd1f-239893aa4b24 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:36.289018 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b7150ab6-de2a-4ae6-bd1f-239893aa4b24 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:36.309174 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-cfbe25dc-eac8-4c11-bdbd-7670c2acba48 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:36.317040 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7150ab6-de2a-4ae6-bd1f-239893aa4b24 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:36.318533 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7150ab6-de2a-4ae6-bd1f-239893aa4b24 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:36.319361 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7150ab6-de2a-4ae6-bd1f-239893aa4b24 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:36.321054 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7150ab6-de2a-4ae6-bd1f-239893aa4b24 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:36.322388 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7150ab6-de2a-4ae6-bd1f-239893aa4b24 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:36.324032 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7150ab6-de2a-4ae6-bd1f-239893aa4b24 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:36.324957 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-cfbe25dc-eac8-4c11-bdbd-7670c2acba48 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1322 microversion: 2.1 time: 0.837633 Oct 12 13:25:36.341395 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 524/983] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:35 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1322 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:36.359506 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-49542d7d-8fd1-4aa0-aa9f-aba8c904b0e4 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Action: 'create', calling method: .version_select at 0x7f8aa03f3b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1774173716", "description": "tempest-description-619770430"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:36.522784 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-b7150ab6-de2a-4ae6-bd1f-239893aa4b24 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:36.544969 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b7150ab6-de2a-4ae6-bd1f-239893aa4b24 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1316 microversion: 2.1 time: 0.271528 Oct 12 13:25:36.581278 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 460/984] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:36 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1316 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:36.586389 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d32187d8-f7fa-4d27-bb76-0d643a02318d tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:36.597199 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d32187d8-f7fa-4d27-bb76-0d643a02318d tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] [instance: 182dba37-e456-46a8-8ee6-255a657bcd6b] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:36.620138 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d32187d8-f7fa-4d27-bb76-0d643a02318d tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:36.628492 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d32187d8-f7fa-4d27-bb76-0d643a02318d tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:36.633841 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d32187d8-f7fa-4d27-bb76-0d643a02318d tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:36.634884 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d32187d8-f7fa-4d27-bb76-0d643a02318d tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:36.635360 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d32187d8-f7fa-4d27-bb76-0d643a02318d tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:36.635793 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d32187d8-f7fa-4d27-bb76-0d643a02318d tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:37.000732 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-49542d7d-8fd1-4aa0-aa9f-aba8c904b0e4 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.656911 Oct 12 13:25:37.014035 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 525/985] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:25:36 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:37.021473 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ddea7f8b-fda7-4d8a-9f08-3a58a82ae1b1 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa01d65e0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:37.045801 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d32187d8-f7fa-4d27-bb76-0d643a02318d tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a5a43471b49fc9dac1aa301c50d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36da01f1b35e43be9c4a96d6cc118d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:37.058984 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d32187d8-f7fa-4d27-bb76-0d643a02318d tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] 10.222.0.52 "GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b" status: 200 len: 1322 microversion: 2.1 time: 0.476480 Oct 12 13:25:37.059864 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 461/986] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:36 2022] GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b => generated 1322 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:37.066405 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2abf4f48-53d3-4354-853b-fcff77c29c26 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Action: 'create', calling method: .version_select at 0x7f8a9ba42550>, body: {"security_group_rule": {"parent_group_id": "b648981a-e430-4f43-8bcb-e86913af3130", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:37.114084 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ddea7f8b-fda7-4d8a-9f08-3a58a82ae1b1 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.098766 Oct 12 13:25:37.117172 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 526/987] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:37 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:37.135583 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-2abf4f48-53d3-4354-853b-fcff77c29c26 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 12 13:25:37.137798 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2abf4f48-53d3-4354-853b-fcff77c29c26 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Request method failure captured: Oct 12 13:25:37.137798 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 13:25:37.137798 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:25:37.137798 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:25:37.137798 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:25:37.137798 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 138 Oct 12 13:25:37.137798 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:25:37.137798 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:25:37.137798 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:25:37.137798 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:37.137798 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsBEkZZs7Gre384Iv-UKcvb_KTJCmSNSqyb85WjtZRgWgB9P1SVrqtW3kF_xkHZpKDcbkcjUCQ4_1nAbXGtzD9BYVleCRFfiBXwptTGiDECyK19FcwWxbjlw0BUgsPLP1OQrOCGe55u33_-j8i5BiIrq4kPMAcH3OvmpD41DoXn81wI Oct 12 13:25:37.137798 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:25:37.137798 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:25:37.137798 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:25:37.137798 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:25:37.137798 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:25:37.137798 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:25:37.137798 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: acdc5afde34947f9a13b64c4179587d5 Oct 12 13:25:37.137798 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:37.137798 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:25:37.137798 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:25:37.139153 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/acdc5afde34947f9a13b64c4179587d5"}]}] Oct 12 13:25:37.139153 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:37.139153 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: acdc5afde34947f9a13b64c4179587d5 Oct 12 13:25:37.139153 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:37.139153 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-911474027-project Oct 12 13:25:37.139153 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:25:37.139153 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:25:37.139153 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 4549aaa6806b4c138a9bdf54e7b2965e Oct 12 13:25:37.139153 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027-project Oct 12 13:25:37.139153 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:25:37.139153 n-d-861076-2 devstack@n-api.service[120932]: {"security_group_rule": {"parent_group_id": "b648981a-e430-4f43-8bcb-e86913af3130", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 12 13:25:37.139153 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:25:37.139929 n-d-861076-2 devstack@n-api.service[120932]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 12 13:25:37.139929 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b648981a-e430-4f43-8bcb-e86913af3130', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 12 13:25:37.139929 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:37.139929 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:37.139929 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 12 13:25:37.139929 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 12 13:25:37.139929 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 12 13:25:37.139929 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 12 13:25:37.139929 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 12 13:25:37.139929 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 12 13:25:37.139929 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 12 13:25:37.139929 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 12 13:25:37.139929 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 12 13:25:37.139929 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:37.139929 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:37.139929 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:37.139929 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:37.139929 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:37.139929 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:37.141166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:37.141166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:37.141166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:25:37.141166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:25:37.141166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:37.141166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:37.141166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 12 13:25:37.141166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 13:25:37.141166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 12 13:25:37.141166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:37.141166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:37.141166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:37.141166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:37.141166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:37.141166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:37.141166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:37.141166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:37.141166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 12 13:25:37.141166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:37.144752 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2abf4f48-53d3-4354-853b-fcff77c29c26 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:37.145956 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2abf4f48-53d3-4354-853b-fcff77c29c26 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.084840 Oct 12 13:25:37.146818 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 462/988] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 12 13:25:37 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:25:37.158893 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-12504a00-d6ea-4d2b-bef5-620e2759c593 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Action: 'create', calling method: .version_select at 0x7f8a9bdb1c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1197503259", "description": "tempest-description-898244787"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:37.266517 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-407d38f8-e377-4cfd-be2c-6fbf54dd2d01 req-3d5e035a-829c-4358-b39e-95fa4611ba15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "182dba37-e456-46a8-8ee6-255a657bcd6b", "name": "network-vif-plugged", "status": "completed", "tag": "819ba82b-dd17-45b9-b70c-d488542a44e9"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:37.294015 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-407d38f8-e377-4cfd-be2c-6fbf54dd2d01 req-3d5e035a-829c-4358-b39e-95fa4611ba15 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:37.296217 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-407d38f8-e377-4cfd-be2c-6fbf54dd2d01 req-3d5e035a-829c-4358-b39e-95fa4611ba15 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:37.296925 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-407d38f8-e377-4cfd-be2c-6fbf54dd2d01 req-3d5e035a-829c-4358-b39e-95fa4611ba15 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:37.322669 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-407d38f8-e377-4cfd-be2c-6fbf54dd2d01 req-3d5e035a-829c-4358-b39e-95fa4611ba15 service nova] Creating event network-vif-plugged:819ba82b-dd17-45b9-b70c-d488542a44e9 for instance 182dba37-e456-46a8-8ee6-255a657bcd6b on n-h1-861076-2 Oct 12 13:25:37.333873 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-407d38f8-e377-4cfd-be2c-6fbf54dd2d01 req-3d5e035a-829c-4358-b39e-95fa4611ba15 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074823 Oct 12 13:25:37.336332 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 463/989] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:37.361365 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e779b080-80a4-421e-8d8d-8f2bf7a51dd7 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:37.364044 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e779b080-80a4-421e-8d8d-8f2bf7a51dd7 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:37.378559 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e779b080-80a4-421e-8d8d-8f2bf7a51dd7 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:37.380638 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e779b080-80a4-421e-8d8d-8f2bf7a51dd7 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:37.383898 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e779b080-80a4-421e-8d8d-8f2bf7a51dd7 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:37.385814 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e779b080-80a4-421e-8d8d-8f2bf7a51dd7 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:37.386453 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e779b080-80a4-421e-8d8d-8f2bf7a51dd7 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:37.387184 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e779b080-80a4-421e-8d8d-8f2bf7a51dd7 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:37.734381 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-e779b080-80a4-421e-8d8d-8f2bf7a51dd7 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:37.748328 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-12504a00-d6ea-4d2b-bef5-620e2759c593 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.596116 Oct 12 13:25:37.749567 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 527/990] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:25:37 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:37.755549 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-da222490-68b3-4ee4-8d9d-d5dd181a3b19 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:37.756933 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-da222490-68b3-4ee4-8d9d-d5dd181a3b19 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:37.758710 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e779b080-80a4-421e-8d8d-8f2bf7a51dd7 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1472 microversion: 2.1 time: 0.405830 Oct 12 13:25:37.759324 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 464/991] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:37 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1472 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:37.764701 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-82330726-e3cf-4612-8710-b4c5af28b1d1 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Action: 'create', calling method: .version_select at 0x7f8a9ba13940>, body: {"security_group_rule": {"parent_group_id": "02a1600c-0bda-4de1-91ae-d096b34a062d", "ip_protocol": "tcp", "from_port": 22, "to_port": 994373307}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:37.778984 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da222490-68b3-4ee4-8d9d-d5dd181a3b19 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:37.779791 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da222490-68b3-4ee4-8d9d-d5dd181a3b19 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:37.780623 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da222490-68b3-4ee4-8d9d-d5dd181a3b19 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:37.781573 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da222490-68b3-4ee4-8d9d-d5dd181a3b19 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:37.782182 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da222490-68b3-4ee4-8d9d-d5dd181a3b19 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:37.782752 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da222490-68b3-4ee4-8d9d-d5dd181a3b19 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:37.826203 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-82330726-e3cf-4612-8710-b4c5af28b1d1 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] HTTP exception thrown: Invalid port range 22:994373307. Valid TCP ports should be between 1-65535 Oct 12 13:25:37.828295 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-82330726-e3cf-4612-8710-b4c5af28b1d1 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Request method failure captured: Oct 12 13:25:37.828295 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 13:25:37.828295 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:25:37.828295 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:25:37.828295 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:25:37.828295 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 145 Oct 12 13:25:37.828295 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:25:37.828295 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:25:37.828295 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:25:37.828295 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:37.828295 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsBEkZZs7Gre384Iv-UKcvb_KTJCmSNSqyb85WjtZRgWgB9P1SVrqtW3kF_xkHZpKDcbkcjUCQ4_1nAbXGtzD9BYVleCRFfiBXwptTGiDECyK19FcwWxbjlw0BUgsPLP1OQrOCGe55u33_-j8i5BiIrq4kPMAcH3OvmpD41DoXn81wI Oct 12 13:25:37.828295 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:25:37.828295 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:25:37.828295 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:25:37.828295 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:25:37.828295 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:25:37.828295 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:25:37.828295 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: acdc5afde34947f9a13b64c4179587d5 Oct 12 13:25:37.828295 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:37.828295 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:25:37.828295 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:25:37.835754 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/acdc5afde34947f9a13b64c4179587d5"}]}] Oct 12 13:25:37.835754 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:37.835754 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: acdc5afde34947f9a13b64c4179587d5 Oct 12 13:25:37.835754 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:37.835754 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-911474027-project Oct 12 13:25:37.835754 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:25:37.835754 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:25:37.835754 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 4549aaa6806b4c138a9bdf54e7b2965e Oct 12 13:25:37.835754 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027-project Oct 12 13:25:37.835754 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:25:37.835754 n-d-861076-2 devstack@n-api.service[120932]: {"security_group_rule": {"parent_group_id": "02a1600c-0bda-4de1-91ae-d096b34a062d", "ip_protocol": "tcp", "from_port": 22, "to_port": 994373307}} Oct 12 13:25:37.835754 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:25:37.836618 n-d-861076-2 devstack@n-api.service[120932]: exception: Invalid port range 22:994373307. Valid TCP ports should be between 1-65535 Oct 12 13:25:37.836618 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'security_group_rule': {'parent_group_id': '02a1600c-0bda-4de1-91ae-d096b34a062d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 994373307}}} Oct 12 13:25:37.836618 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:37.836618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:37.836618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 12 13:25:37.836618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 12 13:25:37.836618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 12 13:25:37.836618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 12 13:25:37.836618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 12 13:25:37.836618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 12 13:25:37.836618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 12 13:25:37.836618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 12 13:25:37.836618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:994373307. Valid TCP ports should be between 1-65535 Oct 12 13:25:37.836618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:37.836618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:37.836618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:37.836618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:37.836618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:37.836618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:37.838141 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:37.838141 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:37.838141 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:25:37.838141 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:25:37.838141 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:37.838141 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:37.838141 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 12 13:25:37.838141 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 13:25:37.838141 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:994373307. Valid TCP ports should be between 1-65535 Oct 12 13:25:37.838141 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:37.838141 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:37.838141 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:37.838141 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:37.838141 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:37.838141 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:37.838141 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:37.838141 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:37.838141 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:994373307. Valid TCP ports should be between 1-65535 Oct 12 13:25:37.838141 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:37.839462 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-82330726-e3cf-4612-8710-b4c5af28b1d1 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Returning 400 to user: Invalid port range 22:994373307. Valid TCP ports should be between 1-65535 {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:37.839462 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-82330726-e3cf-4612-8710-b4c5af28b1d1 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.069789 Oct 12 13:25:37.839462 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 465/992] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 12 13:25:37 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:25:37.844040 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8a2a19d2-edd6-40db-8bef-e535543f61c5 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:37.844572 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8a2a19d2-edd6-40db-8bef-e535543f61c5 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:37.864491 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a2a19d2-edd6-40db-8bef-e535543f61c5 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:37.865017 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a2a19d2-edd6-40db-8bef-e535543f61c5 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:37.865450 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a2a19d2-edd6-40db-8bef-e535543f61c5 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:37.866342 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a2a19d2-edd6-40db-8bef-e535543f61c5 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:37.866955 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a2a19d2-edd6-40db-8bef-e535543f61c5 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:37.867539 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a2a19d2-edd6-40db-8bef-e535543f61c5 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:37.899958 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-8a2a19d2-edd6-40db-8bef-e535543f61c5 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Lazy-loading 'flavor' on Instance uuid f3676307-e5eb-4e25-ab76-44f29e7a4b21 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:25:38.047681 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-da222490-68b3-4ee4-8d9d-d5dd181a3b19 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:38.057158 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-da222490-68b3-4ee4-8d9d-d5dd181a3b19 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1316 microversion: 2.1 time: 0.305845 Oct 12 13:25:38.058260 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 528/993] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:37 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1316 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:38.064005 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2fa6f3c3-973b-48ed-b0ba-128b39e13b74 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Action: 'create', calling method: .version_select at 0x7f8aa038ca60>, body: {"security_group_rule": {"parent_group_id": "4cc26336-0999-4f79-9fd1-3977ca45a684", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:38.104374 n-d-861076-2 devstack@n-api.service[120933]: DEBUG neutronclient.v2_0.client [None req-2fa6f3c3-973b-48ed-b0ba-128b39e13b74 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4cc26336-0999-4f79-9fd1-3977ca45a684 does not exist", "detail": ""}} {{(pid=120933) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 13:25:38.105054 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.security_group_api [None req-2fa6f3c3-973b-48ed-b0ba-128b39e13b74 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Neutron security group 4cc26336-0999-4f79-9fd1-3977ca45a684 not found {{(pid=120933) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 13:25:38.105710 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-2fa6f3c3-973b-48ed-b0ba-128b39e13b74 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] HTTP exception thrown: Security group 4cc26336-0999-4f79-9fd1-3977ca45a684 does not exist Oct 12 13:25:38.105710 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-7eb83036-829f-473a-81f1-4197b7cd4cc7'] Oct 12 13:25:38.107579 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2fa6f3c3-973b-48ed-b0ba-128b39e13b74 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Request method failure captured: Oct 12 13:25:38.107579 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 13:25:38.107579 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:25:38.107579 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:25:38.107579 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:25:38.107579 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 138 Oct 12 13:25:38.107579 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:25:38.107579 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:25:38.107579 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:25:38.107579 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:38.107579 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsBEkZZs7Gre384Iv-UKcvb_KTJCmSNSqyb85WjtZRgWgB9P1SVrqtW3kF_xkHZpKDcbkcjUCQ4_1nAbXGtzD9BYVleCRFfiBXwptTGiDECyK19FcwWxbjlw0BUgsPLP1OQrOCGe55u33_-j8i5BiIrq4kPMAcH3OvmpD41DoXn81wI Oct 12 13:25:38.107579 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:25:38.107579 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:25:38.107579 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:25:38.107579 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:25:38.107579 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:25:38.107579 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:25:38.107579 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: acdc5afde34947f9a13b64c4179587d5 Oct 12 13:25:38.107579 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:38.107579 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:25:38.107579 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:25:38.108938 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/acdc5afde34947f9a13b64c4179587d5"}]}] Oct 12 13:25:38.108938 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:38.108938 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: acdc5afde34947f9a13b64c4179587d5 Oct 12 13:25:38.108938 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:38.108938 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-911474027-project Oct 12 13:25:38.108938 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:25:38.108938 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:25:38.108938 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 4549aaa6806b4c138a9bdf54e7b2965e Oct 12 13:25:38.108938 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027-project Oct 12 13:25:38.108938 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:25:38.108938 n-d-861076-2 devstack@n-api.service[120933]: {"security_group_rule": {"parent_group_id": "4cc26336-0999-4f79-9fd1-3977ca45a684", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 12 13:25:38.108938 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:25:38.109691 n-d-861076-2 devstack@n-api.service[120933]: exception: Security group 4cc26336-0999-4f79-9fd1-3977ca45a684 does not exist Oct 12 13:25:38.109691 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-7eb83036-829f-473a-81f1-4197b7cd4cc7'] Oct 12 13:25:38.109691 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4cc26336-0999-4f79-9fd1-3977ca45a684', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 12 13:25:38.109691 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:38.109691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:38.109691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 13:25:38.109691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 13:25:38.109691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:38.109691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:38.109691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 13:25:38.109691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 13:25:38.109691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:38.109691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:38.109691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:25:38.109691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:25:38.109691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:38.109691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:38.109691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:25:38.109691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:25:38.111329 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:38.111329 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:38.111329 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 13:25:38.111329 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 13:25:38.111329 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:38.111329 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:38.111329 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 13:25:38.111329 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 13:25:38.111329 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 13:25:38.111329 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 13:25:38.111329 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4cc26336-0999-4f79-9fd1-3977ca45a684 does not exist Oct 12 13:25:38.111329 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7eb83036-829f-473a-81f1-4197b7cd4cc7'] Oct 12 13:25:38.111329 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:38.111329 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:38.111329 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:38.111329 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:38.111329 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 12 13:25:38.111329 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 12 13:25:38.111329 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 13:25:38.118412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 13:25:38.118412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4cc26336-0999-4f79-9fd1-3977ca45a684 does not exist Oct 12 13:25:38.118412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7eb83036-829f-473a-81f1-4197b7cd4cc7'] Oct 12 13:25:38.118412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:38.118412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:38.118412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:38.118412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:38.118412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:38.118412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:38.118412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:38.118412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:38.118412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:25:38.118412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:25:38.118412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:38.118412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:38.118412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 12 13:25:38.118412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 13:25:38.118412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4cc26336-0999-4f79-9fd1-3977ca45a684 does not exist Oct 12 13:25:38.118412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7eb83036-829f-473a-81f1-4197b7cd4cc7'] Oct 12 13:25:38.118412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:38.119680 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:38.119680 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:38.119680 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:38.119680 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:38.119680 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:38.119680 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:38.119680 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:38.119680 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4cc26336-0999-4f79-9fd1-3977ca45a684 does not exist Oct 12 13:25:38.119680 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7eb83036-829f-473a-81f1-4197b7cd4cc7'] Oct 12 13:25:38.119680 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:38.119680 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2fa6f3c3-973b-48ed-b0ba-128b39e13b74 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Returning 404 to user: Security group 4cc26336-0999-4f79-9fd1-3977ca45a684 does not exist Oct 12 13:25:38.119680 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-7eb83036-829f-473a-81f1-4197b7cd4cc7'] {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:38.119680 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2fa6f3c3-973b-48ed-b0ba-128b39e13b74 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.049787 Oct 12 13:25:38.120494 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 529/994] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 12 13:25:38 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:25:38.137318 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-889f00dd-9bb3-47be-abaa-132c0c3d2e4e tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:38.137942 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-889f00dd-9bb3-47be-abaa-132c0c3d2e4e tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] [instance: 182dba37-e456-46a8-8ee6-255a657bcd6b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:38.154747 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-889f00dd-9bb3-47be-abaa-132c0c3d2e4e tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:38.155245 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-889f00dd-9bb3-47be-abaa-132c0c3d2e4e tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:38.155682 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-889f00dd-9bb3-47be-abaa-132c0c3d2e4e tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:38.161820 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-889f00dd-9bb3-47be-abaa-132c0c3d2e4e tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:38.162372 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-889f00dd-9bb3-47be-abaa-132c0c3d2e4e tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:38.163201 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-889f00dd-9bb3-47be-abaa-132c0c3d2e4e tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:38.428007 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-889f00dd-9bb3-47be-abaa-132c0c3d2e4e tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a5a43471b49fc9dac1aa301c50d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36da01f1b35e43be9c4a96d6cc118d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:38.439427 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-889f00dd-9bb3-47be-abaa-132c0c3d2e4e tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] 10.222.0.52 "GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b" status: 200 len: 1322 microversion: 2.1 time: 0.327991 Oct 12 13:25:38.454181 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 530/995] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:38 2022] GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:38.462438 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-21e27aa8-c4fc-4eaf-954c-2e912f547f45 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Calling method '.version_select at 0x7f8aa038c670>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:38.479846 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8a2a19d2-edd6-40db-8bef-e535543f61c5 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21/action" status: 202 len: 0 microversion: 2.1 time: 0.639990 Oct 12 13:25:38.481579 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 466/996] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:25:37 2022] POST /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21/action => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:25:38.496066 n-d-861076-2 devstack@n-api.service[120933]: DEBUG neutronclient.v2_0.client [None req-21e27aa8-c4fc-4eaf-954c-2e912f547f45 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule c74128f5-8d51-4029-8646-4fc5c0be5b66 does not exist", "detail": ""}} {{(pid=120933) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 13:25:38.497411 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.security_group_api [None req-21e27aa8-c4fc-4eaf-954c-2e912f547f45 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Neutron security group rule c74128f5-8d51-4029-8646-4fc5c0be5b66 not found {{(pid=120933) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 12 13:25:38.498366 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-21e27aa8-c4fc-4eaf-954c-2e912f547f45 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] HTTP exception thrown: Security group rule c74128f5-8d51-4029-8646-4fc5c0be5b66 does not exist Oct 12 13:25:38.498366 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-645d834d-b39d-4abf-8e70-8cb2ed059dab'] Oct 12 13:25:38.504203 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-06877524-197e-4516-95b7-e61f7ad33213 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bcf5670>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:38.515022 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-21e27aa8-c4fc-4eaf-954c-2e912f547f45 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Request method failure captured: Oct 12 13:25:38.515022 n-d-861076-2 devstack@n-api.service[120933]: request: DELETE /compute/v2.1/os-security-group-rules/c74128f5-8d51-4029-8646-4fc5c0be5b66 HTTP/1.1 Oct 12 13:25:38.515022 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:25:38.515022 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:25:38.515022 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:25:38.515022 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:25:38.515022 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:25:38.515022 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:25:38.515022 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:25:38.515022 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:38.515022 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsBEkZZs7Gre384Iv-UKcvb_KTJCmSNSqyb85WjtZRgWgB9P1SVrqtW3kF_xkHZpKDcbkcjUCQ4_1nAbXGtzD9BYVleCRFfiBXwptTGiDECyK19FcwWxbjlw0BUgsPLP1OQrOCGe55u33_-j8i5BiIrq4kPMAcH3OvmpD41DoXn81wI Oct 12 13:25:38.515022 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:25:38.515022 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:25:38.515022 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:25:38.515022 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:25:38.515022 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:25:38.515022 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:25:38.515022 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: acdc5afde34947f9a13b64c4179587d5 Oct 12 13:25:38.515022 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:38.515022 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:25:38.515022 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:25:38.516467 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/acdc5afde34947f9a13b64c4179587d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/acdc5afde34947f9a13b64c4179587d5"}]}] Oct 12 13:25:38.516467 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:38.516467 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: acdc5afde34947f9a13b64c4179587d5 Oct 12 13:25:38.516467 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027 Oct 12 13:25:38.516467 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-911474027-project Oct 12 13:25:38.516467 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:25:38.516467 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:25:38.516467 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 4549aaa6806b4c138a9bdf54e7b2965e Oct 12 13:25:38.516467 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-911474027-project Oct 12 13:25:38.516467 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:25:38.516467 n-d-861076-2 devstack@n-api.service[120933]: exception: Security group rule c74128f5-8d51-4029-8646-4fc5c0be5b66 does not exist Oct 12 13:25:38.516467 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-645d834d-b39d-4abf-8e70-8cb2ed059dab'] Oct 12 13:25:38.517372 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'c74128f5-8d51-4029-8646-4fc5c0be5b66'} Oct 12 13:25:38.517372 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:38.517372 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:38.517372 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 12 13:25:38.517372 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 12 13:25:38.517372 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:38.517372 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:38.517372 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 12 13:25:38.517372 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 12 13:25:38.517372 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:38.517372 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:38.517372 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:25:38.517372 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:25:38.517372 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:38.517372 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:38.517372 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:25:38.517372 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:25:38.517372 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:38.517372 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:38.521452 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 13:25:38.521452 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 13:25:38.521452 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:38.521452 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:38.521452 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 13:25:38.521452 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 13:25:38.521452 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 13:25:38.521452 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 13:25:38.521452 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule c74128f5-8d51-4029-8646-4fc5c0be5b66 does not exist Oct 12 13:25:38.521452 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-645d834d-b39d-4abf-8e70-8cb2ed059dab'] Oct 12 13:25:38.521452 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:38.521452 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:38.521452 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:38.521452 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:38.521452 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 12 13:25:38.521452 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 12 13:25:38.521452 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 12 13:25:38.521452 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 13:25:38.522608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule c74128f5-8d51-4029-8646-4fc5c0be5b66 does not exist Oct 12 13:25:38.522608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-645d834d-b39d-4abf-8e70-8cb2ed059dab'] Oct 12 13:25:38.522608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:38.522608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:38.522608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:38.522608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:38.522608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:38.522608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:38.522608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:38.522608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:38.522608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:25:38.522608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:25:38.522608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:38.522608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:38.522608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 12 13:25:38.522608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 13:25:38.522608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule c74128f5-8d51-4029-8646-4fc5c0be5b66 does not exist Oct 12 13:25:38.522608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-645d834d-b39d-4abf-8e70-8cb2ed059dab'] Oct 12 13:25:38.522608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:38.522608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:38.525675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:38.525675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:38.525675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:38.525675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:38.525675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:38.525675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:38.525675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule c74128f5-8d51-4029-8646-4fc5c0be5b66 does not exist Oct 12 13:25:38.525675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-645d834d-b39d-4abf-8e70-8cb2ed059dab'] Oct 12 13:25:38.525675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:38.525675 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-21e27aa8-c4fc-4eaf-954c-2e912f547f45 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Returning 404 to user: Security group rule c74128f5-8d51-4029-8646-4fc5c0be5b66 does not exist Oct 12 13:25:38.525675 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-645d834d-b39d-4abf-8e70-8cb2ed059dab'] {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:38.525675 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-21e27aa8-c4fc-4eaf-954c-2e912f547f45 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-group-rules/c74128f5-8d51-4029-8646-4fc5c0be5b66" status: 404 len: 199 microversion: 2.1 time: 0.061102 Oct 12 13:25:38.525675 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 531/997] 10.222.0.52 () {58 vars in 1287 bytes} [Wed Oct 12 13:25:38 2022] DELETE /compute/v2.1/os-security-group-rules/c74128f5-8d51-4029-8646-4fc5c0be5b66 => generated 199 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:25:38.539330 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6351f8eb-e539-4a7f-a6f9-cd8ba3419531 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:38.540229 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-6351f8eb-e539-4a7f-a6f9-cd8ba3419531 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:38.548541 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6351f8eb-e539-4a7f-a6f9-cd8ba3419531 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:38.549133 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6351f8eb-e539-4a7f-a6f9-cd8ba3419531 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:38.550189 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6351f8eb-e539-4a7f-a6f9-cd8ba3419531 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:38.550964 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6351f8eb-e539-4a7f-a6f9-cd8ba3419531 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:38.551489 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6351f8eb-e539-4a7f-a6f9-cd8ba3419531 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:38.551981 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6351f8eb-e539-4a7f-a6f9-cd8ba3419531 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:38.631352 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-06877524-197e-4516-95b7-e61f7ad33213 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.148027 Oct 12 13:25:38.632735 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 467/998] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:38 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:38.638598 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-acb26a59-820a-4ba2-8df9-83d13248ed07 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Calling method '.version_select at 0x7f8a9ba5f3a0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:39.238500 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6351f8eb-e539-4a7f-a6f9-cd8ba3419531 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1631 microversion: 2.1 time: 0.719073 Oct 12 13:25:39.240394 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 532/999] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:38 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1631 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:39.254227 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2215288f-6eb3-427d-9d44-9174ca4d3195 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:39.258433 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-2215288f-6eb3-427d-9d44-9174ca4d3195 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:39.275985 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2215288f-6eb3-427d-9d44-9174ca4d3195 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:39.276184 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2215288f-6eb3-427d-9d44-9174ca4d3195 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:39.278657 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2215288f-6eb3-427d-9d44-9174ca4d3195 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:39.280716 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2215288f-6eb3-427d-9d44-9174ca4d3195 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:39.283307 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2215288f-6eb3-427d-9d44-9174ca4d3195 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:39.293831 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2215288f-6eb3-427d-9d44-9174ca4d3195 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:39.309550 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-acb26a59-820a-4ba2-8df9-83d13248ed07 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/02a1600c-0bda-4de1-91ae-d096b34a062d" status: 202 len: 0 microversion: 2.1 time: 0.675280 Oct 12 13:25:39.311978 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 468/1000] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:25:38 2022] DELETE /compute/v2.1/os-security-groups/02a1600c-0bda-4de1-91ae-d096b34a062d => generated 0 bytes in 678 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:25:39.321191 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e34b1ca0-1d82-42c7-a41b-ee5f667d0303 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Calling method '.version_select at 0x7f8a9ba42e50>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:39.650166 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-2215288f-6eb3-427d-9d44-9174ca4d3195 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:39.672045 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2215288f-6eb3-427d-9d44-9174ca4d3195 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1316 microversion: 2.1 time: 0.427373 Oct 12 13:25:39.697820 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 533/1001] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:39 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1316 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:39.731480 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-f214e056-38e4-4f3a-a699-9ff637d15d12 req-81730e05-2042-49d2-970a-fd85a1b25b85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84665e09-6290-4534-9254-53bc1a6364d2", "name": "network-vif-plugged", "status": "completed", "tag": "beff24b0-5676-4432-96b9-99712fc212bb"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:39.762247 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-f214e056-38e4-4f3a-a699-9ff637d15d12 req-81730e05-2042-49d2-970a-fd85a1b25b85 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:39.763234 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-f214e056-38e4-4f3a-a699-9ff637d15d12 req-81730e05-2042-49d2-970a-fd85a1b25b85 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:39.763234 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-f214e056-38e4-4f3a-a699-9ff637d15d12 req-81730e05-2042-49d2-970a-fd85a1b25b85 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:39.799532 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-f214e056-38e4-4f3a-a699-9ff637d15d12 req-81730e05-2042-49d2-970a-fd85a1b25b85 service nova] Creating event network-vif-plugged:beff24b0-5676-4432-96b9-99712fc212bb for instance 84665e09-6290-4534-9254-53bc1a6364d2 on n-h2-861076-2 Oct 12 13:25:39.809895 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-f214e056-38e4-4f3a-a699-9ff637d15d12 req-81730e05-2042-49d2-970a-fd85a1b25b85 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110576 Oct 12 13:25:39.813006 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 534/1002] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:39.820080 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7c3c8848-875c-4213-b058-5c91d42a916d tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:39.821086 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7c3c8848-875c-4213-b058-5c91d42a916d tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] [instance: 182dba37-e456-46a8-8ee6-255a657bcd6b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:39.830901 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7c3c8848-875c-4213-b058-5c91d42a916d tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:39.831722 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7c3c8848-875c-4213-b058-5c91d42a916d tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:39.833278 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7c3c8848-875c-4213-b058-5c91d42a916d tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:39.834190 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7c3c8848-875c-4213-b058-5c91d42a916d tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:39.835858 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7c3c8848-875c-4213-b058-5c91d42a916d tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:39.838679 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7c3c8848-875c-4213-b058-5c91d42a916d tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:39.990893 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e34b1ca0-1d82-42c7-a41b-ee5f667d0303 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/b648981a-e430-4f43-8bcb-e86913af3130" status: 202 len: 0 microversion: 2.1 time: 0.674952 Oct 12 13:25:39.993437 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 469/1003] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:25:39 2022] DELETE /compute/v2.1/os-security-groups/b648981a-e430-4f43-8bcb-e86913af3130 => generated 0 bytes in 677 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:25:40.011544 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4fb7fc47-cf1e-4b68-846b-9e6a36d6521a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9ba298b0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:40.066919 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4fb7fc47-cf1e-4b68-846b-9e6a36d6521a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1454 microversion: 2.1 time: 0.071979 Oct 12 13:25:40.067747 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 470/1004] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:39 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1454 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:40.073343 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1b67f30d-88db-454e-b2bb-31faf31d3c11 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Calling method '.version_select at 0x7f8a9ba5faf0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:40.404602 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-7c3c8848-875c-4213-b058-5c91d42a916d tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a5a43471b49fc9dac1aa301c50d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36da01f1b35e43be9c4a96d6cc118d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:40.413684 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-7c3c8848-875c-4213-b058-5c91d42a916d tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] 10.222.0.52 "GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b" status: 200 len: 1471 microversion: 2.1 time: 0.599257 Oct 12 13:25:40.414860 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 535/1005] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:39 2022] GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b => generated 1471 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:40.419909 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fa8e7d5d-8d3e-4e6a-9e58-e870c7da3597 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:40.420969 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-fa8e7d5d-8d3e-4e6a-9e58-e870c7da3597 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:40.428127 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fa8e7d5d-8d3e-4e6a-9e58-e870c7da3597 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:40.428820 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fa8e7d5d-8d3e-4e6a-9e58-e870c7da3597 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:40.429437 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fa8e7d5d-8d3e-4e6a-9e58-e870c7da3597 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:40.430322 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fa8e7d5d-8d3e-4e6a-9e58-e870c7da3597 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:40.430953 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fa8e7d5d-8d3e-4e6a-9e58-e870c7da3597 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:40.431529 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fa8e7d5d-8d3e-4e6a-9e58-e870c7da3597 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:40.772303 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fa8e7d5d-8d3e-4e6a-9e58-e870c7da3597 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1614 microversion: 2.1 time: 0.352351 Oct 12 13:25:40.785582 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 536/1006] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:40 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1614 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:40.785582 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1a9b82fd-7ad1-4067-a74a-1418c8d0395f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:40.785582 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-1a9b82fd-7ad1-4067-a74a-1418c8d0395f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] [instance: 182dba37-e456-46a8-8ee6-255a657bcd6b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:40.802019 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1a9b82fd-7ad1-4067-a74a-1418c8d0395f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:40.802520 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1a9b82fd-7ad1-4067-a74a-1418c8d0395f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:40.802965 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1a9b82fd-7ad1-4067-a74a-1418c8d0395f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:40.803722 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1a9b82fd-7ad1-4067-a74a-1418c8d0395f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:40.804419 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1a9b82fd-7ad1-4067-a74a-1418c8d0395f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:40.805165 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1a9b82fd-7ad1-4067-a74a-1418c8d0395f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:40.836236 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-1a9b82fd-7ad1-4067-a74a-1418c8d0395f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'd19a5a43471b49fc9dac1aa301c50d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36da01f1b35e43be9c4a96d6cc118d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:40.838521 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1a9b82fd-7ad1-4067-a74a-1418c8d0395f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Request method failure captured: Oct 12 13:25:40.838521 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b/diagnostics HTTP/1.1 Oct 12 13:25:40.838521 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:25:40.838521 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:25:40.838521 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:25:40.838521 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:25:40.838521 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:25:40.838521 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:25:40.838521 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:25:40.838521 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:40.838521 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsA3dFVGVqxiLYTbS5wV5aaxB4EXHXrky1-egTBm5b6xu5Ner_ja5zNOK9WsSc7prLQ2-VanK6Tk5bUHZBywLg-_zvsxie8Uve3erNg9Y7Zc0CkCd6UN82ADeLAOFfLnelFHSH6nriRpi7vZKLV5ixuBcYO0PBZdN5u6GK8CZwt3OEo Oct 12 13:25:40.838521 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:25:40.838521 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:25:40.838521 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:25:40.838521 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:25:40.838521 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:25:40.838521 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:25:40.838521 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 36da01f1b35e43be9c4a96d6cc118d70 Oct 12 13:25:40.838521 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1784255883 Oct 12 13:25:40.838521 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:25:40.838521 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:25:40.843415 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/36da01f1b35e43be9c4a96d6cc118d70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_36da01f1b35e43be9c4a96d6cc118d70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/36da01f1b35e43be9c4a96d6cc118d70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/36da01f1b35e43be9c4a96d6cc118d70"}]}] Oct 12 13:25:40.843415 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1784255883 Oct 12 13:25:40.843415 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 36da01f1b35e43be9c4a96d6cc118d70 Oct 12 13:25:40.843415 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1784255883 Oct 12 13:25:40.843415 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServerDiagnosticsNegativeTest-1784255883-project Oct 12 13:25:40.843415 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:25:40.843415 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:25:40.843415 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: d19a5a43471b49fc9dac1aa301c50d08 Oct 12 13:25:40.843415 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1784255883-project Oct 12 13:25:40.843415 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:25:40.843415 n-d-861076-2 devstack@n-api.service[120933]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 12 13:25:40.844121 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'server_id': '182dba37-e456-46a8-8ee6-255a657bcd6b'} Oct 12 13:25:40.844121 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:40.844121 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:40.844121 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:40.844121 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:40.844121 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:40.844121 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:40.844121 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:40.844121 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:40.844121 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 12 13:25:40.844121 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 12 13:25:40.844121 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:25:40.844121 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:25:40.844121 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:25:40.844121 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:25:40.844121 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:25:40.844121 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:25:40.844121 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:25:40.844121 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:25:40.844121 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:25:40.845791 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:25:40.845791 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:25:40.845791 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:25:40.845791 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:25:40.845791 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:25:40.845791 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 12 13:25:40.845791 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:40.845791 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:40.845791 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:40.845791 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:40.845791 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:40.845791 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:40.845791 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:25:40.845791 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:25:40.845791 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 12 13:25:40.845791 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:40.845791 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1a9b82fd-7ad1-4067-a74a-1418c8d0395f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:40.849067 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1a9b82fd-7ad1-4067-a74a-1418c8d0395f tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] 10.222.0.52 "GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.063311 Oct 12 13:25:40.849067 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 537/1007] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:25:40 2022] GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b/diagnostics => generated 117 bytes in 70 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:25:40.852296 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1307c399-496d-46c2-a335-6e68c8ed8d96 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:40.852971 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-1307c399-496d-46c2-a335-6e68c8ed8d96 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:40.859146 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1307c399-496d-46c2-a335-6e68c8ed8d96 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:40.859637 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1307c399-496d-46c2-a335-6e68c8ed8d96 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:40.860075 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1307c399-496d-46c2-a335-6e68c8ed8d96 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:40.860999 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1307c399-496d-46c2-a335-6e68c8ed8d96 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:40.861624 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1307c399-496d-46c2-a335-6e68c8ed8d96 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:40.862052 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1307c399-496d-46c2-a335-6e68c8ed8d96 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:40.895558 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1b67f30d-88db-454e-b2bb-31faf31d3c11 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/6b39af8b-144a-4b7a-9da3-3cbabdf4c330" status: 202 len: 0 microversion: 2.1 time: 0.811726 Oct 12 13:25:40.897450 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 471/1008] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:25:40 2022] DELETE /compute/v2.1/os-security-groups/6b39af8b-144a-4b7a-9da3-3cbabdf4c330 => generated 0 bytes in 829 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:25:40.908563 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0fae17c9-adfb-4317-9641-4e52f6b408f9 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:40.909672 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0fae17c9-adfb-4317-9641-4e52f6b408f9 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:40.923734 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0fae17c9-adfb-4317-9641-4e52f6b408f9 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:40.927351 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0fae17c9-adfb-4317-9641-4e52f6b408f9 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:40.930778 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0fae17c9-adfb-4317-9641-4e52f6b408f9 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:40.932829 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0fae17c9-adfb-4317-9641-4e52f6b408f9 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:40.933883 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0fae17c9-adfb-4317-9641-4e52f6b408f9 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:40.936636 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0fae17c9-adfb-4317-9641-4e52f6b408f9 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:40.996493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-0fae17c9-adfb-4317-9641-4e52f6b408f9 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3c7ed10f-3b86-401a-8c8c-e65d83e27ade) Oct 12 13:25:40.996493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:40.996493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:40.996493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:40.996493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:40.996493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:40.996493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 12 13:25:40.996493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 12 13:25:40.996493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 12 13:25:40.996493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 12 13:25:40.996493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 12 13:25:40.996493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 12 13:25:40.996493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:25:40.996493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:25:41.008676 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:25:41.008676 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:25:41.008676 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:25:41.008676 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:25:41.008676 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:41.008676 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:41.008676 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:25:41.008676 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:25:41.008676 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:41.008676 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:41.008676 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:25:41.008676 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:25:41.008676 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:41.008676 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:41.008676 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:25:41.008676 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:25:41.008676 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:41.008676 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:41.009821 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:25:41.009821 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:25:41.009821 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:25:41.009821 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:25:41.009821 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:25:41.009821 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:25:41.009821 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:25:41.009821 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:25:41.009821 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:25:41.009821 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:25:41.009821 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:25:41.009821 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:25:41.009821 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:25:41.009821 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:25:41.009821 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:25:41.009821 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:25:41.010800 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:25:41.010800 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:25:41.010800 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:25:41.010800 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:25:41.010800 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:25:41.010800 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:25:41.010800 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:25:41.010800 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:25:41.010800 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:25:41.010800 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:25:41.010800 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3c7ed10f-3b86-401a-8c8c-e65d83e27ade) Oct 12 13:25:41.010800 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:41.010800 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-0fae17c9-adfb-4317-9641-4e52f6b408f9 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:41.010800 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:25:41.011661 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0fae17c9-adfb-4317-9641-4e52f6b408f9 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Request method failure captured: Oct 12 13:25:41.011661 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21/action HTTP/1.1 Oct 12 13:25:41.011661 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:25:41.011661 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:25:41.011661 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:25:41.011661 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 15 Oct 12 13:25:41.011661 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:25:41.011661 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:25:41.011661 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:25:41.011661 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:41.011661 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsAT28ek4MsScjtTBGI8Ms8LAC8fj4MDuDrMEpVTijlEMk6cP5EDOu11KzhH_uHNU7v1CdXUoctpDSiE7Q1XM7F3lV4E7lSRSu2nhkqsXwBRBs7Ri3-TB4Gmceqb1RQiScAh4kS4nLf5A7bTzGk1ZfRJ6p0d5UjRBxU84R6oQeLjgug Oct 12 13:25:41.011661 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:25:41.011661 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:25:41.011661 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:25:41.011661 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:25:41.011661 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:25:41.011661 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:25:41.011661 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 8d3e7a06b07c472f9622139256b6f979 Oct 12 13:25:41.011661 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-419437385 Oct 12 13:25:41.011661 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,admin,reader Oct 12 13:25:41.011661 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,admin,reader Oct 12 13:25:41.014456 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d3e7a06b07c472f9622139256b6f979"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d3e7a06b07c472f9622139256b6f979"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d3e7a06b07c472f9622139256b6f979"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d3e7a06b07c472f9622139256b6f979"}]}] Oct 12 13:25:41.014456 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServersAdminNegativeTestJSON-419437385 Oct 12 13:25:41.014456 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 8d3e7a06b07c472f9622139256b6f979 Oct 12 13:25:41.014456 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-419437385 Oct 12 13:25:41.014456 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServersAdminNegativeTestJSON-419437385-project-admin Oct 12 13:25:41.014456 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:25:41.014456 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:25:41.014456 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: facfbc21985745999c14297a645e3b44 Oct 12 13:25:41.014456 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServersAdminNegativeTestJSON-419437385-project-admin Oct 12 13:25:41.014456 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:25:41.014456 n-d-861076-2 devstack@n-api.service[120932]: {"migrate": {}} Oct 12 13:25:41.014456 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:25:41.016040 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:41.016040 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:25:41.016040 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'f3676307-e5eb-4e25-ab76-44f29e7a4b21', 'body': {'migrate': {}}} Oct 12 13:25:41.016040 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:41.016040 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:41.016040 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:41.016040 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:41.016040 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:41.016040 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:41.016040 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 12 13:25:41.016040 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 12 13:25:41.016040 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 12 13:25:41.016040 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 12 13:25:41.016040 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 12 13:25:41.016040 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 12 13:25:41.016040 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:25:41.016040 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:25:41.016040 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:25:41.016040 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:25:41.018850 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:25:41.018850 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:25:41.018850 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:41.018850 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:41.018850 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:25:41.018850 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:25:41.018850 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:41.018850 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:41.018850 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:25:41.018850 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:25:41.018850 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:41.018850 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:41.018850 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:25:41.018850 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:25:41.018850 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:41.018850 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:41.018850 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:25:41.018850 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:25:41.022200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:25:41.022200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:25:41.022200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:25:41.022200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:25:41.022200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:25:41.022200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:25:41.022200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:25:41.022200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:25:41.022200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:25:41.022200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:25:41.022200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:25:41.022200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:25:41.022200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:25:41.022200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:25:41.022200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:25:41.022200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:25:41.022200 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:25:41.025504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:25:41.025504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:25:41.025504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:25:41.025504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:25:41.025504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:25:41.025504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:25:41.025504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:25:41.025504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3c7ed10f-3b86-401a-8c8c-e65d83e27ade) Oct 12 13:25:41.025504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:41.025504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:41.025504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:41.025504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:41.025504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:41.025504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:41.025504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:41.025504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:41.025504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:25:41.032808 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:25:41.032808 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:41.032808 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:41.032808 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:41.032808 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:41.032808 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:41.032808 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:41.032808 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:41.032808 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:41.032808 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:41.032808 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:41.032808 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:41.032808 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:41.032808 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:41.032808 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0fae17c9-adfb-4317-9641-4e52f6b408f9 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:41.032808 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:41.037798 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0fae17c9-adfb-4317-9641-4e52f6b408f9 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21/action" status: 500 len: 214 microversion: 2.1 time: 0.102020 Oct 12 13:25:41.037798 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 472/1009] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:25:40 2022] POST /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21/action => generated 214 bytes in 103 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:25:41.037798 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c87f8d87-ab0a-4bc8-a431-a65555275f0c tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:41.037798 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c87f8d87-ab0a-4bc8-a431-a65555275f0c tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] [instance: 182dba37-e456-46a8-8ee6-255a657bcd6b] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:41.037798 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c87f8d87-ab0a-4bc8-a431-a65555275f0c tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:41.039883 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c87f8d87-ab0a-4bc8-a431-a65555275f0c tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:41.039883 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c87f8d87-ab0a-4bc8-a431-a65555275f0c tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:41.039883 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c87f8d87-ab0a-4bc8-a431-a65555275f0c tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:41.039883 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c87f8d87-ab0a-4bc8-a431-a65555275f0c tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:41.040642 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c87f8d87-ab0a-4bc8-a431-a65555275f0c tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:41.084713 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c87f8d87-ab0a-4bc8-a431-a65555275f0c tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] [instance: 182dba37-e456-46a8-8ee6-255a657bcd6b] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:25:41.299365 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-1307c399-496d-46c2-a335-6e68c8ed8d96 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:41.312385 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1307c399-496d-46c2-a335-6e68c8ed8d96 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1316 microversion: 2.1 time: 0.463883 Oct 12 13:25:41.313793 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 538/1010] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:40 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1316 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:41.319427 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d4e0812c-dfa6-456d-a185-194ee2f93ace tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Calling method '.version_select at 0x7f8aa0045700>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:41.557396 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c87f8d87-ab0a-4bc8-a431-a65555275f0c tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] 10.222.0.52 "DELETE /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b" status: 204 len: 0 microversion: 2.1 time: 0.548479 Oct 12 13:25:41.557396 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 473/1011] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:25:41 2022] DELETE /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:25:41.566477 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5ff126b6-17c1-42b3-b78d-83a1c0abda31 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:41.572593 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5ff126b6-17c1-42b3-b78d-83a1c0abda31 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Request method failure captured: Oct 12 13:25:41.572593 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb/action HTTP/1.1 Oct 12 13:25:41.572593 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:25:41.572593 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:25:41.572593 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:25:41.572593 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 39 Oct 12 13:25:41.572593 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:25:41.572593 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:25:41.572593 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:25:41.572593 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:41.572593 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsAT28ek4MsScjtTBGI8Ms8LAC8fj4MDuDrMEpVTijlEMk6cP5EDOu11KzhH_uHNU7v1CdXUoctpDSiE7Q1XM7F3lV4E7lSRSu2nhkqsXwBRBs7Ri3-TB4Gmceqb1RQiScAh4kS4nLf5A7bTzGk1ZfRJ6p0d5UjRBxU84R6oQeLjgug Oct 12 13:25:41.572593 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:25:41.572593 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:25:41.572593 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:25:41.572593 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:25:41.572593 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:25:41.572593 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:25:41.572593 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 8d3e7a06b07c472f9622139256b6f979 Oct 12 13:25:41.572593 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-419437385 Oct 12 13:25:41.572593 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,admin,reader Oct 12 13:25:41.572593 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,admin,reader Oct 12 13:25:41.573969 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d3e7a06b07c472f9622139256b6f979"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d3e7a06b07c472f9622139256b6f979"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d3e7a06b07c472f9622139256b6f979"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d3e7a06b07c472f9622139256b6f979"}]}] Oct 12 13:25:41.573969 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServersAdminNegativeTestJSON-419437385 Oct 12 13:25:41.573969 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 8d3e7a06b07c472f9622139256b6f979 Oct 12 13:25:41.573969 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-419437385 Oct 12 13:25:41.573969 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServersAdminNegativeTestJSON-419437385-project-admin Oct 12 13:25:41.573969 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:25:41.573969 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:25:41.573969 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: facfbc21985745999c14297a645e3b44 Oct 12 13:25:41.573969 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServersAdminNegativeTestJSON-419437385-project-admin Oct 12 13:25:41.573969 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:25:41.573969 n-d-861076-2 devstack@n-api.service[120932]: {"os-resetState": {"state": "invalid"}} Oct 12 13:25:41.573969 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:25:41.574707 n-d-861076-2 devstack@n-api.service[120932]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 12 13:25:41.574707 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '981cf996-0c9a-4e4a-8ec0-53ca023742eb', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 12 13:25:41.574707 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:41.574707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:41.574707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 13:25:41.574707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 13:25:41.574707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 13:25:41.574707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise error Oct 12 13:25:41.574707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 12 13:25:41.574707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:41.574707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 12 13:25:41.574707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 12 13:25:41.574707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:41.574707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 12 13:25:41.574707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi 'invalid' Oct 12 13:25:41.574707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:41.574707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:41.574707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:41.574707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:41.574707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:41.574707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:41.574707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:41.576067 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:41.576067 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:41.576067 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:41.576067 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 13:25:41.576067 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 13:25:41.576067 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 13:25:41.576067 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 13:25:41.576067 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 13:25:41.576067 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 13:25:41.576067 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 12 13:25:41.576067 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:41.576067 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:41.576067 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:41.576067 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:41.576067 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:41.576067 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:41.576067 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 13:25:41.576067 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 13:25:41.576067 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 12 13:25:41.579046 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:41.579046 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5ff126b6-17c1-42b3-b78d-83a1c0abda31 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:41.579046 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5ff126b6-17c1-42b3-b78d-83a1c0abda31 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb/action" status: 400 len: 144 microversion: 2.1 time: 0.019521 Oct 12 13:25:41.582609 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 474/1012] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:25:41 2022] POST /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb/action => generated 144 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:25:41.587808 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bc5a77b4-d91b-4ee8-adaa-c41ae5da0b9d tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9ba42310>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:41.665778 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bc5a77b4-d91b-4ee8-adaa-c41ae5da0b9d tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1463 microversion: 2.1 time: 0.081614 Oct 12 13:25:41.666619 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 475/1013] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:41 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1463 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:41.675029 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-763474f2-19ec-44d3-9930-93d08314fa05 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:41.677538 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-763474f2-19ec-44d3-9930-93d08314fa05 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] [instance: 182dba37-e456-46a8-8ee6-255a657bcd6b] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:41.691520 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-763474f2-19ec-44d3-9930-93d08314fa05 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:41.692232 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-763474f2-19ec-44d3-9930-93d08314fa05 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:41.693499 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-763474f2-19ec-44d3-9930-93d08314fa05 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:41.694971 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-763474f2-19ec-44d3-9930-93d08314fa05 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:41.695936 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-763474f2-19ec-44d3-9930-93d08314fa05 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:41.696724 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-763474f2-19ec-44d3-9930-93d08314fa05 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:41.702824 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:25:41.925549 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d4e0812c-dfa6-456d-a185-194ee2f93ace tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/45eae59c-c20d-4985-b84f-f7bda0620e31" status: 202 len: 0 microversion: 2.1 time: 0.609975 Oct 12 13:25:41.926217 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 539/1014] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:25:41 2022] DELETE /compute/v2.1/os-security-groups/45eae59c-c20d-4985-b84f-f7bda0620e31 => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:25:41.931722 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-af76e49c-9593-4b28-8502-a4fce4020c53 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:41.955045 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-763474f2-19ec-44d3-9930-93d08314fa05 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a5a43471b49fc9dac1aa301c50d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36da01f1b35e43be9c4a96d6cc118d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:41.962361 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-af76e49c-9593-4b28-8502-a4fce4020c53 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Request method failure captured: Oct 12 13:25:41.962361 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb/action HTTP/1.1 Oct 12 13:25:41.962361 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:25:41.962361 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:25:41.962361 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:25:41.962361 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 31 Oct 12 13:25:41.962361 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:25:41.962361 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:25:41.962361 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:25:41.962361 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:41.962361 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsAT28ek4MsScjtTBGI8Ms8LAC8fj4MDuDrMEpVTijlEMk6cP5EDOu11KzhH_uHNU7v1CdXUoctpDSiE7Q1XM7F3lV4E7lSRSu2nhkqsXwBRBs7Ri3-TB4Gmceqb1RQiScAh4kS4nLf5A7bTzGk1ZfRJ6p0d5UjRBxU84R6oQeLjgug Oct 12 13:25:41.962361 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:25:41.962361 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:25:41.962361 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:25:41.962361 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:25:41.962361 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:25:41.962361 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:25:41.962361 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 8d3e7a06b07c472f9622139256b6f979 Oct 12 13:25:41.962361 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-419437385 Oct 12 13:25:41.962361 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:25:41.962361 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:25:41.963810 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d3e7a06b07c472f9622139256b6f979"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d3e7a06b07c472f9622139256b6f979"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d3e7a06b07c472f9622139256b6f979"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d3e7a06b07c472f9622139256b6f979"}]}] Oct 12 13:25:41.963810 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServersAdminNegativeTestJSON-419437385 Oct 12 13:25:41.963810 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 8d3e7a06b07c472f9622139256b6f979 Oct 12 13:25:41.963810 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-419437385 Oct 12 13:25:41.963810 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServersAdminNegativeTestJSON-419437385-project-admin Oct 12 13:25:41.963810 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:25:41.963810 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:25:41.963810 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: facfbc21985745999c14297a645e3b44 Oct 12 13:25:41.963810 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServersAdminNegativeTestJSON-419437385-project-admin Oct 12 13:25:41.963810 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:25:41.963810 n-d-861076-2 devstack@n-api.service[120933]: {"os-resetState": {"state": 1}} Oct 12 13:25:41.963810 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:25:41.963810 n-d-861076-2 devstack@n-api.service[120933]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 12 13:25:41.964695 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '981cf996-0c9a-4e4a-8ec0-53ca023742eb', 'body': {'os-resetState': {'state': 1}}} Oct 12 13:25:41.964695 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:41.964695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:41.964695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 13:25:41.964695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 13:25:41.964695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 13:25:41.964695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise error Oct 12 13:25:41.964695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 12 13:25:41.964695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:41.964695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 12 13:25:41.964695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 12 13:25:41.964695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:41.964695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 12 13:25:41.964695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 1 Oct 12 13:25:41.964695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:41.964695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:41.964695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:41.964695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:41.964695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:41.964695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:41.964695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:41.964695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:41.966038 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:41.966038 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:41.966038 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 13:25:41.966038 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 13:25:41.966038 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 13:25:41.966038 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 13:25:41.966038 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 13:25:41.966038 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 13:25:41.966038 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 12 13:25:41.966038 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:41.966038 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:41.966038 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:41.966038 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:41.966038 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:41.966038 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:41.966038 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 13:25:41.966038 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 13:25:41.966038 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 12 13:25:41.966038 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:41.967150 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-af76e49c-9593-4b28-8502-a4fce4020c53 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:41.967150 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-af76e49c-9593-4b28-8502-a4fce4020c53 tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb/action" status: 400 len: 120 microversion: 2.1 time: 0.036722 Oct 12 13:25:41.967150 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 540/1015] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:25:41 2022] POST /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb/action => generated 120 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:25:41.975685 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-763474f2-19ec-44d3-9930-93d08314fa05 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] 10.222.0.52 "GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b" status: 200 len: 1477 microversion: 2.1 time: 0.307276 Oct 12 13:25:41.982453 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 476/1016] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:41 2022] GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b => generated 1477 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:41.989104 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-edc5be75-4482-4452-b0a8-f047bef954c9 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa01d60d0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:42.006826 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a4925d67-be98-4b47-a12a-47362542b9e8 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] Calling method '.version_select at 0x7f8a9ba42820>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:42.065010 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-edc5be75-4482-4452-b0a8-f047bef954c9 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 200 len: 1463 microversion: 2.1 time: 0.087621 Oct 12 13:25:42.066411 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 541/1017] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:41 2022] GET /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 1463 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:42.086256 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f59fa21b-54ab-40a6-a77f-61438f47915f tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:42.090850 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f59fa21b-54ab-40a6-a77f-61438f47915f tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Failed to fetch instance by id 999 {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 13:25:42.093724 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-f59fa21b-54ab-40a6-a77f-61438f47915f tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 12 13:25:42.102418 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f59fa21b-54ab-40a6-a77f-61438f47915f tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Request method failure captured: Oct 12 13:25:42.102418 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 12 13:25:42.102418 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:25:42.102418 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:25:42.102418 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:25:42.102418 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 37 Oct 12 13:25:42.102418 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:25:42.102418 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:25:42.102418 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:25:42.102418 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:42.102418 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsAT28ek4MsScjtTBGI8Ms8LAC8fj4MDuDrMEpVTijlEMk6cP5EDOu11KzhH_uHNU7v1CdXUoctpDSiE7Q1XM7F3lV4E7lSRSu2nhkqsXwBRBs7Ri3-TB4Gmceqb1RQiScAh4kS4nLf5A7bTzGk1ZfRJ6p0d5UjRBxU84R6oQeLjgug Oct 12 13:25:42.102418 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:25:42.102418 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:25:42.102418 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:25:42.102418 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:25:42.102418 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:25:42.102418 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:25:42.102418 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 8d3e7a06b07c472f9622139256b6f979 Oct 12 13:25:42.102418 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-419437385 Oct 12 13:25:42.102418 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:25:42.102418 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:25:42.103748 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d3e7a06b07c472f9622139256b6f979"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d3e7a06b07c472f9622139256b6f979"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d3e7a06b07c472f9622139256b6f979"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d3e7a06b07c472f9622139256b6f979"}]}] Oct 12 13:25:42.103748 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServersAdminNegativeTestJSON-419437385 Oct 12 13:25:42.103748 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 8d3e7a06b07c472f9622139256b6f979 Oct 12 13:25:42.103748 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-419437385 Oct 12 13:25:42.103748 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServersAdminNegativeTestJSON-419437385-project-admin Oct 12 13:25:42.103748 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:25:42.103748 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:25:42.103748 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: facfbc21985745999c14297a645e3b44 Oct 12 13:25:42.103748 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServersAdminNegativeTestJSON-419437385-project-admin Oct 12 13:25:42.103748 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:25:42.103748 n-d-861076-2 devstack@n-api.service[120933]: {"os-resetState": {"state": "error"}} Oct 12 13:25:42.103748 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:25:42.103748 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance 999 could not be found. Oct 12 13:25:42.104543 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 12 13:25:42.104543 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:42.104543 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:42.104543 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:25:42.104543 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:25:42.104543 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 13:25:42.104543 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 13:25:42.104543 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 12 13:25:42.104543 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:42.104543 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:42.104543 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:42.104543 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:42.104543 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:42.104543 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:42.104543 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:42.104543 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:42.104543 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:42.104543 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:42.104543 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:42.104543 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:42.104543 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 12 13:25:42.105834 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 12 13:25:42.105834 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:25:42.105834 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:25:42.105834 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 12 13:25:42.105834 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:42.105834 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:42.105834 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:42.105834 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:42.105834 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:42.105834 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:42.105834 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:42.105834 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:42.105834 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 12 13:25:42.105834 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:42.105834 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f59fa21b-54ab-40a6-a77f-61438f47915f tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:42.105834 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f59fa21b-54ab-40a6-a77f-61438f47915f tempest-ServersAdminNegativeTestJSON-419437385 tempest-ServersAdminNegativeTestJSON-419437385-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.027248 Oct 12 13:25:42.106834 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 542/1018] 10.222.0.52 () {60 vars in 1179 bytes} [Wed Oct 12 13:25:42 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:25:42.113024 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-938af7a1-c040-477d-a932-2620179bf4e5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:42.121304 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-938af7a1-c040-477d-a932-2620179bf4e5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:42.136597 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-938af7a1-c040-477d-a932-2620179bf4e5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:42.138196 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-938af7a1-c040-477d-a932-2620179bf4e5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:42.139188 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-938af7a1-c040-477d-a932-2620179bf4e5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:42.142061 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-938af7a1-c040-477d-a932-2620179bf4e5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:42.143294 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-938af7a1-c040-477d-a932-2620179bf4e5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:42.145087 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-938af7a1-c040-477d-a932-2620179bf4e5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:42.760043 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-938af7a1-c040-477d-a932-2620179bf4e5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:42.779682 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-938af7a1-c040-477d-a932-2620179bf4e5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 200 len: 1468 microversion: 2.1 time: 0.673078 Oct 12 13:25:42.797112 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 543/1019] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:42 2022] GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 1468 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:42.802826 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c7c9b855-d19e-403d-aec1-e0f8fb06ca04 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:42.803519 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c7c9b855-d19e-403d-aec1-e0f8fb06ca04 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:42.809715 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c7c9b855-d19e-403d-aec1-e0f8fb06ca04 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:42.810653 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c7c9b855-d19e-403d-aec1-e0f8fb06ca04 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:42.816570 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c7c9b855-d19e-403d-aec1-e0f8fb06ca04 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:42.816570 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c7c9b855-d19e-403d-aec1-e0f8fb06ca04 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:42.816570 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c7c9b855-d19e-403d-aec1-e0f8fb06ca04 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:42.816570 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c7c9b855-d19e-403d-aec1-e0f8fb06ca04 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:42.840388 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c7c9b855-d19e-403d-aec1-e0f8fb06ca04 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Going to try to terminate instance {{(pid=120933) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:25:43.011627 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=16 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:25:43.045096 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a4925d67-be98-4b47-a12a-47362542b9e8 tempest-SecurityGroupRulesNegativeTestJSON-911474027 tempest-SecurityGroupRulesNegativeTestJSON-911474027-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/58307622-5a81-45b9-863b-ee09fdc4ce13" status: 202 len: 0 microversion: 2.1 time: 1.061168 Oct 12 13:25:43.045992 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 477/1020] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:25:41 2022] DELETE /compute/v2.1/os-security-groups/58307622-5a81-45b9-863b-ee09fdc4ce13 => generated 0 bytes in 1063 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:25:43.049344 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:25:43.057766 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6f63a1bf-f564-4535-91ad-e52d266e7d16 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:43.058757 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6f63a1bf-f564-4535-91ad-e52d266e7d16 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:43.075985 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f63a1bf-f564-4535-91ad-e52d266e7d16 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:43.080925 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f63a1bf-f564-4535-91ad-e52d266e7d16 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:43.080925 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f63a1bf-f564-4535-91ad-e52d266e7d16 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:43.080925 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f63a1bf-f564-4535-91ad-e52d266e7d16 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:43.080925 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f63a1bf-f564-4535-91ad-e52d266e7d16 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:43.085229 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f63a1bf-f564-4535-91ad-e52d266e7d16 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:43.191279 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=100 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:25:43.318584 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c7c9b855-d19e-403d-aec1-e0f8fb06ca04 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 204 len: 0 microversion: 2.1 time: 0.519873 Oct 12 13:25:43.322166 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 544/1021] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:25:42 2022] DELETE /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:25:43.452051 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-6f63a1bf-f564-4535-91ad-e52d266e7d16 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:43.464483 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6f63a1bf-f564-4535-91ad-e52d266e7d16 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1466 microversion: 2.1 time: 0.417329 Oct 12 13:25:43.466895 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 478/1022] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:43 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1466 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:43.473411 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-034fe94e-e010-4cb9-8aaa-e90526b51ef4 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1091568188"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:43.491053 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-034fe94e-e010-4cb9-8aaa-e90526b51ef4 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 14676667-3743-4d37-8ff9-f8d161a483d4] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:43.516669 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-034fe94e-e010-4cb9-8aaa-e90526b51ef4 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:43.524195 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-034fe94e-e010-4cb9-8aaa-e90526b51ef4 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:43.525729 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-034fe94e-e010-4cb9-8aaa-e90526b51ef4 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:43.528448 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-034fe94e-e010-4cb9-8aaa-e90526b51ef4 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:43.530037 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-034fe94e-e010-4cb9-8aaa-e90526b51ef4 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:43.531719 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-034fe94e-e010-4cb9-8aaa-e90526b51ef4 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:43.711489 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-60556cb3-07c5-4a52-b6a7-a21cc23f3f43 tempest-ListServerFiltersTestJSON-290269204 tempest-ListServerFiltersTestJSON-290269204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-187943620", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "9735c5eb-306e-41a4-b54b-0d52b8238892"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:43.788980 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-60556cb3-07c5-4a52-b6a7-a21cc23f3f43 tempest-ListServerFiltersTestJSON-290269204 tempest-ListServerFiltersTestJSON-290269204-project] validate_networks() for [('9735c5eb-306e-41a4-b54b-0d52b8238892', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:25:44.215908 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=10 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:25:44.239478 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-034fe94e-e010-4cb9-8aaa-e90526b51ef4 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "POST /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4/action" status: 202 len: 0 microversion: 2.1 time: 0.758557 Oct 12 13:25:44.243468 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 479/1023] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:25:43 2022] POST /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4/action => generated 0 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 13:25:44.294209 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-60556cb3-07c5-4a52-b6a7-a21cc23f3f43 tempest-ListServerFiltersTestJSON-290269204 tempest-ListServerFiltersTestJSON-290269204-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-009f6cc0-33e5-4f3d-87c3-c3240f10f8fd) Oct 12 13:25:44.294209 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:44.294209 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:44.294209 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:44.294209 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:44.294209 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:44.294209 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:44.294209 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:44.294209 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:44.294209 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:44.294209 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:25:44.294209 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:25:44.294209 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:25:44.294209 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:25:44.294209 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:25:44.294209 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:25:44.296064 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:25:44.296064 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:25:44.296064 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:25:44.296064 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:25:44.296064 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:25:44.296064 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:25:44.296064 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:25:44.296064 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:25:44.296064 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:25:44.296064 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:25:44.296064 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:25:44.296064 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:44.296064 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:44.296064 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:25:44.296064 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:25:44.296064 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:44.296064 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:44.296064 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:25:44.297419 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:25:44.297419 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:44.297419 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:44.297419 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:25:44.297419 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:25:44.297419 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:44.297419 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:44.297419 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:25:44.297419 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:25:44.297419 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:25:44.297419 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:25:44.297419 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:25:44.297419 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:25:44.297419 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:25:44.297419 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:25:44.297419 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:25:44.297419 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:25:44.297419 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:25:44.298720 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:25:44.298720 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:25:44.298720 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:25:44.298720 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:25:44.298720 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:25:44.298720 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:25:44.298720 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:25:44.298720 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:25:44.298720 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:25:44.298720 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:25:44.298720 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:25:44.298720 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:25:44.298720 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:25:44.298720 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:25:44.298720 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-009f6cc0-33e5-4f3d-87c3-c3240f10f8fd) Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-60556cb3-07c5-4a52-b6a7-a21cc23f3f43 tempest-ListServerFiltersTestJSON-290269204 tempest-ListServerFiltersTestJSON-290269204-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-60556cb3-07c5-4a52-b6a7-a21cc23f3f43 tempest-ListServerFiltersTestJSON-290269204 tempest-ListServerFiltersTestJSON-290269204-project] Request method failure captured: Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 212 Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsBWSuyHuBlpmw5xeWuBGu_0qBihKCC4REJKct6zF7xcNsplxr7CctezRLcHdX5a1EHhz89fuA0aW5eaMY70sKi4bz3O2pw2-ROK2KF4FVcEJDIMYPmUrJGrIhsBSs8IhL0aMR_x9pVqWZ_ZcHsPoqu5zr5-vbPC7rw0h1ZK_hIjBuU Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 213332754e2046999fb3261f0726b7a8 Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ListServerFiltersTestJSON-290269204 Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:25:44.299901 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:25:44.304459 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/213332754e2046999fb3261f0726b7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_213332754e2046999fb3261f0726b7a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/213332754e2046999fb3261f0726b7a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/213332754e2046999fb3261f0726b7a8"}]}] Oct 12 13:25:44.304459 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ListServerFiltersTestJSON-290269204 Oct 12 13:25:44.304459 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 213332754e2046999fb3261f0726b7a8 Oct 12 13:25:44.304459 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-290269204 Oct 12 13:25:44.304459 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ListServerFiltersTestJSON-290269204-project Oct 12 13:25:44.304459 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:25:44.304459 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:25:44.304459 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: fda8e709669a436b8f07a0e1fe6290bc Oct 12 13:25:44.304459 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ListServerFiltersTestJSON-290269204-project Oct 12 13:25:44.304459 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:25:44.304459 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-187943620", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "9735c5eb-306e-41a4-b54b-0d52b8238892"}]}} Oct 12 13:25:44.307290 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:25:44.307290 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:44.307290 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:25:44.307290 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-ListServerFiltersTestJSON-instance-187943620', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '9735c5eb-306e-41a4-b54b-0d52b8238892'}]}}} Oct 12 13:25:44.307290 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:44.307290 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:44.307290 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:44.307290 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:44.307290 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:44.307290 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:44.307290 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:44.307290 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:44.307290 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:44.307290 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:44.307290 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:25:44.307290 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:25:44.307290 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:25:44.307290 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:25:44.307290 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:25:44.311400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:25:44.311400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:25:44.311400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:25:44.311400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:25:44.311400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:25:44.311400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:25:44.311400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:25:44.311400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:25:44.311400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:25:44.311400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:25:44.311400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:25:44.311400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:25:44.311400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:44.311400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:44.311400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:25:44.311400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:25:44.311400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:44.311400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:44.312994 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:25:44.312994 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:25:44.312994 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:44.312994 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:44.312994 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:25:44.312994 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:25:44.312994 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:44.312994 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:44.312994 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:25:44.312994 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:25:44.312994 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:25:44.312994 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:25:44.312994 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:25:44.312994 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:25:44.312994 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:25:44.312994 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:25:44.312994 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:25:44.312994 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:25:44.314086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:25:44.314086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:25:44.314086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:25:44.314086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:25:44.314086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:25:44.314086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:25:44.314086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:25:44.314086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:25:44.314086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:25:44.314086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:25:44.314086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:25:44.314086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:25:44.314086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:25:44.314086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:25:44.314086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:25:44.314086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:25:44.315044 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-009f6cc0-33e5-4f3d-87c3-c3240f10f8fd) Oct 12 13:25:44.315044 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:44.315044 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:44.315044 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:44.315044 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:44.315044 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:44.315044 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:44.315044 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:44.315044 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:44.315044 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:25:44.315044 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:25:44.315044 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:44.315044 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:44.315044 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:44.315044 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:44.315044 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:44.315044 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:44.315044 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:44.315044 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:44.316260 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:44.316260 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:44.316260 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:44.316260 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:44.316260 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:44.316260 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-60556cb3-07c5-4a52-b6a7-a21cc23f3f43 tempest-ListServerFiltersTestJSON-290269204 tempest-ListServerFiltersTestJSON-290269204-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:44.316260 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:44.316260 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-60556cb3-07c5-4a52-b6a7-a21cc23f3f43 tempest-ListServerFiltersTestJSON-290269204 tempest-ListServerFiltersTestJSON-290269204-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.981022 Oct 12 13:25:44.316260 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 545/1024] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:25:43 2022] POST /compute/v2.1/servers => generated 214 bytes in 990 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:25:44.316874 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5d8b5d40-c3ca-49c7-8532-f98bbf3965af tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:44.316874 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-5d8b5d40-c3ca-49c7-8532-f98bbf3965af tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] [instance: 182dba37-e456-46a8-8ee6-255a657bcd6b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:44.323416 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5d8b5d40-c3ca-49c7-8532-f98bbf3965af tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:44.323851 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5d8b5d40-c3ca-49c7-8532-f98bbf3965af tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:44.324315 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5d8b5d40-c3ca-49c7-8532-f98bbf3965af tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:44.325156 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5d8b5d40-c3ca-49c7-8532-f98bbf3965af tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:44.325612 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5d8b5d40-c3ca-49c7-8532-f98bbf3965af tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:44.326032 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5d8b5d40-c3ca-49c7-8532-f98bbf3965af tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:44.377566 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-912e144e-bb10-42c1-8643-793d3c7dac8c tempest-InstanceUsageAuditLogTestJSON-1823470744 tempest-InstanceUsageAuditLogTestJSON-1823470744-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:44.408781 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5d8b5d40-c3ca-49c7-8532-f98bbf3965af tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:44.412958 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5d8b5d40-c3ca-49c7-8532-f98bbf3965af tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:44.413711 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5d8b5d40-c3ca-49c7-8532-f98bbf3965af tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:44.414368 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-5d8b5d40-c3ca-49c7-8532-f98bbf3965af tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lazy-loading 'fault' on Instance uuid 182dba37-e456-46a8-8ee6-255a657bcd6b {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:25:44.415961 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-912e144e-bb10-42c1-8643-793d3c7dac8c tempest-InstanceUsageAuditLogTestJSON-1823470744 tempest-InstanceUsageAuditLogTestJSON-1823470744-project-admin] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-12 13:25:42" status: 200 len: 318 microversion: 2.1 time: 0.170920 Oct 12 13:25:44.426234 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 480/1025] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 12 13:25:44 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-12%2013%3A25%3A42 => generated 318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:44.426234 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-35bd7290-0236-4e93-9176-ea397af55366 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:44.426234 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-35bd7290-0236-4e93-9176-ea397af55366 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:44.432914 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-35bd7290-0236-4e93-9176-ea397af55366 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:44.434290 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-35bd7290-0236-4e93-9176-ea397af55366 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:44.434907 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-35bd7290-0236-4e93-9176-ea397af55366 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:44.437276 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-35bd7290-0236-4e93-9176-ea397af55366 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:44.437835 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-35bd7290-0236-4e93-9176-ea397af55366 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:44.438271 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-35bd7290-0236-4e93-9176-ea397af55366 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:44.499296 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-5d8b5d40-c3ca-49c7-8532-f98bbf3965af tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19a5a43471b49fc9dac1aa301c50d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36da01f1b35e43be9c4a96d6cc118d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:44.508870 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5d8b5d40-c3ca-49c7-8532-f98bbf3965af tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] 10.222.0.52 "GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b" status: 200 len: 1312 microversion: 2.1 time: 0.197878 Oct 12 13:25:44.510132 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 546/1026] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:44 2022] GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b => generated 1312 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:44.523110 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8c03da7c-447e-4dbc-8374-a63931956133 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:44.524272 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-8c03da7c-447e-4dbc-8374-a63931956133 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:44.549995 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8c03da7c-447e-4dbc-8374-a63931956133 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:44.553491 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8c03da7c-447e-4dbc-8374-a63931956133 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:44.554662 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8c03da7c-447e-4dbc-8374-a63931956133 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:44.556331 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8c03da7c-447e-4dbc-8374-a63931956133 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:44.557442 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8c03da7c-447e-4dbc-8374-a63931956133 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:44.558147 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8c03da7c-447e-4dbc-8374-a63931956133 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:44.828266 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-35bd7290-0236-4e93-9176-ea397af55366 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:44.849390 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-35bd7290-0236-4e93-9176-ea397af55366 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1469 microversion: 2.1 time: 0.430224 Oct 12 13:25:44.878927 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 481/1027] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:44 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1469 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:44.887274 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-b6323481-dae9-437d-86c7-703df04b6e2e req-0176ccbc-c095-425a-9a82-8cffe84c46c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "182dba37-e456-46a8-8ee6-255a657bcd6b", "name": "network-vif-deleted", "tag": "819ba82b-dd17-45b9-b70c-d488542a44e9"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:44.904875 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-b6323481-dae9-437d-86c7-703df04b6e2e req-0176ccbc-c095-425a-9a82-8cffe84c46c2 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:44.908080 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-b6323481-dae9-437d-86c7-703df04b6e2e req-0176ccbc-c095-425a-9a82-8cffe84c46c2 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:44.908743 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-b6323481-dae9-437d-86c7-703df04b6e2e req-0176ccbc-c095-425a-9a82-8cffe84c46c2 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:44.939064 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-b6323481-dae9-437d-86c7-703df04b6e2e req-0176ccbc-c095-425a-9a82-8cffe84c46c2 service nova] Creating event network-vif-deleted:819ba82b-dd17-45b9-b70c-d488542a44e9 for instance 182dba37-e456-46a8-8ee6-255a657bcd6b on n-h1-861076-2 Oct 12 13:25:44.950046 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-b6323481-dae9-437d-86c7-703df04b6e2e req-0176ccbc-c095-425a-9a82-8cffe84c46c2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068763 Oct 12 13:25:44.951826 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 482/1028] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:44.959751 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-8c03da7c-447e-4dbc-8374-a63931956133 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1617 microversion: 2.1 time: 0.446633 Oct 12 13:25:44.960847 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 547/1029] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:44 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1617 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:44.971340 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-84e0e832-aae0-4816-8575-f7c3cda7fe15 req-81450bc2-420e-4f9b-8550-e99c83d8e6ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb212be-202b-4e4d-993a-80dfa753aa9d", "name": "network-vif-unplugged", "status": "completed", "tag": "59a191b0-d550-4432-be96-95cccb474ded"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:44.973794 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-22f59727-7d9e-46f6-8fb1-491b2f024cd7 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9ba13040>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:45.018378 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-84e0e832-aae0-4816-8575-f7c3cda7fe15 req-81450bc2-420e-4f9b-8550-e99c83d8e6ee service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:45.020615 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-84e0e832-aae0-4816-8575-f7c3cda7fe15 req-81450bc2-420e-4f9b-8550-e99c83d8e6ee service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:45.021129 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-84e0e832-aae0-4816-8575-f7c3cda7fe15 req-81450bc2-420e-4f9b-8550-e99c83d8e6ee service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:45.058694 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-84e0e832-aae0-4816-8575-f7c3cda7fe15 req-81450bc2-420e-4f9b-8550-e99c83d8e6ee service nova] Creating event network-vif-unplugged:59a191b0-d550-4432-be96-95cccb474ded for instance 5fb212be-202b-4e4d-993a-80dfa753aa9d on n-h2-861076-2 Oct 12 13:25:45.066613 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-84e0e832-aae0-4816-8575-f7c3cda7fe15 req-81450bc2-420e-4f9b-8550-e99c83d8e6ee service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103734 Oct 12 13:25:45.067455 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 548/1030] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:45.075930 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-faaaed2e-be2a-45d0-906f-b1615282ea0a tempest-InstanceUsageAuditLogTestJSON-1823470744 tempest-InstanceUsageAuditLogTestJSON-1823470744-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:45.103001 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-22f59727-7d9e-46f6-8fb1-491b2f024cd7 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.151223 Oct 12 13:25:45.109835 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 483/1031] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:44 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:45.151110 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-faaaed2e-be2a-45d0-906f-b1615282ea0a tempest-InstanceUsageAuditLogTestJSON-1823470744 tempest-InstanceUsageAuditLogTestJSON-1823470744-project-admin] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.080134 Oct 12 13:25:45.160451 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 549/1032] 10.222.0.52 () {58 vars in 1185 bytes} [Wed Oct 12 13:25:45 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:45.165668 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-763f5622-cb20-4475-84b3-c14536e8c839 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1035849072", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["9443e943-93c1-4a5f-aad4-da32545368fa"]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:45.268440 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-763f5622-cb20-4475-84b3-c14536e8c839 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] validate_networks() for None {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:25:45.546670 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c67451b3-4284-4418-9110-ce52da2d9740 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:45.547527 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c67451b3-4284-4418-9110-ce52da2d9740 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] [instance: 182dba37-e456-46a8-8ee6-255a657bcd6b] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:45.593897 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c67451b3-4284-4418-9110-ce52da2d9740 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:45.594684 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c67451b3-4284-4418-9110-ce52da2d9740 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:45.595370 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c67451b3-4284-4418-9110-ce52da2d9740 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:45.596308 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c67451b3-4284-4418-9110-ce52da2d9740 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:45.596999 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c67451b3-4284-4418-9110-ce52da2d9740 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:45.598176 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c67451b3-4284-4418-9110-ce52da2d9740 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:45.617218 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-c67451b3-4284-4418-9110-ce52da2d9740 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] HTTP exception thrown: Instance 182dba37-e456-46a8-8ee6-255a657bcd6b could not be found. Oct 12 13:25:45.619422 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c67451b3-4284-4418-9110-ce52da2d9740 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Request method failure captured: Oct 12 13:25:45.619422 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b HTTP/1.1 Oct 12 13:25:45.619422 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:25:45.619422 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:25:45.619422 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:25:45.619422 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:25:45.619422 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:25:45.619422 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:25:45.619422 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:25:45.619422 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:45.619422 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsA3dFVGVqxiLYTbS5wV5aaxB4EXHXrky1-egTBm5b6xu5Ner_ja5zNOK9WsSc7prLQ2-VanK6Tk5bUHZBywLg-_zvsxie8Uve3erNg9Y7Zc0CkCd6UN82ADeLAOFfLnelFHSH6nriRpi7vZKLV5ixuBcYO0PBZdN5u6GK8CZwt3OEo Oct 12 13:25:45.619422 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:25:45.619422 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:25:45.619422 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:25:45.619422 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:25:45.619422 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:25:45.619422 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:25:45.619422 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 36da01f1b35e43be9c4a96d6cc118d70 Oct 12 13:25:45.619422 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1784255883 Oct 12 13:25:45.619422 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:25:45.619422 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:25:45.620702 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/36da01f1b35e43be9c4a96d6cc118d70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_36da01f1b35e43be9c4a96d6cc118d70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/36da01f1b35e43be9c4a96d6cc118d70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/36da01f1b35e43be9c4a96d6cc118d70"}]}] Oct 12 13:25:45.620702 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1784255883 Oct 12 13:25:45.620702 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 36da01f1b35e43be9c4a96d6cc118d70 Oct 12 13:25:45.620702 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1784255883 Oct 12 13:25:45.620702 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServerDiagnosticsNegativeTest-1784255883-project Oct 12 13:25:45.620702 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:25:45.620702 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:25:45.620702 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: d19a5a43471b49fc9dac1aa301c50d08 Oct 12 13:25:45.620702 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1784255883-project Oct 12 13:25:45.620702 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:25:45.620702 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance 182dba37-e456-46a8-8ee6-255a657bcd6b could not be found. Oct 12 13:25:45.620702 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '182dba37-e456-46a8-8ee6-255a657bcd6b'} Oct 12 13:25:45.621571 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:45.621571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:45.621571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:25:45.621571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:25:45.621571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:25:45.621571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:25:45.621571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:25:45.621571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:25:45.621571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:25:45.621571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:25:45.621571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 182dba37-e456-46a8-8ee6-255a657bcd6b could not be found. Oct 12 13:25:45.621571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:45.621571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:45.621571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:45.621571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:45.621571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:45.621571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:45.621571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:45.621571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:45.621571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:45.622814 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:45.622814 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:25:45.622814 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:25:45.622814 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:25:45.622814 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:25:45.622814 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:25:45.622814 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:25:45.622814 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 182dba37-e456-46a8-8ee6-255a657bcd6b could not be found. Oct 12 13:25:45.622814 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:45.622814 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:45.622814 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:45.622814 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:45.622814 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:45.622814 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:45.622814 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:45.622814 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:45.622814 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 182dba37-e456-46a8-8ee6-255a657bcd6b could not be found. Oct 12 13:25:45.622814 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:45.627567 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c67451b3-4284-4418-9110-ce52da2d9740 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] Returning 404 to user: Instance 182dba37-e456-46a8-8ee6-255a657bcd6b could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:45.630370 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c67451b3-4284-4418-9110-ce52da2d9740 tempest-ServerDiagnosticsNegativeTest-1784255883 tempest-ServerDiagnosticsNegativeTest-1784255883-project] 10.222.0.52 "GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b" status: 404 len: 111 microversion: 2.1 time: 0.090117 Oct 12 13:25:45.631170 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 550/1033] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:45 2022] GET /compute/v2.1/servers/182dba37-e456-46a8-8ee6-255a657bcd6b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:25:45.880760 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-48ebfbf8-4212-45c4-9c9f-788d9414f83b tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:45.882017 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-48ebfbf8-4212-45c4-9c9f-788d9414f83b tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:45.892629 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-48ebfbf8-4212-45c4-9c9f-788d9414f83b tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:45.893401 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-48ebfbf8-4212-45c4-9c9f-788d9414f83b tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:45.897660 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-48ebfbf8-4212-45c4-9c9f-788d9414f83b tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:45.898677 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-48ebfbf8-4212-45c4-9c9f-788d9414f83b tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:45.899615 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-48ebfbf8-4212-45c4-9c9f-788d9414f83b tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:45.900273 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-48ebfbf8-4212-45c4-9c9f-788d9414f83b tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:46.629801 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-48ebfbf8-4212-45c4-9c9f-788d9414f83b tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:46.646589 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-48ebfbf8-4212-45c4-9c9f-788d9414f83b tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1469 microversion: 2.1 time: 0.770183 Oct 12 13:25:46.648787 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 551/1034] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:45 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1469 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:46.686906 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e671e837-a5d2-4a4e-9cd3-b94a72cd5e62 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bd018b0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:46.770970 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-763f5622-cb20-4475-84b3-c14536e8c839 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:25:46.773663 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-763f5622-cb20-4475-84b3-c14536e8c839 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:25:46.782070 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-763f5622-cb20-4475-84b3-c14536e8c839 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:25:46.783716 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-763f5622-cb20-4475-84b3-c14536e8c839 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:25:46.787839 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-763f5622-cb20-4475-84b3-c14536e8c839 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:25:46.807180 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:25:46.811765 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e671e837-a5d2-4a4e-9cd3-b94a72cd5e62 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.161130 Oct 12 13:25:46.816768 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 552/1035] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:46 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:46.821645 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-763f5622-cb20-4475-84b3-c14536e8c839 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:46.822765 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-763f5622-cb20-4475-84b3-c14536e8c839 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:46.823357 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-763f5622-cb20-4475-84b3-c14536e8c839 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:46.824249 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-763f5622-cb20-4475-84b3-c14536e8c839 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:46.824805 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-763f5622-cb20-4475-84b3-c14536e8c839 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:46.826128 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-763f5622-cb20-4475-84b3-c14536e8c839 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:46.869077 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-763f5622-cb20-4475-84b3-c14536e8c839 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for project be50900be6b246aa9289de6ec5d366f9. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:25:46.879657 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-763f5622-cb20-4475-84b3-c14536e8c839 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for user a0fd9458bb2842829a1e13ac93fade30 and project be50900be6b246aa9289de6ec5d366f9. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:25:46.899720 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-763f5622-cb20-4475-84b3-c14536e8c839 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:25:46.903137 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-763f5622-cb20-4475-84b3-c14536e8c839 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:25:47.020784 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-c70bf244-f670-42b1-b852-58ba2bc86204 req-cdb0ed58-17a0-47f2-b03e-76056f67a6f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3676307-e5eb-4e25-ab76-44f29e7a4b21", "name": "network-vif-deleted", "tag": "e0775306-4e5e-4e35-948b-06c20220585f"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:47.083031 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-c70bf244-f670-42b1-b852-58ba2bc86204 req-cdb0ed58-17a0-47f2-b03e-76056f67a6f6 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:47.097349 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-c70bf244-f670-42b1-b852-58ba2bc86204 req-cdb0ed58-17a0-47f2-b03e-76056f67a6f6 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.050s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:47.101646 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-c70bf244-f670-42b1-b852-58ba2bc86204 req-cdb0ed58-17a0-47f2-b03e-76056f67a6f6 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:47.126835 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-763f5622-cb20-4475-84b3-c14536e8c839 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.956630 Oct 12 13:25:47.126835 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 484/1036] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:25:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 13:25:47.139058 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a7e7f911-b882-431a-9897-eadd6745cf49 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:47.139926 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-c70bf244-f670-42b1-b852-58ba2bc86204 req-cdb0ed58-17a0-47f2-b03e-76056f67a6f6 service nova] Creating event network-vif-deleted:e0775306-4e5e-4e35-948b-06c20220585f for instance f3676307-e5eb-4e25-ab76-44f29e7a4b21 on n-h2-861076-2 Oct 12 13:25:47.141576 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a7e7f911-b882-431a-9897-eadd6745cf49 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:47.153778 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-c70bf244-f670-42b1-b852-58ba2bc86204 req-cdb0ed58-17a0-47f2-b03e-76056f67a6f6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139964 Oct 12 13:25:47.155776 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 553/1037] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:47.251410 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-a7e7f911-b882-431a-9897-eadd6745cf49 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:47.259734 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a7e7f911-b882-431a-9897-eadd6745cf49 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d" status: 200 len: 1217 microversion: 2.1 time: 0.129653 Oct 12 13:25:47.265182 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 485/1038] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:47 2022] GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d => generated 1217 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:47.672606 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d3984fb0-bf44-46da-8b55-ba052cb65537 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:47.679241 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-d3984fb0-bf44-46da-8b55-ba052cb65537 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:47.681061 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3984fb0-bf44-46da-8b55-ba052cb65537 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:47.681643 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3984fb0-bf44-46da-8b55-ba052cb65537 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:47.682167 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3984fb0-bf44-46da-8b55-ba052cb65537 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:47.683015 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3984fb0-bf44-46da-8b55-ba052cb65537 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:47.683547 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3984fb0-bf44-46da-8b55-ba052cb65537 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:47.684063 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3984fb0-bf44-46da-8b55-ba052cb65537 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:47.732235 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3984fb0-bf44-46da-8b55-ba052cb65537 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:47.733452 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3984fb0-bf44-46da-8b55-ba052cb65537 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:47.734149 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3984fb0-bf44-46da-8b55-ba052cb65537 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:47.734835 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-d3984fb0-bf44-46da-8b55-ba052cb65537 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lazy-loading 'fault' on Instance uuid f3676307-e5eb-4e25-ab76-44f29e7a4b21 {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:25:47.832458 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8aab48ed-3f11-445e-b9ba-bacd472bc3ca tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9ba513a0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:47.835742 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d3984fb0-bf44-46da-8b55-ba052cb65537 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:47.862253 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d3984fb0-bf44-46da-8b55-ba052cb65537 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1312 microversion: 2.1 time: 0.195033 Oct 12 13:25:47.865156 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 554/1039] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:47 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1312 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:47.915360 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8aab48ed-3f11-445e-b9ba-bacd472bc3ca tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.087905 Oct 12 13:25:47.915949 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 486/1040] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:47 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:48.283477 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-32cce06c-57ca-42cd-a246-eb7c51a89e55 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:48.284342 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-32cce06c-57ca-42cd-a246-eb7c51a89e55 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:48.421828 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-32cce06c-57ca-42cd-a246-eb7c51a89e55 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:48.432757 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-32cce06c-57ca-42cd-a246-eb7c51a89e55 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d" status: 200 len: 1217 microversion: 2.1 time: 0.153507 Oct 12 13:25:48.442747 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 555/1041] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:48 2022] GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:48.891803 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5eb71e39-853c-478f-82e1-cac51246519f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:48.893585 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5eb71e39-853c-478f-82e1-cac51246519f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:48.902219 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5eb71e39-853c-478f-82e1-cac51246519f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:48.903172 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5eb71e39-853c-478f-82e1-cac51246519f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:48.904106 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5eb71e39-853c-478f-82e1-cac51246519f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:48.905116 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5eb71e39-853c-478f-82e1-cac51246519f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:48.906033 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5eb71e39-853c-478f-82e1-cac51246519f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:48.906645 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5eb71e39-853c-478f-82e1-cac51246519f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:48.933849 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-814ebd30-9378-47ae-8fee-36138935834c tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bd01040>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:49.018669 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5eb71e39-853c-478f-82e1-cac51246519f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:49.020751 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5eb71e39-853c-478f-82e1-cac51246519f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:49.021297 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5eb71e39-853c-478f-82e1-cac51246519f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:49.032528 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-814ebd30-9378-47ae-8fee-36138935834c tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.104313 Oct 12 13:25:49.033287 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 556/1042] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:48 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:49.034262 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-5eb71e39-853c-478f-82e1-cac51246519f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lazy-loading 'fault' on Instance uuid f3676307-e5eb-4e25-ab76-44f29e7a4b21 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:25:49.187149 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-5eb71e39-853c-478f-82e1-cac51246519f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:49.198665 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5eb71e39-853c-478f-82e1-cac51246519f tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 200 len: 1312 microversion: 2.1 time: 0.311936 Oct 12 13:25:49.200056 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 487/1043] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:48 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 1312 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:49.461774 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-91985f12-10b0-4b6b-80b5-2f506be684bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:49.462397 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-91985f12-10b0-4b6b-80b5-2f506be684bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:49.482813 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-91985f12-10b0-4b6b-80b5-2f506be684bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:49.483325 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-91985f12-10b0-4b6b-80b5-2f506be684bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:49.483810 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-91985f12-10b0-4b6b-80b5-2f506be684bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:49.486920 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-91985f12-10b0-4b6b-80b5-2f506be684bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:49.488205 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-91985f12-10b0-4b6b-80b5-2f506be684bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:49.488205 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-91985f12-10b0-4b6b-80b5-2f506be684bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:49.656336 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-91985f12-10b0-4b6b-80b5-2f506be684bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:49.666874 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-91985f12-10b0-4b6b-80b5-2f506be684bf tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d" status: 200 len: 1213 microversion: 2.1 time: 0.214117 Oct 12 13:25:49.673192 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 557/1044] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:49 2022] GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d => generated 1213 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:50.055292 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-367c6a9d-6da6-4879-9fbf-3fc12203d8a3 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa06905e0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:50.141579 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-367c6a9d-6da6-4879-9fbf-3fc12203d8a3 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.097137 Oct 12 13:25:50.145126 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 558/1045] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:50 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:50.200248 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7ce56bc3-41e4-4b95-99e5-bd26622e0fe9 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Action: 'create', calling method: .version_select at 0x7f8a9b9bc280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2023688771", "description": "tempest-description-1334837872"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:50.223880 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-defae0f7-c70e-4283-9120-9a454584de86 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:50.224918 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-defae0f7-c70e-4283-9120-9a454584de86 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: f3676307-e5eb-4e25-ab76-44f29e7a4b21] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:50.238208 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-defae0f7-c70e-4283-9120-9a454584de86 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:50.240663 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-defae0f7-c70e-4283-9120-9a454584de86 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:50.242045 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-defae0f7-c70e-4283-9120-9a454584de86 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:50.246769 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-defae0f7-c70e-4283-9120-9a454584de86 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:50.247582 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-defae0f7-c70e-4283-9120-9a454584de86 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:50.248773 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-defae0f7-c70e-4283-9120-9a454584de86 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:50.304007 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-defae0f7-c70e-4283-9120-9a454584de86 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] HTTP exception thrown: Instance f3676307-e5eb-4e25-ab76-44f29e7a4b21 could not be found. Oct 12 13:25:50.313561 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-defae0f7-c70e-4283-9120-9a454584de86 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Request method failure captured: Oct 12 13:25:50.313561 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 HTTP/1.1 Oct 12 13:25:50.313561 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:25:50.313561 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:25:50.313561 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:25:50.313561 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:25:50.313561 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:25:50.313561 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:25:50.313561 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:25:50.313561 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:50.313561 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsARdsd6T720xG98HGmWowFvXYiZuX7KDGnMpozvkfe2Gm01T2WUk_Z8qdpKwlbqDTjSls0cSiBGuL-hDPGCJ2bhggjwfvR0WmyeHVghmcMEjspqg5zwOCmKaOEGKzKsungoOypofYyl0mdzaksZyTjgSVus1A095IYwlxl4elgiI5U Oct 12 13:25:50.313561 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:25:50.313561 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:25:50.313561 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:25:50.313561 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:25:50.313561 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:25:50.313561 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:25:50.313561 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 7afd8d44b48d4ec0b54a400fd73ca770 Oct 12 13:25:50.313561 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1062311697 Oct 12 13:25:50.313561 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:25:50.313561 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:25:50.320494 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7afd8d44b48d4ec0b54a400fd73ca770"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7afd8d44b48d4ec0b54a400fd73ca770"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7afd8d44b48d4ec0b54a400fd73ca770"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7afd8d44b48d4ec0b54a400fd73ca770"}]}] Oct 12 13:25:50.320494 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1062311697 Oct 12 13:25:50.320494 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 7afd8d44b48d4ec0b54a400fd73ca770 Oct 12 13:25:50.320494 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1062311697 Oct 12 13:25:50.320494 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServersAdminNegativeTestJSON-1062311697-project Oct 12 13:25:50.320494 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:25:50.320494 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:25:50.320494 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 27540849dbc344a384a1f24a6cc32175 Oct 12 13:25:50.320494 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1062311697-project Oct 12 13:25:50.320494 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:25:50.320494 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance f3676307-e5eb-4e25-ab76-44f29e7a4b21 could not be found. Oct 12 13:25:50.320494 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'f3676307-e5eb-4e25-ab76-44f29e7a4b21'} Oct 12 13:25:50.321326 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:50.321326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:50.321326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:25:50.321326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:25:50.321326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:25:50.321326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:25:50.321326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:25:50.321326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:25:50.321326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:25:50.321326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:25:50.321326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3676307-e5eb-4e25-ab76-44f29e7a4b21 could not be found. Oct 12 13:25:50.321326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:50.321326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:50.321326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:50.321326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:50.321326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:50.321326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:50.321326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:50.321326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:50.321326 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:50.322587 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:50.322587 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:25:50.322587 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:25:50.322587 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:25:50.322587 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:25:50.322587 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:25:50.322587 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:25:50.322587 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3676307-e5eb-4e25-ab76-44f29e7a4b21 could not be found. Oct 12 13:25:50.322587 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:50.322587 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:50.322587 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:50.322587 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:50.322587 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:50.322587 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:50.322587 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:50.322587 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:50.322587 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3676307-e5eb-4e25-ab76-44f29e7a4b21 could not be found. Oct 12 13:25:50.322587 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:50.323710 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-defae0f7-c70e-4283-9120-9a454584de86 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Returning 404 to user: Instance f3676307-e5eb-4e25-ab76-44f29e7a4b21 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:50.323710 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-defae0f7-c70e-4283-9120-9a454584de86 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21" status: 404 len: 111 microversion: 2.1 time: 0.097407 Oct 12 13:25:50.323710 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 559/1046] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:50 2022] GET /compute/v2.1/servers/f3676307-e5eb-4e25-ab76-44f29e7a4b21 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 13:25:50.326107 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9c7b99c8-99d0-4755-b854-fc4988435114 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:50.326750 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-9c7b99c8-99d0-4755-b854-fc4988435114 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: 981cf996-0c9a-4e4a-8ec0-53ca023742eb] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:50.347816 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9c7b99c8-99d0-4755-b854-fc4988435114 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:50.348645 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9c7b99c8-99d0-4755-b854-fc4988435114 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:50.349652 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9c7b99c8-99d0-4755-b854-fc4988435114 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:50.350577 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9c7b99c8-99d0-4755-b854-fc4988435114 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:50.351828 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9c7b99c8-99d0-4755-b854-fc4988435114 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:50.352947 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9c7b99c8-99d0-4755-b854-fc4988435114 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:50.434384 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-9c7b99c8-99d0-4755-b854-fc4988435114 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: 981cf996-0c9a-4e4a-8ec0-53ca023742eb] Going to try to terminate instance {{(pid=120933) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:25:51.204876 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9c7b99c8-99d0-4755-b854-fc4988435114 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "DELETE /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb" status: 204 len: 0 microversion: 2.1 time: 0.883001 Oct 12 13:25:51.213051 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 560/1047] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:25:50 2022] DELETE /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb => generated 0 bytes in 888 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 13:25:51.224734 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7ce56bc3-41e4-4b95-99e5-bd26622e0fe9 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.523750 Oct 12 13:25:51.234034 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 488/1048] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:25:49 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:51.234034 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4c729781-ef26-48df-8a29-4e56769a71f6 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9b9f93a0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:51.264248 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b6bd57f4-1dc0-4eac-baaa-6b78875fa2dd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:51.264248 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-b6bd57f4-1dc0-4eac-baaa-6b78875fa2dd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:51.283213 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b6bd57f4-1dc0-4eac-baaa-6b78875fa2dd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:51.287925 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b6bd57f4-1dc0-4eac-baaa-6b78875fa2dd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:51.288386 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b6bd57f4-1dc0-4eac-baaa-6b78875fa2dd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:51.289175 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b6bd57f4-1dc0-4eac-baaa-6b78875fa2dd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:51.289641 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b6bd57f4-1dc0-4eac-baaa-6b78875fa2dd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:51.290065 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b6bd57f4-1dc0-4eac-baaa-6b78875fa2dd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:51.291985 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4c729781-ef26-48df-8a29-4e56769a71f6 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.065166 Oct 12 13:25:51.295882 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 489/1049] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:51 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:51.305205 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-96893cc9-8e08-4d0a-8046-08643c6058ad tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:51.307525 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-96893cc9-8e08-4d0a-8046-08643c6058ad tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: 981cf996-0c9a-4e4a-8ec0-53ca023742eb] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:51.325392 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-96893cc9-8e08-4d0a-8046-08643c6058ad tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:51.325931 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-96893cc9-8e08-4d0a-8046-08643c6058ad tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:51.326404 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-96893cc9-8e08-4d0a-8046-08643c6058ad tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:51.327140 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-96893cc9-8e08-4d0a-8046-08643c6058ad tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:51.327604 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-96893cc9-8e08-4d0a-8046-08643c6058ad tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:51.328029 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-96893cc9-8e08-4d0a-8046-08643c6058ad tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:51.577707 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b6bd57f4-1dc0-4eac-baaa-6b78875fa2dd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:51.589162 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b6bd57f4-1dc0-4eac-baaa-6b78875fa2dd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d" status: 200 len: 1277 microversion: 2.1 time: 0.374340 Oct 12 13:25:51.597248 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 561/1050] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:51 2022] GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d => generated 1277 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:51.608686 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9582f33d-8b2f-4125-b791-1d3eebca1aeb tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Action: 'create', calling method: .version_select at 0x7f8aa01d6c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-976817196", "description": "tempest-description-160365493"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:51.783621 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-96893cc9-8e08-4d0a-8046-08643c6058ad tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:51.800377 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-96893cc9-8e08-4d0a-8046-08643c6058ad tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb" status: 200 len: 1477 microversion: 2.1 time: 0.500910 Oct 12 13:25:51.801201 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 490/1051] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:51 2022] GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb => generated 1477 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:52.271840 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9582f33d-8b2f-4125-b791-1d3eebca1aeb tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.669922 Oct 12 13:25:52.271840 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 562/1052] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:25:51 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:52.318005 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-712f3748-69d0-45a0-98c4-1654756004e5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9b9f9280>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:52.365589 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-712f3748-69d0-45a0-98c4-1654756004e5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.052067 Oct 12 13:25:52.366721 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 491/1053] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:52 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:52.442353 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a6c37fd8-2e7f-4ee7-bcbc-a1a37235c88f tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-161191548", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "0bc25e31-d39b-49ae-972f-3651d3516f02"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:52.581679 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-a6c37fd8-2e7f-4ee7-bcbc-a1a37235c88f tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] validate_networks() for [('0bc25e31-d39b-49ae-972f-3651d3516f02', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:25:52.618291 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-61d1398b-0196-428d-b058-54159c79064e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:52.618291 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-61d1398b-0196-428d-b058-54159c79064e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:52.626329 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-61d1398b-0196-428d-b058-54159c79064e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:52.626828 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-61d1398b-0196-428d-b058-54159c79064e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:52.627388 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-61d1398b-0196-428d-b058-54159c79064e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:52.628703 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-61d1398b-0196-428d-b058-54159c79064e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:52.629348 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-61d1398b-0196-428d-b058-54159c79064e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:52.629998 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-61d1398b-0196-428d-b058-54159c79064e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:52.884055 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-61d1398b-0196-428d-b058-54159c79064e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:52.892270 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-61d1398b-0196-428d-b058-54159c79064e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d" status: 200 len: 1275 microversion: 2.1 time: 0.279301 Oct 12 13:25:52.893056 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 492/1054] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:52 2022] GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d => generated 1275 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:25:52.902491 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c0c271a0-aa7f-4954-abf0-151257528454 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:52.903477 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c0c271a0-aa7f-4954-abf0-151257528454 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: 981cf996-0c9a-4e4a-8ec0-53ca023742eb] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:52.917413 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c0c271a0-aa7f-4954-abf0-151257528454 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:52.917907 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c0c271a0-aa7f-4954-abf0-151257528454 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:52.918344 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c0c271a0-aa7f-4954-abf0-151257528454 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:52.919055 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c0c271a0-aa7f-4954-abf0-151257528454 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:52.919507 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c0c271a0-aa7f-4954-abf0-151257528454 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:52.920488 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c0c271a0-aa7f-4954-abf0-151257528454 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:53.623926 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c0c271a0-aa7f-4954-abf0-151257528454 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:53.635252 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c0c271a0-aa7f-4954-abf0-151257528454 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb" status: 200 len: 1477 microversion: 2.1 time: 0.740325 Oct 12 13:25:53.651608 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 493/1055] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:52 2022] GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb => generated 1477 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:53.651608 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a48af771-72a4-4d53-85a9-5eafeae063ec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9b9bc820>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:53.722337 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a48af771-72a4-4d53-85a9-5eafeae063ec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.082388 Oct 12 13:25:53.744314 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 494/1056] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:53 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:53.867558 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-a6c37fd8-2e7f-4ee7-bcbc-a1a37235c88f tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3bcc0036-58f7-4175-aea7-b8694f343cae) Oct 12 13:25:53.867558 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:53.867558 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:53.867558 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:53.867558 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:53.867558 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:53.867558 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:53.867558 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:53.867558 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:53.867558 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:53.867558 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:25:53.867558 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:25:53.867558 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:25:53.867558 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:25:53.867558 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:25:53.867558 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:25:53.869466 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:25:53.869466 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:25:53.869466 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:25:53.869466 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:25:53.869466 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:25:53.869466 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:25:53.869466 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:25:53.869466 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:25:53.869466 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:25:53.869466 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:25:53.869466 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:25:53.869466 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:53.869466 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:53.869466 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:25:53.869466 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:25:53.869466 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:53.869466 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:53.869466 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:25:53.870890 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:25:53.870890 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:53.870890 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:53.870890 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:25:53.870890 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:25:53.870890 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:53.870890 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:53.870890 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:25:53.870890 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:25:53.870890 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:25:53.870890 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:25:53.870890 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:25:53.870890 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:25:53.870890 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:25:53.870890 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:25:53.870890 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:25:53.870890 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:25:53.870890 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:25:53.871995 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:25:53.871995 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:25:53.871995 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:25:53.871995 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:25:53.871995 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:25:53.871995 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:25:53.871995 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:25:53.871995 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:25:53.871995 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:25:53.871995 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:25:53.871995 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:25:53.871995 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:25:53.871995 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:25:53.871995 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:25:53.871995 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3bcc0036-58f7-4175-aea7-b8694f343cae) Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-a6c37fd8-2e7f-4ee7-bcbc-a1a37235c88f tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a6c37fd8-2e7f-4ee7-bcbc-a1a37235c88f tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Request method failure captured: Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 207 Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsBdL7wyincMMZQwWVO4VXZ12yGjskbZB6RbMosVFiO3AhWsk3p3j49O8SLUIedaHGcczd4m4MpzaMoMcOa6aCWbbQi-5ZIc3ZUEa1lJskMXmN8Nc0ijYn_Q7UvKQVQkq2YKbmWhYhuHg_-gF1WghqCfIW01OCPDumgGkHJGO6VVHFs Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 3399cf92fd65427b8652320be1e501ad Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:25:53.872945 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:25:53.874685 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3399cf92fd65427b8652320be1e501ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3399cf92fd65427b8652320be1e501ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3399cf92fd65427b8652320be1e501ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3399cf92fd65427b8652320be1e501ad"}]}] Oct 12 13:25:53.874685 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:25:53.874685 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 3399cf92fd65427b8652320be1e501ad Oct 12 13:25:53.874685 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:25:53.874685 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-SecurityGroupsTestJSON-1263036119-project Oct 12 13:25:53.874685 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:25:53.874685 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:25:53.874685 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 21315dd58bd4461bb41c70ccdfd27d47 Oct 12 13:25:53.874685 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-SecurityGroupsTestJSON-1263036119-project Oct 12 13:25:53.874685 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:25:53.874685 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-161191548", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "0bc25e31-d39b-49ae-972f-3651d3516f02"}]}} Oct 12 13:25:53.875575 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:25:53.875575 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:53.875575 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:25:53.875575 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-SecurityGroupsTestJSON-server-161191548', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '0bc25e31-d39b-49ae-972f-3651d3516f02'}]}}} Oct 12 13:25:53.875575 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:53.875575 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:53.875575 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:53.875575 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:53.875575 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:53.875575 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:53.875575 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:53.875575 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:53.875575 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:25:53.875575 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:25:53.875575 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:25:53.875575 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:25:53.875575 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:25:53.875575 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:25:53.875575 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:25:53.879255 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:25:53.879255 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:25:53.879255 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:25:53.879255 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:25:53.879255 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:25:53.879255 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:25:53.879255 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:25:53.879255 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:25:53.879255 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:25:53.879255 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:25:53.879255 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:25:53.879255 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:25:53.879255 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:53.879255 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:53.879255 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:25:53.879255 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:25:53.879255 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:53.879255 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:53.881154 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:25:53.881154 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:25:53.881154 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:53.881154 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:53.881154 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:25:53.881154 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:25:53.881154 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:53.881154 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:53.881154 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:25:53.881154 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:25:53.881154 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:25:53.881154 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:25:53.881154 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:25:53.881154 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:25:53.881154 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:25:53.881154 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:25:53.881154 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:25:53.881154 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:25:53.884667 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:25:53.884667 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:25:53.884667 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:25:53.884667 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:25:53.884667 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:25:53.884667 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:25:53.884667 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:25:53.884667 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:25:53.884667 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:25:53.884667 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:25:53.884667 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:25:53.884667 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:25:53.884667 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:25:53.884667 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:25:53.884667 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:25:53.884667 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:25:53.885866 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3bcc0036-58f7-4175-aea7-b8694f343cae) Oct 12 13:25:53.885866 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:53.885866 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:53.885866 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:53.885866 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:53.885866 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:53.885866 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:53.885866 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:53.885866 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:53.885866 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:25:53.885866 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:25:53.885866 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:53.885866 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:53.885866 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:53.885866 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:53.885866 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:53.885866 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:53.885866 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:53.885866 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:53.887376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:53.887376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:53.887376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:53.887376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:53.887376 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:25:53.887376 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a6c37fd8-2e7f-4ee7-bcbc-a1a37235c88f tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:25:53.887376 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:53.887376 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a6c37fd8-2e7f-4ee7-bcbc-a1a37235c88f tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.388887 Oct 12 13:25:53.887376 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 563/1057] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:25:52 2022] POST /compute/v2.1/servers => generated 214 bytes in 1390 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:25:53.888184 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4f464046-07c5-4f08-b20d-86844097b3fb tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Action: 'create', calling method: .version_select at 0x7f8a9b9bcaf0>, body: {"security_group": {"name": " tempest-securitygroup -1059351444 ", "description": "tempest-description-1912923170"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:53.924404 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b44675da-1da3-4706-a2c5-f0addb8b8fe9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:53.925255 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-b44675da-1da3-4706-a2c5-f0addb8b8fe9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:53.936287 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b44675da-1da3-4706-a2c5-f0addb8b8fe9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:53.937103 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b44675da-1da3-4706-a2c5-f0addb8b8fe9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:53.961421 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b44675da-1da3-4706-a2c5-f0addb8b8fe9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:53.961421 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b44675da-1da3-4706-a2c5-f0addb8b8fe9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:53.961421 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b44675da-1da3-4706-a2c5-f0addb8b8fe9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:53.961421 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b44675da-1da3-4706-a2c5-f0addb8b8fe9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:54.265343 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b44675da-1da3-4706-a2c5-f0addb8b8fe9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:54.286767 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b44675da-1da3-4706-a2c5-f0addb8b8fe9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d" status: 200 len: 1317 microversion: 2.1 time: 0.370285 Oct 12 13:25:54.304762 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 564/1058] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:53 2022] GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:54.516881 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-2c8b8754-7ecc-43b2-acca-ce24660c238b req-6c42b917-6e07-4468-961a-01dc38fab9fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14676667-3743-4d37-8ff9-f8d161a483d4", "name": "network-vif-plugged", "status": "completed", "tag": "5170297d-0d3f-4e69-aa8a-6c0e40750532"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:54.527362 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-2c8b8754-7ecc-43b2-acca-ce24660c238b req-6c42b917-6e07-4468-961a-01dc38fab9fa service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:54.528178 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-2c8b8754-7ecc-43b2-acca-ce24660c238b req-6c42b917-6e07-4468-961a-01dc38fab9fa service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:54.529608 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-2c8b8754-7ecc-43b2-acca-ce24660c238b req-6c42b917-6e07-4468-961a-01dc38fab9fa service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:54.551724 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-2c8b8754-7ecc-43b2-acca-ce24660c238b req-6c42b917-6e07-4468-961a-01dc38fab9fa service nova] Creating event network-vif-plugged:5170297d-0d3f-4e69-aa8a-6c0e40750532 for instance 14676667-3743-4d37-8ff9-f8d161a483d4 on n-h2-861076-2 Oct 12 13:25:54.557744 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-2c8b8754-7ecc-43b2-acca-ce24660c238b req-6c42b917-6e07-4468-961a-01dc38fab9fa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043432 Oct 12 13:25:54.558192 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 565/1059] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:54.564106 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-17b7e73a-7cb4-49c2-96c8-456bcb0a4d2f req-422fedbb-04a1-4da8-81fc-9ef5c0a33a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981cf996-0c9a-4e4a-8ec0-53ca023742eb", "name": "network-vif-deleted", "tag": "bbd1fd9d-4fd1-45fc-969b-d8977c2bdd5a"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:54.575424 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-17b7e73a-7cb4-49c2-96c8-456bcb0a4d2f req-422fedbb-04a1-4da8-81fc-9ef5c0a33a3c service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:54.576100 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-17b7e73a-7cb4-49c2-96c8-456bcb0a4d2f req-422fedbb-04a1-4da8-81fc-9ef5c0a33a3c service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:54.593071 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-17b7e73a-7cb4-49c2-96c8-456bcb0a4d2f req-422fedbb-04a1-4da8-81fc-9ef5c0a33a3c service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:54.593071 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-17b7e73a-7cb4-49c2-96c8-456bcb0a4d2f req-422fedbb-04a1-4da8-81fc-9ef5c0a33a3c service nova] Creating event network-vif-deleted:bbd1fd9d-4fd1-45fc-969b-d8977c2bdd5a for instance 981cf996-0c9a-4e4a-8ec0-53ca023742eb on n-h1-861076-2 Oct 12 13:25:54.595063 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-17b7e73a-7cb4-49c2-96c8-456bcb0a4d2f req-422fedbb-04a1-4da8-81fc-9ef5c0a33a3c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035557 Oct 12 13:25:54.595661 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 566/1060] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:54.659688 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5efd75eb-4041-4a2c-b800-b06d6e1edf88 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:54.661316 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-5efd75eb-4041-4a2c-b800-b06d6e1edf88 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: 981cf996-0c9a-4e4a-8ec0-53ca023742eb] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:54.667704 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5efd75eb-4041-4a2c-b800-b06d6e1edf88 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:54.678899 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5efd75eb-4041-4a2c-b800-b06d6e1edf88 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:54.678899 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5efd75eb-4041-4a2c-b800-b06d6e1edf88 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:54.678899 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5efd75eb-4041-4a2c-b800-b06d6e1edf88 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:54.678899 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5efd75eb-4041-4a2c-b800-b06d6e1edf88 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:54.679330 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5efd75eb-4041-4a2c-b800-b06d6e1edf88 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:54.737660 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-5efd75eb-4041-4a2c-b800-b06d6e1edf88 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:54.745949 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5efd75eb-4041-4a2c-b800-b06d6e1edf88 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb" status: 200 len: 1435 microversion: 2.1 time: 0.091668 Oct 12 13:25:54.749053 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 567/1061] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:54 2022] GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb => generated 1435 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:25:54.754106 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-83cd1b22-ba99-4cac-b747-9b186288edea tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa0aa80d0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:54.820805 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-83cd1b22-ba99-4cac-b747-9b186288edea tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.070444 Oct 12 13:25:54.822119 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 568/1062] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:54 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:55.244287 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4f464046-07c5-4f08-b20d-86844097b3fb tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 1.368528 Oct 12 13:25:55.255955 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 495/1063] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:25:53 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:55.258854 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2a14d07a-13f7-45e6-b770-e95c43c7f06c tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Calling method '.version_select at 0x7f8a9bd1ce50>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:55.322308 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d0ca0bc4-b1ef-4a41-a858-6412ed291e40 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:55.323010 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d0ca0bc4-b1ef-4a41-a858-6412ed291e40 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:55.332291 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0ca0bc4-b1ef-4a41-a858-6412ed291e40 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:55.332983 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0ca0bc4-b1ef-4a41-a858-6412ed291e40 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:55.333400 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0ca0bc4-b1ef-4a41-a858-6412ed291e40 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:55.334114 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0ca0bc4-b1ef-4a41-a858-6412ed291e40 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:55.334575 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0ca0bc4-b1ef-4a41-a858-6412ed291e40 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:55.335003 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0ca0bc4-b1ef-4a41-a858-6412ed291e40 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:55.335615 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2a14d07a-13f7-45e6-b770-e95c43c7f06c tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/4660681e-d98d-4065-8dc5-f3b783fc250b" status: 200 len: 224 microversion: 2.1 time: 0.081292 Oct 12 13:25:55.336202 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 569/1064] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 12 13:25:55 2022] GET /compute/v2.1/os-security-groups/4660681e-d98d-4065-8dc5-f3b783fc250b => generated 224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:55.349359 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c382330a-917b-42c9-aa63-1805325a753b tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Calling method '.version_select at 0x7f8aa038c550>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:55.746385 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d0ca0bc4-b1ef-4a41-a858-6412ed291e40 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:55.754798 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d0ca0bc4-b1ef-4a41-a858-6412ed291e40 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d" status: 200 len: 1317 microversion: 2.1 time: 0.440516 Oct 12 13:25:55.755476 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 496/1065] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:55 2022] GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:25:55.779422 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2537d8c3-60a5-4a95-85b6-5eb58e1b7b28 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:55.780675 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2537d8c3-60a5-4a95-85b6-5eb58e1b7b28 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: 981cf996-0c9a-4e4a-8ec0-53ca023742eb] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:55.789018 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2537d8c3-60a5-4a95-85b6-5eb58e1b7b28 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:55.789823 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2537d8c3-60a5-4a95-85b6-5eb58e1b7b28 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:55.790549 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2537d8c3-60a5-4a95-85b6-5eb58e1b7b28 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:55.791377 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2537d8c3-60a5-4a95-85b6-5eb58e1b7b28 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:55.791932 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2537d8c3-60a5-4a95-85b6-5eb58e1b7b28 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:55.792426 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2537d8c3-60a5-4a95-85b6-5eb58e1b7b28 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:55.841208 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2537d8c3-60a5-4a95-85b6-5eb58e1b7b28 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:55.841208 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2537d8c3-60a5-4a95-85b6-5eb58e1b7b28 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:55.841376 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2537d8c3-60a5-4a95-85b6-5eb58e1b7b28 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:55.841818 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-2537d8c3-60a5-4a95-85b6-5eb58e1b7b28 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lazy-loading 'fault' on Instance uuid 981cf996-0c9a-4e4a-8ec0-53ca023742eb {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:25:55.999796 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-2537d8c3-60a5-4a95-85b6-5eb58e1b7b28 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27540849dbc344a384a1f24a6cc32175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd8d44b48d4ec0b54a400fd73ca770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:56.014045 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2537d8c3-60a5-4a95-85b6-5eb58e1b7b28 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb" status: 200 len: 1311 microversion: 2.1 time: 0.242637 Oct 12 13:25:56.020867 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 497/1066] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:55 2022] GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb => generated 1311 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:56.032199 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-247a72fd-a31a-4514-8e17-39c1a09830b9 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9b9f9d30>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:56.097584 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-247a72fd-a31a-4514-8e17-39c1a09830b9 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.074978 Oct 12 13:25:56.099795 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 498/1067] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:56 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:56.154857 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c382330a-917b-42c9-aa63-1805325a753b tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/4660681e-d98d-4065-8dc5-f3b783fc250b" status: 202 len: 0 microversion: 2.1 time: 0.809663 Oct 12 13:25:56.155425 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 570/1068] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:25:55 2022] DELETE /compute/v2.1/os-security-groups/4660681e-d98d-4065-8dc5-f3b783fc250b => generated 0 bytes in 811 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 13:25:56.163959 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9377f05a-e840-440c-99f0-ce0b74a1ca01 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Calling method '.version_select at 0x7f8a9b9b6d30>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:56.328028 n-d-861076-2 devstack@n-api.service[120932]: DEBUG neutronclient.v2_0.client [None req-9377f05a-e840-440c-99f0-ce0b74a1ca01 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4660681e-d98d-4065-8dc5-f3b783fc250b does not exist", "detail": ""}} {{(pid=120932) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 13:25:56.328997 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.security_group_api [None req-9377f05a-e840-440c-99f0-ce0b74a1ca01 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Neutron security group 4660681e-d98d-4065-8dc5-f3b783fc250b not found {{(pid=120932) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 13:25:56.329994 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-9377f05a-e840-440c-99f0-ce0b74a1ca01 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] HTTP exception thrown: Security group 4660681e-d98d-4065-8dc5-f3b783fc250b does not exist Oct 12 13:25:56.329994 n-d-861076-2 devstack@n-api.service[120932]: Neutron server returns request_ids: ['req-05dde526-e59e-4078-ad97-3e45283bc4ea'] Oct 12 13:25:56.343403 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9377f05a-e840-440c-99f0-ce0b74a1ca01 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Request method failure captured: Oct 12 13:25:56.343403 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/os-security-groups/4660681e-d98d-4065-8dc5-f3b783fc250b HTTP/1.1 Oct 12 13:25:56.343403 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:25:56.343403 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:25:56.343403 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:25:56.343403 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:25:56.343403 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:25:56.343403 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:25:56.343403 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:25:56.343403 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:56.343403 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsBdL7wyincMMZQwWVO4VXZ12yGjskbZB6RbMosVFiO3AhWsk3p3j49O8SLUIedaHGcczd4m4MpzaMoMcOa6aCWbbQi-5ZIc3ZUEa1lJskMXmN8Nc0ijYn_Q7UvKQVQkq2YKbmWhYhuHg_-gF1WghqCfIW01OCPDumgGkHJGO6VVHFs Oct 12 13:25:56.343403 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:25:56.343403 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:25:56.343403 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:25:56.343403 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:25:56.343403 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:25:56.343403 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:25:56.343403 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 3399cf92fd65427b8652320be1e501ad Oct 12 13:25:56.343403 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:25:56.343403 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:25:56.343403 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:25:56.345349 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3399cf92fd65427b8652320be1e501ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3399cf92fd65427b8652320be1e501ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3399cf92fd65427b8652320be1e501ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3399cf92fd65427b8652320be1e501ad"}]}] Oct 12 13:25:56.345349 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:25:56.345349 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 3399cf92fd65427b8652320be1e501ad Oct 12 13:25:56.345349 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:25:56.345349 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-SecurityGroupsTestJSON-1263036119-project Oct 12 13:25:56.345349 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:25:56.345349 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:25:56.345349 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 21315dd58bd4461bb41c70ccdfd27d47 Oct 12 13:25:56.345349 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-SecurityGroupsTestJSON-1263036119-project Oct 12 13:25:56.345349 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:25:56.345349 n-d-861076-2 devstack@n-api.service[120932]: exception: Security group 4660681e-d98d-4065-8dc5-f3b783fc250b does not exist Oct 12 13:25:56.345349 n-d-861076-2 devstack@n-api.service[120932]: Neutron server returns request_ids: ['req-05dde526-e59e-4078-ad97-3e45283bc4ea'] Oct 12 13:25:56.345349 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '4660681e-d98d-4065-8dc5-f3b783fc250b'} Oct 12 13:25:56.346254 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:56.346254 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:56.346254 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 13:25:56.346254 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 13:25:56.346254 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:56.346254 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:56.346254 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 13:25:56.346254 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 13:25:56.346254 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:56.346254 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:56.346254 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:25:56.346254 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:25:56.346254 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:56.346254 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:56.346254 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:25:56.346254 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:25:56.346254 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:56.346254 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:56.346254 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 13:25:56.347405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 13:25:56.347405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:25:56.347405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:25:56.347405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 13:25:56.347405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 13:25:56.347405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 13:25:56.347405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 13:25:56.347405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4660681e-d98d-4065-8dc5-f3b783fc250b does not exist Oct 12 13:25:56.347405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05dde526-e59e-4078-ad97-3e45283bc4ea'] Oct 12 13:25:56.347405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:56.347405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:56.347405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:56.347405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:56.347405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 12 13:25:56.347405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 13:25:56.347405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 13:25:56.347405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 13:25:56.347405 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4660681e-d98d-4065-8dc5-f3b783fc250b does not exist Oct 12 13:25:56.348710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05dde526-e59e-4078-ad97-3e45283bc4ea'] Oct 12 13:25:56.348710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:56.348710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:56.348710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:56.348710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:56.348710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:56.348710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:56.348710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:56.348710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:56.348710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:25:56.348710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:25:56.348710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:56.348710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:56.348710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 12 13:25:56.348710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 13:25:56.348710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4660681e-d98d-4065-8dc5-f3b783fc250b does not exist Oct 12 13:25:56.348710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05dde526-e59e-4078-ad97-3e45283bc4ea'] Oct 12 13:25:56.348710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:56.348710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:56.348710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:56.348710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:56.350953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:56.350953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:56.350953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:56.350953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:56.350953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4660681e-d98d-4065-8dc5-f3b783fc250b does not exist Oct 12 13:25:56.350953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05dde526-e59e-4078-ad97-3e45283bc4ea'] Oct 12 13:25:56.350953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:56.353038 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9377f05a-e840-440c-99f0-ce0b74a1ca01 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Returning 404 to user: Security group 4660681e-d98d-4065-8dc5-f3b783fc250b does not exist Oct 12 13:25:56.353038 n-d-861076-2 devstack@n-api.service[120932]: Neutron server returns request_ids: ['req-05dde526-e59e-4078-ad97-3e45283bc4ea'] {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:56.354167 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9377f05a-e840-440c-99f0-ce0b74a1ca01 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/4660681e-d98d-4065-8dc5-f3b783fc250b" status: 404 len: 194 microversion: 2.1 time: 0.194648 Oct 12 13:25:56.355246 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 499/1069] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 12 13:25:56 2022] GET /compute/v2.1/os-security-groups/4660681e-d98d-4065-8dc5-f3b783fc250b => generated 194 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:25:56.366533 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3b3086f1-e92f-4b6c-a389-ad76f3841f2f tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Action: 'create', calling method: .version_select at 0x7f8a9bd01f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-330433603", "description": "tempest-description-2111624962"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:56.611104 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2f6e21e2-afd0-4489-a869-20e34c1a6dad tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-593918320", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:56.687873 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-2f6e21e2-afd0-4489-a869-20e34c1a6dad tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] validate_networks() for None {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:25:56.848455 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:25:57.165111 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-2f6e21e2-afd0-4489-a869-20e34c1a6dad tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:25:57.169752 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-2f6e21e2-afd0-4489-a869-20e34c1a6dad tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:25:57.169752 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-2f6e21e2-afd0-4489-a869-20e34c1a6dad tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:25:57.169752 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-2f6e21e2-afd0-4489-a869-20e34c1a6dad tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:25:57.169752 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-2f6e21e2-afd0-4489-a869-20e34c1a6dad tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:25:57.178110 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f6e21e2-afd0-4489-a869-20e34c1a6dad tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:57.178930 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f6e21e2-afd0-4489-a869-20e34c1a6dad tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:57.179584 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f6e21e2-afd0-4489-a869-20e34c1a6dad tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:57.180528 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f6e21e2-afd0-4489-a869-20e34c1a6dad tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:57.181252 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f6e21e2-afd0-4489-a869-20e34c1a6dad tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:57.181898 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f6e21e2-afd0-4489-a869-20e34c1a6dad tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:57.202009 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-2f6e21e2-afd0-4489-a869-20e34c1a6dad tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Getting quotas for project 2bb790004fd34993aeee9b0f5820b798. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:25:57.208015 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-2f6e21e2-afd0-4489-a869-20e34c1a6dad tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Getting quotas for user aecb9d3ecf9d4f29bc40f00736887149 and project 2bb790004fd34993aeee9b0f5820b798. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:25:57.223648 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2f6e21e2-afd0-4489-a869-20e34c1a6dad tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:25:57.226408 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2f6e21e2-afd0-4489-a869-20e34c1a6dad tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:25:57.294054 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3b3086f1-e92f-4b6c-a389-ad76f3841f2f tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.931740 Oct 12 13:25:57.303966 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 571/1070] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:25:56 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:57.308819 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-8b419b43-c917-413d-8936-8302a4cc9216 req-20395e69-2a80-4b7d-b812-d8425077feb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e37b5b43-6124-4cd8-bdba-1c489326db1d", "tag": "0b9eae89-c32d-4a0b-9567-be443a4f3d00"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:57.321907 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-8b419b43-c917-413d-8936-8302a4cc9216 req-20395e69-2a80-4b7d-b812-d8425077feb2 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:57.322470 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-8b419b43-c917-413d-8936-8302a4cc9216 req-20395e69-2a80-4b7d-b812-d8425077feb2 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:57.322966 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-8b419b43-c917-413d-8936-8302a4cc9216 req-20395e69-2a80-4b7d-b812-d8425077feb2 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:57.334536 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-8b419b43-c917-413d-8936-8302a4cc9216 req-20395e69-2a80-4b7d-b812-d8425077feb2 service nova] Creating event network-changed:0b9eae89-c32d-4a0b-9567-be443a4f3d00 for instance e37b5b43-6124-4cd8-bdba-1c489326db1d on n-h2-861076-2 Oct 12 13:25:57.339612 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-8b419b43-c917-413d-8936-8302a4cc9216 req-20395e69-2a80-4b7d-b812-d8425077feb2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034385 Oct 12 13:25:57.340292 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 572/1071] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:57.346794 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-64cd75c3-16bb-47f0-b7e3-334a47ff6a42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:57.347497 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-64cd75c3-16bb-47f0-b7e3-334a47ff6a42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:57.355386 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-64cd75c3-16bb-47f0-b7e3-334a47ff6a42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:57.365181 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-64cd75c3-16bb-47f0-b7e3-334a47ff6a42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:57.365181 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-64cd75c3-16bb-47f0-b7e3-334a47ff6a42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:57.365181 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-64cd75c3-16bb-47f0-b7e3-334a47ff6a42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:57.365181 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-64cd75c3-16bb-47f0-b7e3-334a47ff6a42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:57.365672 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-64cd75c3-16bb-47f0-b7e3-334a47ff6a42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:57.457906 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2f6e21e2-afd0-4489-a869-20e34c1a6dad tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.974618 Oct 12 13:25:57.475883 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 500/1072] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:25:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 13:25:57.749231 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1265afa1-ef15-4bb9-ac6f-a47a54977398 tempest-AZV2TestJSON-1830588325 tempest-AZV2TestJSON-1830588325-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:57.751228 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1265afa1-ef15-4bb9-ac6f-a47a54977398 tempest-AZV2TestJSON-1830588325 tempest-AZV2TestJSON-1830588325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:57.751865 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1265afa1-ef15-4bb9-ac6f-a47a54977398 tempest-AZV2TestJSON-1830588325 tempest-AZV2TestJSON-1830588325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:57.752455 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1265afa1-ef15-4bb9-ac6f-a47a54977398 tempest-AZV2TestJSON-1830588325 tempest-AZV2TestJSON-1830588325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:57.753370 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1265afa1-ef15-4bb9-ac6f-a47a54977398 tempest-AZV2TestJSON-1830588325 tempest-AZV2TestJSON-1830588325-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:57.754075 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1265afa1-ef15-4bb9-ac6f-a47a54977398 tempest-AZV2TestJSON-1830588325 tempest-AZV2TestJSON-1830588325-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:57.755774 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1265afa1-ef15-4bb9-ac6f-a47a54977398 tempest-AZV2TestJSON-1830588325 tempest-AZV2TestJSON-1830588325-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:57.797103 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1265afa1-ef15-4bb9-ac6f-a47a54977398 tempest-AZV2TestJSON-1830588325 tempest-AZV2TestJSON-1830588325-project] 10.222.0.52 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.318321 Oct 12 13:25:57.819656 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 501/1073] 10.222.0.52 () {58 vars in 1164 bytes} [Wed Oct 12 13:25:57 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:25:57.833845 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-49ea4221-8994-443d-affe-016206273b96 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:57.834269 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-49ea4221-8994-443d-affe-016206273b96 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] [instance: 981cf996-0c9a-4e4a-8ec0-53ca023742eb] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:57.856336 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-49ea4221-8994-443d-affe-016206273b96 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:57.856923 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-49ea4221-8994-443d-affe-016206273b96 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:57.858630 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-49ea4221-8994-443d-affe-016206273b96 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:57.860589 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-49ea4221-8994-443d-affe-016206273b96 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:57.861110 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-49ea4221-8994-443d-affe-016206273b96 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:57.862988 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-49ea4221-8994-443d-affe-016206273b96 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:57.890215 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-49ea4221-8994-443d-affe-016206273b96 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] HTTP exception thrown: Instance 981cf996-0c9a-4e4a-8ec0-53ca023742eb could not be found. Oct 12 13:25:57.892070 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-49ea4221-8994-443d-affe-016206273b96 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Request method failure captured: Oct 12 13:25:57.892070 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb HTTP/1.1 Oct 12 13:25:57.892070 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:25:57.892070 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:25:57.892070 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:25:57.892070 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:25:57.892070 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:25:57.892070 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:25:57.892070 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:25:57.892070 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:25:57.892070 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsARdsd6T720xG98HGmWowFvXYiZuX7KDGnMpozvkfe2Gm01T2WUk_Z8qdpKwlbqDTjSls0cSiBGuL-hDPGCJ2bhggjwfvR0WmyeHVghmcMEjspqg5zwOCmKaOEGKzKsungoOypofYyl0mdzaksZyTjgSVus1A095IYwlxl4elgiI5U Oct 12 13:25:57.892070 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:25:57.892070 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:25:57.892070 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:25:57.892070 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:25:57.892070 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:25:57.892070 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:25:57.892070 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 7afd8d44b48d4ec0b54a400fd73ca770 Oct 12 13:25:57.892070 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1062311697 Oct 12 13:25:57.892070 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:25:57.892070 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:25:57.902747 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7afd8d44b48d4ec0b54a400fd73ca770"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7afd8d44b48d4ec0b54a400fd73ca770"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7afd8d44b48d4ec0b54a400fd73ca770"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7afd8d44b48d4ec0b54a400fd73ca770"}]}] Oct 12 13:25:57.902747 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1062311697 Oct 12 13:25:57.902747 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 7afd8d44b48d4ec0b54a400fd73ca770 Oct 12 13:25:57.902747 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1062311697 Oct 12 13:25:57.902747 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServersAdminNegativeTestJSON-1062311697-project Oct 12 13:25:57.902747 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:25:57.902747 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:25:57.902747 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 27540849dbc344a384a1f24a6cc32175 Oct 12 13:25:57.902747 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1062311697-project Oct 12 13:25:57.902747 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:25:57.902747 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance 981cf996-0c9a-4e4a-8ec0-53ca023742eb could not be found. Oct 12 13:25:57.902747 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '981cf996-0c9a-4e4a-8ec0-53ca023742eb'} Oct 12 13:25:57.903771 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:25:57.903771 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:57.903771 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:25:57.903771 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:25:57.903771 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:25:57.903771 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:25:57.903771 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:25:57.903771 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:25:57.903771 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:25:57.903771 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:25:57.903771 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 981cf996-0c9a-4e4a-8ec0-53ca023742eb could not be found. Oct 12 13:25:57.903771 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:57.903771 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:57.903771 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:57.903771 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:57.903771 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:57.903771 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:57.903771 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:25:57.903771 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:25:57.903771 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:25:57.905046 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:25:57.905046 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:25:57.905046 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:25:57.905046 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:25:57.905046 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:25:57.905046 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:25:57.905046 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:25:57.905046 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 981cf996-0c9a-4e4a-8ec0-53ca023742eb could not be found. Oct 12 13:25:57.905046 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:57.905046 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:25:57.905046 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:57.905046 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:25:57.905046 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:25:57.905046 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:25:57.905046 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:25:57.905046 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:25:57.905046 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 981cf996-0c9a-4e4a-8ec0-53ca023742eb could not be found. Oct 12 13:25:57.905046 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:25:57.907662 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-49ea4221-8994-443d-affe-016206273b96 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] Returning 404 to user: Instance 981cf996-0c9a-4e4a-8ec0-53ca023742eb could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:25:57.907662 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-49ea4221-8994-443d-affe-016206273b96 tempest-ServersAdminNegativeTestJSON-1062311697 tempest-ServersAdminNegativeTestJSON-1062311697-project] 10.222.0.52 "GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb" status: 404 len: 111 microversion: 2.1 time: 0.072654 Oct 12 13:25:57.907662 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 502/1074] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:57 2022] GET /compute/v2.1/servers/981cf996-0c9a-4e4a-8ec0-53ca023742eb => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:25:57.907662 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-947e06aa-0d0d-4431-8527-090da9bb38fc tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9b9b6dc0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:57.955570 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-64cd75c3-16bb-47f0-b7e3-334a47ff6a42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:25:57.966323 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-947e06aa-0d0d-4431-8527-090da9bb38fc tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.066336 Oct 12 13:25:57.968969 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-64cd75c3-16bb-47f0-b7e3-334a47ff6a42 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d" status: 200 len: 1317 microversion: 2.1 time: 0.623884 Oct 12 13:25:57.971960 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 573/1075] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:57 2022] GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d => generated 1317 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:57.976836 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 503/1076] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:57 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:57.983616 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b7678634-2d25-4c55-a9a5-245924d2ef74 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1253965216", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:57.987457 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e1ffd53a-a63e-4fdf-9fbb-f8de89a8f552 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Action: 'create', calling method: .version_select at 0x7f8a9bf0ab80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-409250877", "description": "tempest-description-655141584"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:58.065885 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-b7678634-2d25-4c55-a9a5-245924d2ef74 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] validate_networks() for None {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:25:58.429642 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=6 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:25:59.140430 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-b7678634-2d25-4c55-a9a5-245924d2ef74 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:25:59.140430 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-b7678634-2d25-4c55-a9a5-245924d2ef74 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:25:59.140430 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-b7678634-2d25-4c55-a9a5-245924d2ef74 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:25:59.140430 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-b7678634-2d25-4c55-a9a5-245924d2ef74 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:25:59.140430 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-b7678634-2d25-4c55-a9a5-245924d2ef74 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:25:59.159290 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7678634-2d25-4c55-a9a5-245924d2ef74 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:59.160033 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7678634-2d25-4c55-a9a5-245924d2ef74 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:59.161589 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7678634-2d25-4c55-a9a5-245924d2ef74 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:59.169112 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7678634-2d25-4c55-a9a5-245924d2ef74 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:59.180202 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7678634-2d25-4c55-a9a5-245924d2ef74 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:59.181146 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7678634-2d25-4c55-a9a5-245924d2ef74 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:59.233217 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-b7678634-2d25-4c55-a9a5-245924d2ef74 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Getting quotas for project 2bb790004fd34993aeee9b0f5820b798. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:25:59.241787 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-b7678634-2d25-4c55-a9a5-245924d2ef74 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Getting quotas for user aecb9d3ecf9d4f29bc40f00736887149 and project 2bb790004fd34993aeee9b0f5820b798. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:25:59.282899 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b7678634-2d25-4c55-a9a5-245924d2ef74 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:25:59.289751 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b7678634-2d25-4c55-a9a5-245924d2ef74 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2e5ecdb4-eaf0-4b44-9a4c-e442345da741] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:25:59.610685 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e1ffd53a-a63e-4fdf-9fbb-f8de89a8f552 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.633877 Oct 12 13:25:59.612163 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 574/1077] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:25:57 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:25:59.618317 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d53fe948-25a5-4d91-806d-c829014320e5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa01d63a0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:59.653349 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b7678634-2d25-4c55-a9a5-245924d2ef74 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.671244 Oct 12 13:25:59.660191 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 504/1078] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:25:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 13:25:59.698309 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fc4e786e-1e6f-4ad0-b7a8-17e1062abdd4 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:25:59.699759 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fc4e786e-1e6f-4ad0-b7a8-17e1062abdd4 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:25:59.745851 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d53fe948-25a5-4d91-806d-c829014320e5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.129015 Oct 12 13:25:59.747612 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 575/1079] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:25:59 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:25:59.765098 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc4e786e-1e6f-4ad0-b7a8-17e1062abdd4 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:59.767584 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc4e786e-1e6f-4ad0-b7a8-17e1062abdd4 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:59.768051 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc4e786e-1e6f-4ad0-b7a8-17e1062abdd4 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:25:59.768612 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-15b99127-1a33-40fc-b936-892f5e9a6819 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Action: 'create', calling method: .version_select at 0x7f8aa0045790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1203568618", "description": "tempest-description-293661743"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:25:59.768800 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc4e786e-1e6f-4ad0-b7a8-17e1062abdd4 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:25:59.783012 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc4e786e-1e6f-4ad0-b7a8-17e1062abdd4 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:25:59.783559 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc4e786e-1e6f-4ad0-b7a8-17e1062abdd4 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:00.728592 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-fc4e786e-1e6f-4ad0-b7a8-17e1062abdd4 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:00.737209 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fc4e786e-1e6f-4ad0-b7a8-17e1062abdd4 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d" status: 200 len: 1317 microversion: 2.1 time: 1.077011 Oct 12 13:26:00.739696 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 505/1080] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:25:59 2022] GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d => generated 1317 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:00.781097 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ea594469-5474-4129-9db9-01c8d84e31ae tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:00.783377 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ea594469-5474-4129-9db9-01c8d84e31ae tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2e5ecdb4-eaf0-4b44-9a4c-e442345da741] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:00.986250 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-ea594469-5474-4129-9db9-01c8d84e31ae tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:01.000399 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ea594469-5474-4129-9db9-01c8d84e31ae tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741" status: 200 len: 1214 microversion: 2.1 time: 0.255654 Oct 12 13:26:01.013942 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 506/1081] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:00 2022] GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741 => generated 1214 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:01.029155 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8dbce6f4-8d18-4839-a0f6-188555934fbc tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9b9b6ca0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:01.132778 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8dbce6f4-8d18-4839-a0f6-188555934fbc tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.117146 Oct 12 13:26:01.141015 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 507/1082] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:26:01 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:01.168323 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-15b99127-1a33-40fc-b936-892f5e9a6819 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.419303 Oct 12 13:26:01.169272 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 576/1083] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:25:59 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:01.183151 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cc8c8f58-1332-4852-88a5-15d97c21ec74 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Calling method '.version_select at 0x7f8a9b9b6700>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:01.768060 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b132586a-a669-4d6a-bbfc-297650208068 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:01.768238 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-b132586a-a669-4d6a-bbfc-297650208068 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:01.793058 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b132586a-a669-4d6a-bbfc-297650208068 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:01.794693 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b132586a-a669-4d6a-bbfc-297650208068 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:01.796695 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b132586a-a669-4d6a-bbfc-297650208068 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:01.799111 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b132586a-a669-4d6a-bbfc-297650208068 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:01.800840 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b132586a-a669-4d6a-bbfc-297650208068 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:01.801727 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b132586a-a669-4d6a-bbfc-297650208068 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:03.388258 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cc8c8f58-1332-4852-88a5-15d97c21ec74 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 2.209610 Oct 12 13:26:03.389378 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 508/1084] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 12 13:26:01 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 2211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:03.395029 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-dba02b78-14bd-41c7-9f0b-11d26113f032 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:03.396000 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-dba02b78-14bd-41c7-9f0b-11d26113f032 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2e5ecdb4-eaf0-4b44-9a4c-e442345da741] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:03.418771 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dba02b78-14bd-41c7-9f0b-11d26113f032 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:03.427227 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dba02b78-14bd-41c7-9f0b-11d26113f032 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:03.429363 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dba02b78-14bd-41c7-9f0b-11d26113f032 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:03.430138 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dba02b78-14bd-41c7-9f0b-11d26113f032 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:03.430614 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dba02b78-14bd-41c7-9f0b-11d26113f032 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:03.431047 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dba02b78-14bd-41c7-9f0b-11d26113f032 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:03.714791 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-dba02b78-14bd-41c7-9f0b-11d26113f032 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:03.717537 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b132586a-a669-4d6a-bbfc-297650208068 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:03.732182 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b132586a-a669-4d6a-bbfc-297650208068 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d" status: 200 len: 1317 microversion: 2.1 time: 1.970317 Oct 12 13:26:03.733134 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-dba02b78-14bd-41c7-9f0b-11d26113f032 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741" status: 200 len: 1266 microversion: 2.1 time: 0.342297 Oct 12 13:26:03.733745 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 509/1085] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:03 2022] GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741 => generated 1266 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:03.751945 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-dcb70ae0-ef6b-4363-bcd9-bf3b80919edd tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9ba13430>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:03.752526 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 577/1086] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:01 2022] GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d => generated 1317 bytes in 1992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:03.774051 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d25f1dbd-6858-4fb0-80e0-269a10956717 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Calling method '.version_select at 0x7f8aa01d6700>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:03.918585 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-dcb70ae0-ef6b-4363-bcd9-bf3b80919edd tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.174471 Oct 12 13:26:03.919763 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 510/1087] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:26:03 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:04.768681 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-01e98a56-ee03-4813-921e-9d86bd64a344 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:04.779021 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-01e98a56-ee03-4813-921e-9d86bd64a344 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2e5ecdb4-eaf0-4b44-9a4c-e442345da741] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:04.790400 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-01e98a56-ee03-4813-921e-9d86bd64a344 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:04.799149 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-01e98a56-ee03-4813-921e-9d86bd64a344 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:04.799992 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-01e98a56-ee03-4813-921e-9d86bd64a344 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:04.800971 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-01e98a56-ee03-4813-921e-9d86bd64a344 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:04.801702 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-01e98a56-ee03-4813-921e-9d86bd64a344 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:04.802429 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-01e98a56-ee03-4813-921e-9d86bd64a344 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:05.292635 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-01e98a56-ee03-4813-921e-9d86bd64a344 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:05.298929 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:26:05.306417 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-01e98a56-ee03-4813-921e-9d86bd64a344 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741" status: 200 len: 1284 microversion: 2.1 time: 0.553246 Oct 12 13:26:05.324317 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 511/1088] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:04 2022] GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741 => generated 1284 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:05.565470 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-32885175-c855-466c-9c70-f69007138d70 tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:05.573791 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-32885175-c855-466c-9c70-f69007138d70 tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.247534 Oct 12 13:26:05.583687 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 512/1089] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:26:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:05.588970 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-df4747d4-3223-461b-88d3-fb10f826b5f8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:05.589597 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-df4747d4-3223-461b-88d3-fb10f826b5f8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:05.626953 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-df4747d4-3223-461b-88d3-fb10f826b5f8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:05.627455 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-df4747d4-3223-461b-88d3-fb10f826b5f8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:05.627896 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-df4747d4-3223-461b-88d3-fb10f826b5f8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:05.628607 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-df4747d4-3223-461b-88d3-fb10f826b5f8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:05.635129 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-df4747d4-3223-461b-88d3-fb10f826b5f8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:05.635879 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-df4747d4-3223-461b-88d3-fb10f826b5f8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:06.322956 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d25f1dbd-6858-4fb0-80e0-269a10956717 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/9d6d1949-9d67-49e0-b14f-17f75af8d3d7" status: 202 len: 0 microversion: 2.1 time: 2.569243 Oct 12 13:26:06.324606 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 578/1090] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:26:03 2022] DELETE /compute/v2.1/os-security-groups/9d6d1949-9d67-49e0-b14f-17f75af8d3d7 => generated 0 bytes in 2572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:26:06.330757 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c40429f0-914c-45a9-bc67-d4378e643163 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa01d65e0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:06.412299 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c40429f0-914c-45a9-bc67-d4378e643163 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.086215 Oct 12 13:26:06.422060 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 579/1091] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:26:06 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:06.430885 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d4eda197-d86d-4ff8-bcba-4130251a1f59 tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:06.495553 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d4eda197-d86d-4ff8-bcba-4130251a1f59 tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] 10.222.0.52 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.055194 Oct 12 13:26:06.495553 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 580/1092] 10.222.0.52 () {58 vars in 1125 bytes} [Wed Oct 12 13:26:06 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:06.533199 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-731df824-0232-43f7-870c-8bf4b1e97279 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Calling method '.version_select at 0x7f8aa0321670>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:07.022233 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-df4747d4-3223-461b-88d3-fb10f826b5f8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:07.035112 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-df4747d4-3223-461b-88d3-fb10f826b5f8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d" status: 200 len: 1317 microversion: 2.1 time: 1.450249 Oct 12 13:26:07.038166 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 513/1093] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:05 2022] GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d => generated 1317 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:07.051013 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fbb11ee6-ddee-4021-bf6f-83c27dcba5ae tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:07.055759 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fbb11ee6-ddee-4021-bf6f-83c27dcba5ae tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2e5ecdb4-eaf0-4b44-9a4c-e442345da741] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:07.071770 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fbb11ee6-ddee-4021-bf6f-83c27dcba5ae tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:07.072273 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fbb11ee6-ddee-4021-bf6f-83c27dcba5ae tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:07.072712 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fbb11ee6-ddee-4021-bf6f-83c27dcba5ae tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:07.075138 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fbb11ee6-ddee-4021-bf6f-83c27dcba5ae tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:07.075605 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fbb11ee6-ddee-4021-bf6f-83c27dcba5ae tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:07.076038 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fbb11ee6-ddee-4021-bf6f-83c27dcba5ae tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:07.138112 n-d-861076-2 devstack@n-api.service[120933]: DEBUG neutronclient.v2_0.client [None req-731df824-0232-43f7-870c-8bf4b1e97279 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9d6d1949-9d67-49e0-b14f-17f75af8d3d7 does not exist", "detail": ""}} {{(pid=120933) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 13:26:07.138112 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.security_group_api [None req-731df824-0232-43f7-870c-8bf4b1e97279 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Neutron security group 9d6d1949-9d67-49e0-b14f-17f75af8d3d7 not found {{(pid=120933) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 13:26:07.138112 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-731df824-0232-43f7-870c-8bf4b1e97279 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] HTTP exception thrown: Security group 9d6d1949-9d67-49e0-b14f-17f75af8d3d7 does not exist Oct 12 13:26:07.138112 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-cbdb67c3-51bb-4c2f-838b-a0a34a39cc8b'] Oct 12 13:26:07.138112 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-731df824-0232-43f7-870c-8bf4b1e97279 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Request method failure captured: Oct 12 13:26:07.138112 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-security-groups/9d6d1949-9d67-49e0-b14f-17f75af8d3d7 HTTP/1.1 Oct 12 13:26:07.138112 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:26:07.138112 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:26:07.138112 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:26:07.138112 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:26:07.138112 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:26:07.138112 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:26:07.138112 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:26:07.138112 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:26:07.139239 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsBdL7wyincMMZQwWVO4VXZ12yGjskbZB6RbMosVFiO3AhWsk3p3j49O8SLUIedaHGcczd4m4MpzaMoMcOa6aCWbbQi-5ZIc3ZUEa1lJskMXmN8Nc0ijYn_Q7UvKQVQkq2YKbmWhYhuHg_-gF1WghqCfIW01OCPDumgGkHJGO6VVHFs Oct 12 13:26:07.139239 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:26:07.139239 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:26:07.139239 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:26:07.139239 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:26:07.139239 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:26:07.139239 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:26:07.139239 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 3399cf92fd65427b8652320be1e501ad Oct 12 13:26:07.139239 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:07.139239 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:26:07.139239 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:26:07.139239 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3399cf92fd65427b8652320be1e501ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3399cf92fd65427b8652320be1e501ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3399cf92fd65427b8652320be1e501ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3399cf92fd65427b8652320be1e501ad"}]}] Oct 12 13:26:07.139239 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:07.139239 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 3399cf92fd65427b8652320be1e501ad Oct 12 13:26:07.139239 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:07.140356 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-SecurityGroupsTestJSON-1263036119-project Oct 12 13:26:07.140356 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:26:07.140356 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:26:07.140356 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 21315dd58bd4461bb41c70ccdfd27d47 Oct 12 13:26:07.140356 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-SecurityGroupsTestJSON-1263036119-project Oct 12 13:26:07.140356 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:26:07.140356 n-d-861076-2 devstack@n-api.service[120933]: exception: Security group 9d6d1949-9d67-49e0-b14f-17f75af8d3d7 does not exist Oct 12 13:26:07.140356 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-cbdb67c3-51bb-4c2f-838b-a0a34a39cc8b'] Oct 12 13:26:07.140356 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '9d6d1949-9d67-49e0-b14f-17f75af8d3d7'} Oct 12 13:26:07.140356 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:26:07.140356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:07.140356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 13:26:07.140356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 13:26:07.140356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:07.140356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:07.140356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 13:26:07.140356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 13:26:07.140356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:07.140356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:07.140356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:07.140356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:07.140356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:07.140356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:07.142089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:07.142089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:07.142089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:07.142089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:07.142089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 13:26:07.142089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 13:26:07.142089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:07.142089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:07.142089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 13:26:07.142089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 13:26:07.142089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 13:26:07.142089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 13:26:07.142089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9d6d1949-9d67-49e0-b14f-17f75af8d3d7 does not exist Oct 12 13:26:07.142089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cbdb67c3-51bb-4c2f-838b-a0a34a39cc8b'] Oct 12 13:26:07.142089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:07.142089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:07.142089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:07.142089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:07.142089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 12 13:26:07.143584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 13:26:07.143584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 13:26:07.143584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 13:26:07.143584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9d6d1949-9d67-49e0-b14f-17f75af8d3d7 does not exist Oct 12 13:26:07.143584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cbdb67c3-51bb-4c2f-838b-a0a34a39cc8b'] Oct 12 13:26:07.143584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:07.143584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:07.143584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:07.143584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:07.143584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:07.143584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:07.143584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:26:07.143584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:26:07.143584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:26:07.143584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:26:07.143584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:07.143584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:07.143584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 12 13:26:07.143584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 13:26:07.145844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9d6d1949-9d67-49e0-b14f-17f75af8d3d7 does not exist Oct 12 13:26:07.145844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cbdb67c3-51bb-4c2f-838b-a0a34a39cc8b'] Oct 12 13:26:07.145844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:07.145844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:07.145844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:07.145844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:07.145844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:07.145844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:07.145844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:26:07.145844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:26:07.145844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9d6d1949-9d67-49e0-b14f-17f75af8d3d7 does not exist Oct 12 13:26:07.145844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cbdb67c3-51bb-4c2f-838b-a0a34a39cc8b'] Oct 12 13:26:07.145844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:07.145844 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-731df824-0232-43f7-870c-8bf4b1e97279 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Returning 404 to user: Security group 9d6d1949-9d67-49e0-b14f-17f75af8d3d7 does not exist Oct 12 13:26:07.145844 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-cbdb67c3-51bb-4c2f-838b-a0a34a39cc8b'] {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:26:07.147774 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-731df824-0232-43f7-870c-8bf4b1e97279 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/9d6d1949-9d67-49e0-b14f-17f75af8d3d7" status: 404 len: 194 microversion: 2.1 time: 0.630484 Oct 12 13:26:07.147774 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 581/1094] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 12 13:26:06 2022] GET /compute/v2.1/os-security-groups/9d6d1949-9d67-49e0-b14f-17f75af8d3d7 => generated 194 bytes in 648 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:26:07.147774 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d8a910f1-837a-463e-9595-0b0733b7093a tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:07.155377 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d8a910f1-837a-463e-9595-0b0733b7093a tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017124 Oct 12 13:26:07.155964 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 582/1095] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:26:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:07.181981 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-41fda05c-47fc-489a-bc41-fe3b5d764c1f tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Calling method '.version_select at 0x7f8a9bf568b0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:07.287814 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-fbb11ee6-ddee-4021-bf6f-83c27dcba5ae tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:07.305940 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fbb11ee6-ddee-4021-bf6f-83c27dcba5ae tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741" status: 200 len: 1272 microversion: 2.1 time: 0.260312 Oct 12 13:26:07.328615 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 514/1096] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:07 2022] GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741 => generated 1272 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:07.376872 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-dc50c99b-5ee5-4911-abe5-6f448c79258a tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:07.426012 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-dc50c99b-5ee5-4911-abe5-6f448c79258a tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.092605 Oct 12 13:26:07.430549 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 515/1097] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:26:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:07.452476 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9b453f23-c813-4780-9e0e-618d021a1381 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9b9f9dc0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:07.588397 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9b453f23-c813-4780-9e0e-618d021a1381 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.147367 Oct 12 13:26:07.596812 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 516/1098] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:26:07 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:07.616777 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6d39a443-f5e5-4dd2-a672-39858567e1be tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:07.698425 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6d39a443-f5e5-4dd2-a672-39858567e1be tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.099611 Oct 12 13:26:07.719013 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 517/1099] 10.222.0.52 () {58 vars in 1165 bytes} [Wed Oct 12 13:26:07 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:07.727215 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c974d9cc-2a67-4408-99d0-c096aaa98be6 tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:07.740217 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c974d9cc-2a67-4408-99d0-c096aaa98be6 tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021286 Oct 12 13:26:07.745206 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 518/1100] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:26:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:26:07.768710 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c97e2b96-54cd-4ac1-98cb-a18f5dd3a7ad tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:07.820723 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c97e2b96-54cd-4ac1-98cb-a18f5dd3a7ad tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.067451 Oct 12 13:26:07.825261 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 519/1101] 10.222.0.52 () {58 vars in 1169 bytes} [Wed Oct 12 13:26:07 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:07.838401 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e450d65d-8e92-459b-aaf5-63bac97bd334 tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:07.879407 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e450d65d-8e92-459b-aaf5-63bac97bd334 tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.044774 Oct 12 13:26:07.881643 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 520/1102] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 12 13:26:07 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:07.908340 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-68adaece-0373-4208-9aef-17fe9bb30f8d tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:07.932590 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-68adaece-0373-4208-9aef-17fe9bb30f8d tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031271 Oct 12 13:26:07.934483 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 521/1103] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:26:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:07.947721 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9c405c04-4b50-4c8e-b721-ef778b744e89 tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:08.001441 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:26:08.048887 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9c405c04-4b50-4c8e-b721-ef778b744e89 tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.104096 Oct 12 13:26:08.050105 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 522/1104] 10.222.0.52 () {58 vars in 1167 bytes} [Wed Oct 12 13:26:07 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:08.070401 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7961776a-0467-4c35-9b92-2ff37a821f34 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:08.071630 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7961776a-0467-4c35-9b92-2ff37a821f34 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:08.087753 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7961776a-0467-4c35-9b92-2ff37a821f34 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:08.088660 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7961776a-0467-4c35-9b92-2ff37a821f34 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:08.091985 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7961776a-0467-4c35-9b92-2ff37a821f34 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:08.093155 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7961776a-0467-4c35-9b92-2ff37a821f34 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:08.094812 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7961776a-0467-4c35-9b92-2ff37a821f34 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:08.096354 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7961776a-0467-4c35-9b92-2ff37a821f34 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:08.177865 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-41fda05c-47fc-489a-bc41-fe3b5d764c1f tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/cb6601ae-389a-4077-aa94-e24f671cb79a" status: 202 len: 0 microversion: 2.1 time: 1.007398 Oct 12 13:26:08.178855 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 583/1105] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:26:07 2022] DELETE /compute/v2.1/os-security-groups/cb6601ae-389a-4077-aa94-e24f671cb79a => generated 0 bytes in 1011 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:26:08.183952 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b09e20b2-bf41-490f-895a-398ec634bb1b tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:08.195450 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b09e20b2-bf41-490f-895a-398ec634bb1b tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015443 Oct 12 13:26:08.203120 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 584/1106] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:26:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:08.216617 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a608460d-a21a-4cf6-98cb-4eb98aef7894 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Calling method '.version_select at 0x7f8aa03f39d0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:08.486280 n-d-861076-2 devstack@n-api.service[120933]: DEBUG neutronclient.v2_0.client [None req-a608460d-a21a-4cf6-98cb-4eb98aef7894 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cb6601ae-389a-4077-aa94-e24f671cb79a does not exist", "detail": ""}} {{(pid=120933) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 13:26:08.487001 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.security_group_api [None req-a608460d-a21a-4cf6-98cb-4eb98aef7894 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Neutron security group cb6601ae-389a-4077-aa94-e24f671cb79a not found {{(pid=120933) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 13:26:08.487628 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-a608460d-a21a-4cf6-98cb-4eb98aef7894 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] HTTP exception thrown: Security group cb6601ae-389a-4077-aa94-e24f671cb79a does not exist Oct 12 13:26:08.487628 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-62b0ade7-5ccd-4979-89c7-c3a9ecdd6fa5'] Oct 12 13:26:08.490619 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a608460d-a21a-4cf6-98cb-4eb98aef7894 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Request method failure captured: Oct 12 13:26:08.490619 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-security-groups/cb6601ae-389a-4077-aa94-e24f671cb79a HTTP/1.1 Oct 12 13:26:08.490619 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:26:08.490619 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:26:08.490619 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:26:08.490619 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:26:08.490619 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:26:08.490619 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:26:08.490619 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:26:08.490619 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:26:08.490619 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsBdL7wyincMMZQwWVO4VXZ12yGjskbZB6RbMosVFiO3AhWsk3p3j49O8SLUIedaHGcczd4m4MpzaMoMcOa6aCWbbQi-5ZIc3ZUEa1lJskMXmN8Nc0ijYn_Q7UvKQVQkq2YKbmWhYhuHg_-gF1WghqCfIW01OCPDumgGkHJGO6VVHFs Oct 12 13:26:08.490619 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:26:08.490619 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:26:08.490619 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:26:08.490619 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:26:08.490619 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:26:08.490619 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:26:08.490619 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 3399cf92fd65427b8652320be1e501ad Oct 12 13:26:08.490619 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:08.490619 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:26:08.490619 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:26:08.492293 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3399cf92fd65427b8652320be1e501ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3399cf92fd65427b8652320be1e501ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3399cf92fd65427b8652320be1e501ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3399cf92fd65427b8652320be1e501ad"}]}] Oct 12 13:26:08.492293 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:08.492293 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 3399cf92fd65427b8652320be1e501ad Oct 12 13:26:08.492293 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:08.492293 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-SecurityGroupsTestJSON-1263036119-project Oct 12 13:26:08.492293 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:26:08.492293 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:26:08.492293 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 21315dd58bd4461bb41c70ccdfd27d47 Oct 12 13:26:08.492293 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-SecurityGroupsTestJSON-1263036119-project Oct 12 13:26:08.492293 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:26:08.492293 n-d-861076-2 devstack@n-api.service[120933]: exception: Security group cb6601ae-389a-4077-aa94-e24f671cb79a does not exist Oct 12 13:26:08.492293 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-62b0ade7-5ccd-4979-89c7-c3a9ecdd6fa5'] Oct 12 13:26:08.492293 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'cb6601ae-389a-4077-aa94-e24f671cb79a'} Oct 12 13:26:08.493304 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:26:08.493304 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:08.493304 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 13:26:08.493304 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 13:26:08.493304 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:08.493304 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:08.493304 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 13:26:08.493304 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 13:26:08.493304 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:08.493304 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:08.493304 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:08.493304 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:08.493304 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:08.493304 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:08.493304 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:08.493304 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:08.493304 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:08.493304 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:08.493304 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 13:26:08.496343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 13:26:08.496343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:08.496343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:08.496343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 13:26:08.496343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 13:26:08.496343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 13:26:08.496343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 13:26:08.496343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cb6601ae-389a-4077-aa94-e24f671cb79a does not exist Oct 12 13:26:08.496343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62b0ade7-5ccd-4979-89c7-c3a9ecdd6fa5'] Oct 12 13:26:08.496343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:08.496343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:08.496343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:08.496343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:08.496343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 12 13:26:08.496343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 13:26:08.496343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 13:26:08.496343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 13:26:08.496343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cb6601ae-389a-4077-aa94-e24f671cb79a does not exist Oct 12 13:26:08.497730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62b0ade7-5ccd-4979-89c7-c3a9ecdd6fa5'] Oct 12 13:26:08.497730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:08.497730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:08.497730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:08.497730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:08.497730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:08.497730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:08.497730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:26:08.497730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:26:08.497730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:26:08.497730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:26:08.497730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:08.497730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:08.497730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 12 13:26:08.497730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 13:26:08.497730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cb6601ae-389a-4077-aa94-e24f671cb79a does not exist Oct 12 13:26:08.497730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62b0ade7-5ccd-4979-89c7-c3a9ecdd6fa5'] Oct 12 13:26:08.497730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:08.497730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:08.497730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:08.497730 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:08.499706 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:08.499706 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:08.499706 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:26:08.499706 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:26:08.499706 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cb6601ae-389a-4077-aa94-e24f671cb79a does not exist Oct 12 13:26:08.499706 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62b0ade7-5ccd-4979-89c7-c3a9ecdd6fa5'] Oct 12 13:26:08.499706 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:08.499706 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a608460d-a21a-4cf6-98cb-4eb98aef7894 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Returning 404 to user: Security group cb6601ae-389a-4077-aa94-e24f671cb79a does not exist Oct 12 13:26:08.499706 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-62b0ade7-5ccd-4979-89c7-c3a9ecdd6fa5'] {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:26:08.499706 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a608460d-a21a-4cf6-98cb-4eb98aef7894 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/cb6601ae-389a-4077-aa94-e24f671cb79a" status: 404 len: 194 microversion: 2.1 time: 0.290004 Oct 12 13:26:08.499706 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 585/1107] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 12 13:26:08 2022] GET /compute/v2.1/os-security-groups/cb6601ae-389a-4077-aa94-e24f671cb79a => generated 194 bytes in 295 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:26:08.505838 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0f9d6039-260c-428b-958f-c52e9f79052e tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:08.532688 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0f9d6039-260c-428b-958f-c52e9f79052e tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] 10.222.0.52 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.032677 Oct 12 13:26:08.533431 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 586/1108] 10.222.0.52 () {58 vars in 1144 bytes} [Wed Oct 12 13:26:08 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:08.538786 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ac98a45a-bd8b-4968-83c9-e38a5e51c7d2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:08.539652 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-ac98a45a-bd8b-4968-83c9-e38a5e51c7d2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2e5ecdb4-eaf0-4b44-9a4c-e442345da741] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:08.546361 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ac98a45a-bd8b-4968-83c9-e38a5e51c7d2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:08.547170 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ac98a45a-bd8b-4968-83c9-e38a5e51c7d2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:08.548093 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ac98a45a-bd8b-4968-83c9-e38a5e51c7d2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:08.548884 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ac98a45a-bd8b-4968-83c9-e38a5e51c7d2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:08.549545 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ac98a45a-bd8b-4968-83c9-e38a5e51c7d2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:08.550034 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ac98a45a-bd8b-4968-83c9-e38a5e51c7d2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:08.681561 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-ac98a45a-bd8b-4968-83c9-e38a5e51c7d2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:08.689753 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:26:08.692708 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ac98a45a-bd8b-4968-83c9-e38a5e51c7d2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741" status: 200 len: 1272 microversion: 2.1 time: 0.158053 Oct 12 13:26:08.693688 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 587/1109] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:08 2022] GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741 => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:08.707018 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-90e931ef-c207-47f3-8d0d-c746a8de33e0 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Calling method '.version_select at 0x7f8a9bd01310>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:08.958687 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-7961776a-0467-4c35-9b92-2ff37a821f34 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:08.973319 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7961776a-0467-4c35-9b92-2ff37a821f34 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d" status: 200 len: 1317 microversion: 2.1 time: 0.912122 Oct 12 13:26:08.992062 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 523/1110] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:08 2022] GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d => generated 1317 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:09.002837 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1d63d9e3-d34b-4141-a8c2-922fcaf82a4a tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:09.017290 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1d63d9e3-d34b-4141-a8c2-922fcaf82a4a tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021940 Oct 12 13:26:09.018472 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 524/1111] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:26:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:09.035091 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4ffbc57b-98d4-45f2-b44a-14a38cb89a28 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9ba05a60>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:09.153534 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4ffbc57b-98d4-45f2-b44a-14a38cb89a28 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.131580 Oct 12 13:26:09.156156 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 525/1112] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:26:09 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:09.161395 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d3aa637d-b000-4a05-821a-dd8f5db7300b tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:09.203266 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=6 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:26:09.211553 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d3aa637d-b000-4a05-821a-dd8f5db7300b tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] 10.222.0.52 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.054028 Oct 12 13:26:09.225406 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 526/1113] 10.222.0.52 () {58 vars in 1148 bytes} [Wed Oct 12 13:26:09 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:09.235193 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c0248bd0-31cf-40da-8ab4-7cfe4437eb4b tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:09.267467 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c0248bd0-31cf-40da-8ab4-7cfe4437eb4b tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] 10.222.0.52 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.040881 Oct 12 13:26:09.280385 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 527/1114] 10.222.0.52 () {58 vars in 1140 bytes} [Wed Oct 12 13:26:09 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:09.293163 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f00b4300-57c8-4698-bae8-e3b7e4afe251 tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:09.327049 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f00b4300-57c8-4698-bae8-e3b7e4afe251 tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.044641 Oct 12 13:26:09.327926 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 528/1115] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:26:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:09.334453 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-86c7a801-3100-4b06-895c-1ebf69e80b42 req-808c48c2-f656-4d1f-a05f-70c3049539c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e37b5b43-6124-4cd8-bdba-1c489326db1d", "name": "network-vif-plugged", "status": "completed", "tag": "0b9eae89-c32d-4a0b-9567-be443a4f3d00"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:09.348561 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-86c7a801-3100-4b06-895c-1ebf69e80b42 req-808c48c2-f656-4d1f-a05f-70c3049539c7 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:09.349245 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-86c7a801-3100-4b06-895c-1ebf69e80b42 req-808c48c2-f656-4d1f-a05f-70c3049539c7 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:09.349907 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-86c7a801-3100-4b06-895c-1ebf69e80b42 req-808c48c2-f656-4d1f-a05f-70c3049539c7 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:09.374694 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-86c7a801-3100-4b06-895c-1ebf69e80b42 req-808c48c2-f656-4d1f-a05f-70c3049539c7 service nova] Creating event network-vif-plugged:0b9eae89-c32d-4a0b-9567-be443a4f3d00 for instance e37b5b43-6124-4cd8-bdba-1c489326db1d on n-h2-861076-2 Oct 12 13:26:09.383028 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-86c7a801-3100-4b06-895c-1ebf69e80b42 req-808c48c2-f656-4d1f-a05f-70c3049539c7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052359 Oct 12 13:26:09.384233 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 529/1116] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:09.390502 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1fd3277d-d96b-4207-bbfc-4de502d1578d tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:09.435156 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1fd3277d-d96b-4207-bbfc-4de502d1578d tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] 10.222.0.52 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.048858 Oct 12 13:26:09.436404 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 530/1117] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:26:09 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:09.476449 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-32410bf9-01ef-4f7b-aaf0-9b44cdefe6cb tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:09.561946 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-32410bf9-01ef-4f7b-aaf0-9b44cdefe6cb tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.115393 Oct 12 13:26:09.566718 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 531/1118] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:26:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:26:09.589301 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-67500010-510d-4d09-ac2a-aeeccb8f9eab tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:09.604997 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-67500010-510d-4d09-ac2a-aeeccb8f9eab tempest-FlavorsV2TestJSON-1095406221 tempest-FlavorsV2TestJSON-1095406221-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020131 Oct 12 13:26:09.611098 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 532/1119] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:26:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:26:09.718742 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f0f65144-1f29-41d0-8091-e3e998439ae7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:09.725169 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f0f65144-1f29-41d0-8091-e3e998439ae7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2e5ecdb4-eaf0-4b44-9a4c-e442345da741] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:09.735065 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0f65144-1f29-41d0-8091-e3e998439ae7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:09.736556 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0f65144-1f29-41d0-8091-e3e998439ae7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:09.737192 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0f65144-1f29-41d0-8091-e3e998439ae7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:09.738655 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0f65144-1f29-41d0-8091-e3e998439ae7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:09.748054 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0f65144-1f29-41d0-8091-e3e998439ae7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:09.748815 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0f65144-1f29-41d0-8091-e3e998439ae7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:10.099586 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f0f65144-1f29-41d0-8091-e3e998439ae7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:10.108750 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f0f65144-1f29-41d0-8091-e3e998439ae7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741" status: 200 len: 1272 microversion: 2.1 time: 0.395576 Oct 12 13:26:10.109375 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 533/1120] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:09 2022] GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741 => generated 1272 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:26:10.127825 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9bed9f08-6158-4ee9-bdae-f3a9ad77a3a2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:10.128466 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9bed9f08-6158-4ee9-bdae-f3a9ad77a3a2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:10.146978 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9bed9f08-6158-4ee9-bdae-f3a9ad77a3a2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:10.147453 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9bed9f08-6158-4ee9-bdae-f3a9ad77a3a2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:10.147900 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9bed9f08-6158-4ee9-bdae-f3a9ad77a3a2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:10.148626 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9bed9f08-6158-4ee9-bdae-f3a9ad77a3a2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:10.150789 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9bed9f08-6158-4ee9-bdae-f3a9ad77a3a2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:10.151256 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9bed9f08-6158-4ee9-bdae-f3a9ad77a3a2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:10.932180 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-9bed9f08-6158-4ee9-bdae-f3a9ad77a3a2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:10.945381 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9bed9f08-6158-4ee9-bdae-f3a9ad77a3a2 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d" status: 200 len: 1317 microversion: 2.1 time: 0.825984 Oct 12 13:26:10.946305 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 534/1121] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:10 2022] GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d => generated 1317 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:10.965558 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-eeecdff4-c9e9-44c2-926e-20a67573433e tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9b9bc160>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:10.993607 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=26 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:26:11.097391 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-eeecdff4-c9e9-44c2-926e-20a67573433e tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.146777 Oct 12 13:26:11.099685 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 535/1122] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:26:10 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:11.133812 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6acc8052-1420-4cce-9001-fa218b123633 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:11.134913 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6acc8052-1420-4cce-9001-fa218b123633 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2e5ecdb4-eaf0-4b44-9a4c-e442345da741] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:11.150381 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6acc8052-1420-4cce-9001-fa218b123633 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:11.152468 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6acc8052-1420-4cce-9001-fa218b123633 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:11.153599 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6acc8052-1420-4cce-9001-fa218b123633 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:11.155854 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6acc8052-1420-4cce-9001-fa218b123633 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:11.159590 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6acc8052-1420-4cce-9001-fa218b123633 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:11.160328 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6acc8052-1420-4cce-9001-fa218b123633 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:12.338305 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-90e931ef-c207-47f3-8d0d-c746a8de33e0 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725" status: 202 len: 0 microversion: 2.1 time: 3.635391 Oct 12 13:26:12.339934 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 588/1123] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:26:08 2022] DELETE /compute/v2.1/os-security-groups/c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725 => generated 0 bytes in 3638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:26:12.345473 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-784f8e18-05db-404c-a213-27867ed5c2a5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:12.346404 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-784f8e18-05db-404c-a213-27867ed5c2a5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:12.370976 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-784f8e18-05db-404c-a213-27867ed5c2a5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:12.371812 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-784f8e18-05db-404c-a213-27867ed5c2a5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:12.372376 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-784f8e18-05db-404c-a213-27867ed5c2a5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:12.373243 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-784f8e18-05db-404c-a213-27867ed5c2a5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:12.373835 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-784f8e18-05db-404c-a213-27867ed5c2a5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:12.378571 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-784f8e18-05db-404c-a213-27867ed5c2a5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:13.062012 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-6acc8052-1420-4cce-9001-fa218b123633 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:13.071519 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6acc8052-1420-4cce-9001-fa218b123633 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741" status: 200 len: 1314 microversion: 2.1 time: 1.943472 Oct 12 13:26:13.076275 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 536/1124] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:11 2022] GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741 => generated 1314 bytes in 1949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:26:13.093588 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1eef64c5-643d-4430-95d3-8d5d6348e91f tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9b9b63a0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:13.181593 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1eef64c5-643d-4430-95d3-8d5d6348e91f tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.096067 Oct 12 13:26:13.183761 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 537/1125] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:26:13 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:13.199210 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-486e1c74-4ca3-4449-a3d0-d64641076daf tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Calling method '.version_select at 0x7f8a9b9f9ee0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:13.500603 n-d-861076-2 devstack@n-api.service[120932]: DEBUG neutronclient.v2_0.client [None req-486e1c74-4ca3-4449-a3d0-d64641076daf tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725 does not exist", "detail": ""}} {{(pid=120932) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 13:26:13.501555 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.security_group_api [None req-486e1c74-4ca3-4449-a3d0-d64641076daf tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Neutron security group c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725 not found {{(pid=120932) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 13:26:13.502298 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-486e1c74-4ca3-4449-a3d0-d64641076daf tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] HTTP exception thrown: Security group c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725 does not exist Oct 12 13:26:13.502298 n-d-861076-2 devstack@n-api.service[120932]: Neutron server returns request_ids: ['req-a8e199e4-2c2b-4745-9848-c9c7a1bb604e'] Oct 12 13:26:13.504547 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-486e1c74-4ca3-4449-a3d0-d64641076daf tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Request method failure captured: Oct 12 13:26:13.504547 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/os-security-groups/c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725 HTTP/1.1 Oct 12 13:26:13.504547 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:26:13.504547 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:26:13.504547 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:26:13.504547 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:26:13.504547 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:26:13.504547 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:26:13.504547 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:26:13.504547 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:26:13.504547 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsBdL7wyincMMZQwWVO4VXZ12yGjskbZB6RbMosVFiO3AhWsk3p3j49O8SLUIedaHGcczd4m4MpzaMoMcOa6aCWbbQi-5ZIc3ZUEa1lJskMXmN8Nc0ijYn_Q7UvKQVQkq2YKbmWhYhuHg_-gF1WghqCfIW01OCPDumgGkHJGO6VVHFs Oct 12 13:26:13.504547 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:26:13.504547 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:26:13.504547 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:26:13.504547 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:26:13.504547 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:26:13.504547 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:26:13.504547 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 3399cf92fd65427b8652320be1e501ad Oct 12 13:26:13.504547 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:13.504547 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:26:13.504547 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:26:13.506909 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3399cf92fd65427b8652320be1e501ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3399cf92fd65427b8652320be1e501ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3399cf92fd65427b8652320be1e501ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3399cf92fd65427b8652320be1e501ad"}]}] Oct 12 13:26:13.506909 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:13.506909 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 3399cf92fd65427b8652320be1e501ad Oct 12 13:26:13.506909 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:13.506909 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-SecurityGroupsTestJSON-1263036119-project Oct 12 13:26:13.506909 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:26:13.506909 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:26:13.506909 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 21315dd58bd4461bb41c70ccdfd27d47 Oct 12 13:26:13.506909 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-SecurityGroupsTestJSON-1263036119-project Oct 12 13:26:13.506909 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:26:13.506909 n-d-861076-2 devstack@n-api.service[120932]: exception: Security group c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725 does not exist Oct 12 13:26:13.506909 n-d-861076-2 devstack@n-api.service[120932]: Neutron server returns request_ids: ['req-a8e199e4-2c2b-4745-9848-c9c7a1bb604e'] Oct 12 13:26:13.506909 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725'} Oct 12 13:26:13.507899 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:26:13.507899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:13.507899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 13:26:13.507899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 13:26:13.507899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:13.507899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:13.507899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 13:26:13.507899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 13:26:13.507899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:13.507899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:13.507899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:13.507899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:13.507899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:13.507899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:13.507899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:13.507899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:13.507899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:13.507899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:13.507899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 13:26:13.509575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 13:26:13.509575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:13.509575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:13.509575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 13:26:13.509575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 13:26:13.509575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 13:26:13.509575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 13:26:13.509575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725 does not exist Oct 12 13:26:13.509575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8e199e4-2c2b-4745-9848-c9c7a1bb604e'] Oct 12 13:26:13.509575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:13.509575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:13.509575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:13.509575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:13.509575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 12 13:26:13.509575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 13:26:13.509575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 13:26:13.509575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 13:26:13.509575 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725 does not exist Oct 12 13:26:13.511773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8e199e4-2c2b-4745-9848-c9c7a1bb604e'] Oct 12 13:26:13.511773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:13.511773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:13.511773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:13.511773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:13.511773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:13.511773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:13.511773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:26:13.511773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:26:13.511773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:26:13.511773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:26:13.511773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:13.511773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:13.511773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 12 13:26:13.511773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 13:26:13.511773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725 does not exist Oct 12 13:26:13.511773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8e199e4-2c2b-4745-9848-c9c7a1bb604e'] Oct 12 13:26:13.511773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:13.511773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:13.511773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:13.511773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:13.517990 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:13.517990 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:13.517990 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:26:13.517990 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:26:13.517990 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725 does not exist Oct 12 13:26:13.517990 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8e199e4-2c2b-4745-9848-c9c7a1bb604e'] Oct 12 13:26:13.517990 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:13.517990 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-486e1c74-4ca3-4449-a3d0-d64641076daf tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Returning 404 to user: Security group c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725 does not exist Oct 12 13:26:13.517990 n-d-861076-2 devstack@n-api.service[120932]: Neutron server returns request_ids: ['req-a8e199e4-2c2b-4745-9848-c9c7a1bb604e'] {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:26:13.517990 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-486e1c74-4ca3-4449-a3d0-d64641076daf tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725" status: 404 len: 194 microversion: 2.1 time: 0.331735 Oct 12 13:26:13.521226 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 538/1126] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 12 13:26:13 2022] GET /compute/v2.1/os-security-groups/c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725 => generated 194 bytes in 337 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:26:13.526427 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ca5648a0-f1e3-44ab-a691-5c1e3a7dc0df tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Calling method '.version_select at 0x7f8a9b9bcc10>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:14.060341 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-784f8e18-05db-404c-a213-27867ed5c2a5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:14.077752 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-784f8e18-05db-404c-a213-27867ed5c2a5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d" status: 200 len: 1467 microversion: 2.1 time: 1.734863 Oct 12 13:26:14.079713 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 589/1127] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:12 2022] GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d => generated 1467 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:14.104362 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1edc79ae-3a91-46b4-b218-465e23a0ec02 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:14.107160 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-1edc79ae-3a91-46b4-b218-465e23a0ec02 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:14.116382 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1edc79ae-3a91-46b4-b218-465e23a0ec02 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:14.117775 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1edc79ae-3a91-46b4-b218-465e23a0ec02 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:14.118499 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1edc79ae-3a91-46b4-b218-465e23a0ec02 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:14.119776 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1edc79ae-3a91-46b4-b218-465e23a0ec02 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:14.120511 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1edc79ae-3a91-46b4-b218-465e23a0ec02 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:14.121182 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1edc79ae-3a91-46b4-b218-465e23a0ec02 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:15.124778 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1edc79ae-3a91-46b4-b218-465e23a0ec02 tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d" status: 200 len: 1618 microversion: 2.1 time: 1.022797 Oct 12 13:26:15.126055 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 590/1128] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:14 2022] GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d => generated 1618 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:15.133769 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-12ad1a53-3391-4cc0-8afe-fe723f41ac92 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:15.134584 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-12ad1a53-3391-4cc0-8afe-fe723f41ac92 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2e5ecdb4-eaf0-4b44-9a4c-e442345da741] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:15.140347 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=69 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:26:15.150194 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-12ad1a53-3391-4cc0-8afe-fe723f41ac92 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:15.150194 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-12ad1a53-3391-4cc0-8afe-fe723f41ac92 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:15.154308 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-12ad1a53-3391-4cc0-8afe-fe723f41ac92 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:15.155866 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-12ad1a53-3391-4cc0-8afe-fe723f41ac92 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:15.158175 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-12ad1a53-3391-4cc0-8afe-fe723f41ac92 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:15.158733 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-12ad1a53-3391-4cc0-8afe-fe723f41ac92 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:15.935709 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ca5648a0-f1e3-44ab-a691-5c1e3a7dc0df tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 2.413022 Oct 12 13:26:15.936302 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 539/1129] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 12 13:26:13 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 2414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:15.941386 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a3d57269-d0e3-4035-837a-f3c286100fca tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9b9bc040>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:15.997958 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a3d57269-d0e3-4035-837a-f3c286100fca tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.060504 Oct 12 13:26:15.999127 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 540/1130] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:26:15 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:16.004765 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-3d5b88c5-e030-4c40-b38a-79205e0c97e6 req-aba8f8aa-532b-4c90-8b1c-c5ede47fbf51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fbda837-cf92-4aa6-8551-96cd4a3f1b80", "tag": "cf85a1bd-8e0c-48d6-9580-9faf6388ba80"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:16.016335 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-3d5b88c5-e030-4c40-b38a-79205e0c97e6 req-aba8f8aa-532b-4c90-8b1c-c5ede47fbf51 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:16.017107 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-3d5b88c5-e030-4c40-b38a-79205e0c97e6 req-aba8f8aa-532b-4c90-8b1c-c5ede47fbf51 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:16.017731 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-3d5b88c5-e030-4c40-b38a-79205e0c97e6 req-aba8f8aa-532b-4c90-8b1c-c5ede47fbf51 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:16.029930 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-3d5b88c5-e030-4c40-b38a-79205e0c97e6 req-aba8f8aa-532b-4c90-8b1c-c5ede47fbf51 service nova] Creating event network-changed:cf85a1bd-8e0c-48d6-9580-9faf6388ba80 for instance 3fbda837-cf92-4aa6-8551-96cd4a3f1b80 on n-h1-861076-2 Oct 12 13:26:16.035836 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-3d5b88c5-e030-4c40-b38a-79205e0c97e6 req-aba8f8aa-532b-4c90-8b1c-c5ede47fbf51 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035081 Oct 12 13:26:16.037394 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 541/1131] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:16.043880 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a391b181-8571-4324-a0d5-2805d36f6cd1 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1707415215", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "9443e943-93c1-4a5f-aad4-da32545368fa"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:16.112742 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-a391b181-8571-4324-a0d5-2805d36f6cd1 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] validate_networks() for None {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:26:16.182106 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-12ad1a53-3391-4cc0-8afe-fe723f41ac92 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:16.196400 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-12ad1a53-3391-4cc0-8afe-fe723f41ac92 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741" status: 200 len: 1314 microversion: 2.1 time: 1.069043 Oct 12 13:26:16.197478 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 591/1132] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:15 2022] GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741 => generated 1314 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:16.202259 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2e6196cd-49c0-46ad-802d-b91e60220e22 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Action: 'create', calling method: .version_select at 0x7f8a9bd015e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-171911323", "description": "tempest-description-1582815506"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:17.144854 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-a391b181-8571-4324-a0d5-2805d36f6cd1 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:26:17.145465 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-a391b181-8571-4324-a0d5-2805d36f6cd1 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:26:17.145951 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-a391b181-8571-4324-a0d5-2805d36f6cd1 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:26:17.146366 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-a391b181-8571-4324-a0d5-2805d36f6cd1 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:26:17.146830 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-a391b181-8571-4324-a0d5-2805d36f6cd1 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:26:17.180952 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a391b181-8571-4324-a0d5-2805d36f6cd1 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:17.184927 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a391b181-8571-4324-a0d5-2805d36f6cd1 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:17.185424 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a391b181-8571-4324-a0d5-2805d36f6cd1 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:17.190420 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a391b181-8571-4324-a0d5-2805d36f6cd1 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:17.288369 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a391b181-8571-4324-a0d5-2805d36f6cd1 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:17.308591 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a391b181-8571-4324-a0d5-2805d36f6cd1 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.099s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:17.591231 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-a391b181-8571-4324-a0d5-2805d36f6cd1 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for project be50900be6b246aa9289de6ec5d366f9. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:26:17.591231 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-a391b181-8571-4324-a0d5-2805d36f6cd1 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Getting quotas for user a0fd9458bb2842829a1e13ac93fade30 and project be50900be6b246aa9289de6ec5d366f9. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:26:17.591231 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a391b181-8571-4324-a0d5-2805d36f6cd1 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:26:17.591795 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a391b181-8571-4324-a0d5-2805d36f6cd1 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 04ccef15-bb8d-4f4e-ac84-20c94c040b22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:26:18.020689 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a391b181-8571-4324-a0d5-2805d36f6cd1 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.981782 Oct 12 13:26:18.021890 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 542/1133] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:26:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 13:26:18.037643 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9712c1ce-dec1-4755-86e6-c9a47684bc31 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9ba51c10>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:18.149702 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9712c1ce-dec1-4755-86e6-c9a47684bc31 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.125160 Oct 12 13:26:18.163356 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 543/1134] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:26:18 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:18.171885 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bf0bf750-74ac-4755-b54d-572785239d19 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:18.182559 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-bf0bf750-74ac-4755-b54d-572785239d19 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2e5ecdb4-eaf0-4b44-9a4c-e442345da741] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:18.190531 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf0bf750-74ac-4755-b54d-572785239d19 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:18.191293 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf0bf750-74ac-4755-b54d-572785239d19 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:18.192076 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf0bf750-74ac-4755-b54d-572785239d19 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:18.193036 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf0bf750-74ac-4755-b54d-572785239d19 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:18.193650 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf0bf750-74ac-4755-b54d-572785239d19 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:18.194691 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf0bf750-74ac-4755-b54d-572785239d19 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:18.216771 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2e6196cd-49c0-46ad-802d-b91e60220e22 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 2.018006 Oct 12 13:26:18.217523 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 592/1135] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:26:16 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 2019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:18.228935 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-81ac2ac7-f064-4529-84ef-9b8978a8b6eb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:18.230616 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-81ac2ac7-f064-4529-84ef-9b8978a8b6eb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 04ccef15-bb8d-4f4e-ac84-20c94c040b22] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:18.857772 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-81ac2ac7-f064-4529-84ef-9b8978a8b6eb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:18.868552 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-81ac2ac7-f064-4529-84ef-9b8978a8b6eb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22" status: 200 len: 1217 microversion: 2.1 time: 0.649882 Oct 12 13:26:18.871243 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 593/1136] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:18 2022] GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22 => generated 1217 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:18.885258 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-ba8ada69-4b54-4f07-a892-29c5e45e5398 req-b53a6258-4562-46e8-95b7-ed08caef883d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e5ecdb4-eaf0-4b44-9a4c-e442345da741", "tag": "695f956c-e26c-42e8-9eef-abbf05e8c6fb"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:18.913052 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-ba8ada69-4b54-4f07-a892-29c5e45e5398 req-b53a6258-4562-46e8-95b7-ed08caef883d service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:18.913052 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-ba8ada69-4b54-4f07-a892-29c5e45e5398 req-b53a6258-4562-46e8-95b7-ed08caef883d service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:18.913435 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-ba8ada69-4b54-4f07-a892-29c5e45e5398 req-b53a6258-4562-46e8-95b7-ed08caef883d service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:18.995514 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-ba8ada69-4b54-4f07-a892-29c5e45e5398 req-b53a6258-4562-46e8-95b7-ed08caef883d service nova] Creating event network-changed:695f956c-e26c-42e8-9eef-abbf05e8c6fb for instance 2e5ecdb4-eaf0-4b44-9a4c-e442345da741 on n-h1-861076-2 Oct 12 13:26:19.009665 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-ba8ada69-4b54-4f07-a892-29c5e45e5398 req-b53a6258-4562-46e8-95b7-ed08caef883d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135482 Oct 12 13:26:19.021708 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 594/1137] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:19.046390 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d5560283-39c3-4934-8688-9acad5010fb2 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Action: 'create', calling method: .version_select at 0x7f8aa03f3b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-69593625", "description": "tempest-description-463956723"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:19.683258 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-bf0bf750-74ac-4755-b54d-572785239d19 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:19.691870 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bf0bf750-74ac-4755-b54d-572785239d19 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741" status: 200 len: 1314 microversion: 2.1 time: 1.527127 Oct 12 13:26:19.694875 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 544/1138] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:18 2022] GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741 => generated 1314 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:19.991342 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-aae39d82-e0d9-4454-86b9-e74ae1fa8d3b tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-304839724", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "35f69b3e-54a3-4d3a-9bbb-6d43dd211917"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:20.124514 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-aae39d82-e0d9-4454-86b9-e74ae1fa8d3b tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] validate_networks() for [('35f69b3e-54a3-4d3a-9bbb-6d43dd211917', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:26:21.670670 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d5560283-39c3-4934-8688-9acad5010fb2 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 2.639144 Oct 12 13:26:21.670670 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 595/1139] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:26:19 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 2641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:21.670670 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b2c2c205-2c0f-4b7f-8bac-9fbea82fa32e tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bd1ce50>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:21.760759 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b2c2c205-2c0f-4b7f-8bac-9fbea82fa32e tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.096308 Oct 12 13:26:21.765306 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 596/1140] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:26:21 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:21.770193 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0133ec05-eb4c-44db-9ea3-469cf2993877 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:21.785982 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-0133ec05-eb4c-44db-9ea3-469cf2993877 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 04ccef15-bb8d-4f4e-ac84-20c94c040b22] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:21.805739 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0133ec05-eb4c-44db-9ea3-469cf2993877 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:21.823870 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0133ec05-eb4c-44db-9ea3-469cf2993877 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:21.824481 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0133ec05-eb4c-44db-9ea3-469cf2993877 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:21.826653 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0133ec05-eb4c-44db-9ea3-469cf2993877 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:21.827234 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0133ec05-eb4c-44db-9ea3-469cf2993877 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:21.828561 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0133ec05-eb4c-44db-9ea3-469cf2993877 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:22.161051 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-0133ec05-eb4c-44db-9ea3-469cf2993877 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:22.175646 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0133ec05-eb4c-44db-9ea3-469cf2993877 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22" status: 200 len: 1269 microversion: 2.1 time: 0.406317 Oct 12 13:26:22.175646 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 597/1141] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:21 2022] GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22 => generated 1269 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:22.210873 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-aae39d82-e0d9-4454-86b9-e74ae1fa8d3b tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2841717e-8961-4b0c-8c5e-aef2c2db0dbb) Oct 12 13:26:22.210873 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:22.210873 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:22.210873 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:22.210873 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:22.210873 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:22.210873 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:22.210873 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:22.210873 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:22.210873 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:22.210873 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:22.210873 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:22.210873 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:22.210873 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:22.210873 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:22.210873 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:22.212577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:22.212577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:22.212577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:22.212577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:22.212577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:22.212577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:22.212577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:22.212577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:22.212577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:22.212577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:22.212577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:22.212577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:22.212577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:22.212577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:22.212577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:22.212577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:22.212577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:22.212577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:22.213883 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:22.213883 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:22.213883 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:22.213883 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:22.213883 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:22.213883 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:22.213883 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:22.213883 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:22.213883 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:22.213883 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:22.213883 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:22.213883 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:22.213883 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:22.213883 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:22.213883 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:22.213883 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:22.213883 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:22.213883 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:22.215026 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:22.215026 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:22.215026 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:22.215026 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:22.215026 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:22.215026 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:22.215026 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:22.215026 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:22.215026 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:22.215026 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:22.215026 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:22.215026 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:22.215026 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:22.215026 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:22.215026 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2841717e-8961-4b0c-8c5e-aef2c2db0dbb) Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-aae39d82-e0d9-4454-86b9-e74ae1fa8d3b tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-aae39d82-e0d9-4454-86b9-e74ae1fa8d3b tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Request method failure captured: Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 206 Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsB69ycY6emTEF7VKNmSiWucG5hf4zJqAS0qllNTR3QOE0HbuWc3IP0qp9UjEdcrgVVND6UpCY_jIANWKl-PFnlYhqe6aUOGKrPdzQd8B12CFMVl8o8_cfbZpEo2Q-eo-Py_qD3IXZ8-S0wAjivvd-T9o669T0CfjXP2ItDPUd8LF9Y Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 9a13e12acfc242d49d32baadf18b0fe4 Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-DeleteServersTestJSON-700119419 Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:26:22.215981 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:26:22.217721 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9a13e12acfc242d49d32baadf18b0fe4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9a13e12acfc242d49d32baadf18b0fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a13e12acfc242d49d32baadf18b0fe4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a13e12acfc242d49d32baadf18b0fe4"}]}] Oct 12 13:26:22.217721 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-DeleteServersTestJSON-700119419 Oct 12 13:26:22.217721 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 9a13e12acfc242d49d32baadf18b0fe4 Oct 12 13:26:22.217721 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-DeleteServersTestJSON-700119419 Oct 12 13:26:22.217721 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-DeleteServersTestJSON-700119419-project Oct 12 13:26:22.217721 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:26:22.217721 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:26:22.217721 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 9ca6b75658f94803bd9088aa7f23d2c8 Oct 12 13:26:22.217721 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-DeleteServersTestJSON-700119419-project Oct 12 13:26:22.217721 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:26:22.217721 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-DeleteServersTestJSON-server-304839724", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "35f69b3e-54a3-4d3a-9bbb-6d43dd211917"}]}} Oct 12 13:26:22.220226 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:26:22.220226 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:22.220226 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:26:22.220226 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-304839724', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '35f69b3e-54a3-4d3a-9bbb-6d43dd211917'}]}}} Oct 12 13:26:22.220226 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:26:22.220226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:22.220226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:22.220226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:22.220226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:22.220226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:22.220226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:22.220226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:22.220226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:22.220226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:22.220226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:22.220226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:22.220226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:22.220226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:22.220226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:22.226077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:22.226077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:22.226077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:22.226077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:22.226077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:22.226077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:22.226077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:22.226077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:22.226077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:22.226077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:22.226077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:22.226077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:22.226077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:22.226077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:22.226077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:22.226077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:22.226077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:22.226077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:22.227378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:22.227378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:22.227378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:22.227378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:22.227378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:22.227378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:22.227378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:22.227378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:22.227378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:22.227378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:22.227378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:22.227378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:22.227378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:22.227378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:22.227378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:22.227378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:22.227378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:22.227378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:22.228540 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:22.228540 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:22.228540 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:22.228540 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:22.228540 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:22.228540 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:22.228540 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:22.228540 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:22.228540 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:22.228540 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:22.228540 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:22.228540 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:22.228540 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:22.228540 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:22.228540 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:22.228540 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:22.229710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2841717e-8961-4b0c-8c5e-aef2c2db0dbb) Oct 12 13:26:22.229710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:22.229710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:22.229710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:22.229710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:22.229710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:22.229710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:22.229710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:26:22.229710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:26:22.229710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:26:22.229710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:26:22.229710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:22.229710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:22.229710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:22.229710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:22.229710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:22.229710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:22.229710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:22.229710 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:22.230960 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:26:22.230960 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:26:22.230960 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:22.230960 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:22.230960 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:22.230960 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-aae39d82-e0d9-4454-86b9-e74ae1fa8d3b tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:22.230960 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:26:22.230960 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-aae39d82-e0d9-4454-86b9-e74ae1fa8d3b tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.510069 Oct 12 13:26:22.231586 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e8003905-5c39-4b9d-86d0-e942d6674a08 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:22.231586 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-e8003905-5c39-4b9d-86d0-e942d6674a08 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2e5ecdb4-eaf0-4b44-9a4c-e442345da741] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:22.231751 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 545/1142] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:26:19 2022] POST /compute/v2.1/servers => generated 214 bytes in 2533 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:26:22.252095 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e8003905-5c39-4b9d-86d0-e942d6674a08 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:22.255717 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e8003905-5c39-4b9d-86d0-e942d6674a08 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:22.256477 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bfab4691-8ec3-4b70-b34e-5dd396a7bc0a tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1748359983", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "0bc25e31-d39b-49ae-972f-3651d3516f02"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:22.257063 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e8003905-5c39-4b9d-86d0-e942d6674a08 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:22.259067 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e8003905-5c39-4b9d-86d0-e942d6674a08 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:22.263426 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e8003905-5c39-4b9d-86d0-e942d6674a08 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:22.264205 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e8003905-5c39-4b9d-86d0-e942d6674a08 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:22.416484 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-bfab4691-8ec3-4b70-b34e-5dd396a7bc0a tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] validate_networks() for [('0bc25e31-d39b-49ae-972f-3651d3516f02', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:26:23.423855 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e8003905-5c39-4b9d-86d0-e942d6674a08 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:23.437952 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e8003905-5c39-4b9d-86d0-e942d6674a08 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741" status: 200 len: 1314 microversion: 2.1 time: 1.229253 Oct 12 13:26:23.446774 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 598/1143] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:22 2022] GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741 => generated 1314 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:23.459268 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9ff308c8-6bf0-41c8-a6d3-9d3cf1138ac4 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1758721172", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "35f69b3e-54a3-4d3a-9bbb-6d43dd211917"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:23.594700 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-9ff308c8-6bf0-41c8-a6d3-9d3cf1138ac4 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] validate_networks() for [('35f69b3e-54a3-4d3a-9bbb-6d43dd211917', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:26:24.013213 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-bfab4691-8ec3-4b70-b34e-5dd396a7bc0a tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3c1f95a0-d2f5-42fb-95d6-7d446c2616a5) Oct 12 13:26:24.013213 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:24.013213 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:24.013213 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:24.013213 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:24.013213 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:24.013213 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:24.013213 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:24.013213 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:24.013213 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:24.013213 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:24.013213 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:24.013213 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:24.013213 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:24.013213 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:24.013213 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:24.014843 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:24.014843 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:24.014843 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:24.014843 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:24.014843 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:24.014843 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:24.014843 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:24.014843 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:24.014843 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:24.014843 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:24.014843 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:24.014843 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:24.014843 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:24.014843 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:24.014843 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:24.014843 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:24.014843 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:24.014843 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:24.016102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:24.016102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:24.016102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:24.016102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:24.016102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:24.016102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:24.016102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:24.016102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:24.016102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:24.016102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:24.016102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:24.016102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:24.016102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:24.016102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:24.016102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:24.016102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:24.016102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:24.016102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:24.017423 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:24.017423 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:24.017423 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:24.017423 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:24.017423 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:24.017423 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:24.017423 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:24.017423 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:24.017423 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:24.017423 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:24.017423 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:24.017423 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:24.017423 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:24.017423 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:24.017423 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:24.018561 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3c1f95a0-d2f5-42fb-95d6-7d446c2616a5) Oct 12 13:26:24.018561 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:24.019921 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-bfab4691-8ec3-4b70-b34e-5dd396a7bc0a tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:24.019921 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:26:24.023265 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bfab4691-8ec3-4b70-b34e-5dd396a7bc0a tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Request method failure captured: Oct 12 13:26:24.023265 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:26:24.023265 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:26:24.023265 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:26:24.023265 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:26:24.023265 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 208 Oct 12 13:26:24.023265 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:26:24.023265 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:26:24.023265 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:26:24.023265 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:26:24.023265 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsBdL7wyincMMZQwWVO4VXZ12yGjskbZB6RbMosVFiO3AhWsk3p3j49O8SLUIedaHGcczd4m4MpzaMoMcOa6aCWbbQi-5ZIc3ZUEa1lJskMXmN8Nc0ijYn_Q7UvKQVQkq2YKbmWhYhuHg_-gF1WghqCfIW01OCPDumgGkHJGO6VVHFs Oct 12 13:26:24.023265 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:26:24.023265 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:26:24.023265 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:26:24.023265 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:26:24.023265 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:26:24.023265 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:26:24.023265 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 3399cf92fd65427b8652320be1e501ad Oct 12 13:26:24.023265 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:24.023265 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:26:24.023265 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:26:24.024727 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3399cf92fd65427b8652320be1e501ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3399cf92fd65427b8652320be1e501ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3399cf92fd65427b8652320be1e501ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3399cf92fd65427b8652320be1e501ad"}]}] Oct 12 13:26:24.024727 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:24.024727 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 3399cf92fd65427b8652320be1e501ad Oct 12 13:26:24.024727 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:24.024727 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-SecurityGroupsTestJSON-1263036119-project Oct 12 13:26:24.024727 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:26:24.024727 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:26:24.024727 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 21315dd58bd4461bb41c70ccdfd27d47 Oct 12 13:26:24.024727 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-SecurityGroupsTestJSON-1263036119-project Oct 12 13:26:24.024727 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:26:24.024727 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1748359983", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "0bc25e31-d39b-49ae-972f-3651d3516f02"}]}} Oct 12 13:26:24.025462 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:26:24.025462 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:24.025462 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:26:24.025462 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-SecurityGroupsTestJSON-server-1748359983', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '0bc25e31-d39b-49ae-972f-3651d3516f02'}]}}} Oct 12 13:26:24.025462 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:26:24.025462 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:24.025462 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:24.025462 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:24.025462 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:24.025462 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:24.025462 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:24.025462 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:24.025462 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:24.025462 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:24.025462 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:24.025462 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:24.025462 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:24.025462 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:24.025462 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:24.026638 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:24.026638 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:24.026638 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:24.026638 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:24.026638 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:24.026638 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:24.026638 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:24.026638 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:24.026638 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:24.026638 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:24.026638 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:24.026638 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:24.026638 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:24.026638 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:24.026638 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:24.026638 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:24.026638 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:24.026638 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:24.027762 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:24.027762 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:24.027762 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:24.027762 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:24.027762 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:24.027762 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:24.027762 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:24.027762 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:24.027762 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:24.027762 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:24.027762 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:24.027762 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:24.027762 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:24.027762 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:24.027762 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:24.027762 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:24.027762 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:24.027762 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:24.028842 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:24.028842 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:24.028842 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:24.028842 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:24.028842 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:24.028842 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:24.028842 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:24.028842 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:24.028842 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:24.028842 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:24.028842 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:24.028842 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:24.028842 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:24.028842 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:24.028842 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:24.028842 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:24.030285 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3c1f95a0-d2f5-42fb-95d6-7d446c2616a5) Oct 12 13:26:24.030285 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:24.030285 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:24.030285 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:24.030285 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:24.030285 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:24.030285 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:24.030285 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:26:24.030285 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:26:24.030285 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:26:24.030285 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:26:24.030285 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:24.030285 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:24.030285 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:24.030285 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:24.030285 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:24.030285 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:24.030285 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:24.030285 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:24.031420 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:26:24.031420 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:26:24.031420 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:24.031420 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:24.031420 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:24.032622 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bfab4691-8ec3-4b70-b34e-5dd396a7bc0a tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:24.032622 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:26:24.035057 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bfab4691-8ec3-4b70-b34e-5dd396a7bc0a tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.807066 Oct 12 13:26:24.043607 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 546/1144] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:26:22 2022] POST /compute/v2.1/servers => generated 214 bytes in 1810 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:26:24.248019 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bf8c750f-9ccc-407c-b223-6cbbc15055e2 tempest-MultipleCreateTestJSON-314076388 tempest-MultipleCreateTestJSON-314076388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-704294641", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "5739dc36-1178-4983-af4e-d7fbfc4e1c30"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:24.393503 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-bf8c750f-9ccc-407c-b223-6cbbc15055e2 tempest-MultipleCreateTestJSON-314076388 tempest-MultipleCreateTestJSON-314076388-project] validate_networks() for [('5739dc36-1178-4983-af4e-d7fbfc4e1c30', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:26:26.726969 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-9ff308c8-6bf0-41c8-a6d3-9d3cf1138ac4 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b7b53dbb-bcaf-4965-97e0-55e0ffd0d458) Oct 12 13:26:26.726969 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:26.726969 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:26.726969 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:26.726969 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:26.726969 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:26.726969 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:26.726969 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:26.726969 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:26.726969 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:26.726969 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:26.726969 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:26.726969 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:26.726969 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:26.726969 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:26.726969 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:26.728781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:26.728781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:26.728781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:26.728781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:26.728781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:26.728781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:26.728781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:26.728781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:26.728781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:26.728781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:26.728781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:26.728781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:26.728781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:26.728781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:26.728781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:26.728781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:26.728781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:26.728781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:26.730177 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:26.730177 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:26.730177 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:26.730177 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:26.730177 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:26.730177 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:26.730177 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:26.730177 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:26.730177 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:26.730177 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:26.730177 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:26.730177 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:26.730177 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:26.730177 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:26.730177 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:26.730177 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:26.730177 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:26.730177 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:26.731457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:26.731457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:26.731457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:26.731457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:26.731457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:26.731457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:26.731457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:26.731457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:26.731457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:26.731457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:26.731457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:26.731457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:26.731457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:26.731457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:26.731457 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:26.732412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b7b53dbb-bcaf-4965-97e0-55e0ffd0d458) Oct 12 13:26:26.732412 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:26.734020 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-9ff308c8-6bf0-41c8-a6d3-9d3cf1138ac4 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:26.734020 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:26:26.736912 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9ff308c8-6bf0-41c8-a6d3-9d3cf1138ac4 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Request method failure captured: Oct 12 13:26:26.736912 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:26:26.736912 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:26:26.736912 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:26:26.736912 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:26:26.736912 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 207 Oct 12 13:26:26.736912 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:26:26.736912 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:26:26.736912 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:26:26.736912 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:26:26.736912 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsB69ycY6emTEF7VKNmSiWucG5hf4zJqAS0qllNTR3QOE0HbuWc3IP0qp9UjEdcrgVVND6UpCY_jIANWKl-PFnlYhqe6aUOGKrPdzQd8B12CFMVl8o8_cfbZpEo2Q-eo-Py_qD3IXZ8-S0wAjivvd-T9o669T0CfjXP2ItDPUd8LF9Y Oct 12 13:26:26.736912 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:26:26.736912 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:26:26.736912 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:26:26.736912 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:26:26.736912 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:26:26.736912 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:26:26.736912 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 9a13e12acfc242d49d32baadf18b0fe4 Oct 12 13:26:26.736912 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-DeleteServersTestJSON-700119419 Oct 12 13:26:26.736912 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:26:26.736912 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:26:26.738541 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9a13e12acfc242d49d32baadf18b0fe4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9a13e12acfc242d49d32baadf18b0fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a13e12acfc242d49d32baadf18b0fe4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a13e12acfc242d49d32baadf18b0fe4"}]}] Oct 12 13:26:26.738541 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-DeleteServersTestJSON-700119419 Oct 12 13:26:26.738541 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 9a13e12acfc242d49d32baadf18b0fe4 Oct 12 13:26:26.738541 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-DeleteServersTestJSON-700119419 Oct 12 13:26:26.738541 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-DeleteServersTestJSON-700119419-project Oct 12 13:26:26.738541 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:26:26.738541 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:26:26.738541 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 9ca6b75658f94803bd9088aa7f23d2c8 Oct 12 13:26:26.738541 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-DeleteServersTestJSON-700119419-project Oct 12 13:26:26.738541 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:26:26.738541 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-DeleteServersTestJSON-server-1758721172", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "35f69b3e-54a3-4d3a-9bbb-6d43dd211917"}]}} Oct 12 13:26:26.739786 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:26:26.739786 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:26.739786 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:26:26.739786 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-1758721172', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '35f69b3e-54a3-4d3a-9bbb-6d43dd211917'}]}}} Oct 12 13:26:26.739786 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:26:26.739786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:26.739786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:26.739786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:26.739786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:26.739786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:26.739786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:26.739786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:26.739786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:26.739786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:26.739786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:26.739786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:26.739786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:26.739786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:26.739786 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:26.741060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:26.741060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:26.741060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:26.741060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:26.741060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:26.741060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:26.741060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:26.741060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:26.741060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:26.741060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:26.741060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:26.741060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:26.741060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:26.741060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:26.741060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:26.741060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:26.741060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:26.741060 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:26.742157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:26.742157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:26.742157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:26.742157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:26.742157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:26.742157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:26.742157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:26.742157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:26.742157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:26.742157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:26.742157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:26.742157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:26.742157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:26.742157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:26.742157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:26.742157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:26.742157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:26.742157 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:26.743370 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:26.743370 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:26.743370 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:26.743370 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:26.743370 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:26.743370 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:26.743370 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:26.743370 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:26.743370 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:26.743370 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:26.743370 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:26.743370 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:26.743370 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:26.743370 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:26.743370 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:26.743370 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:26.744362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b7b53dbb-bcaf-4965-97e0-55e0ffd0d458) Oct 12 13:26:26.744362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:26.744362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:26.744362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:26.744362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:26.744362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:26.744362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:26.744362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:26:26.744362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:26:26.744362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:26:26.744362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:26:26.744362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:26.744362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:26.744362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:26.744362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:26.744362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:26.744362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:26.744362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:26.744362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:26.745685 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:26:26.745685 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:26:26.745685 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:26.745685 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:26.745685 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:26.761478 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9ff308c8-6bf0-41c8-a6d3-9d3cf1138ac4 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:26.761478 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:26:26.761478 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9ff308c8-6bf0-41c8-a6d3-9d3cf1138ac4 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 3.312076 Oct 12 13:26:26.761478 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 599/1145] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:26:23 2022] POST /compute/v2.1/servers => generated 214 bytes in 3314 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:26:26.784190 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c1e0989d-a388-4cf3-b845-b615692e9d1d tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bd1c670>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:26.886239 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c1e0989d-a388-4cf3-b845-b615692e9d1d tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.113664 Oct 12 13:26:26.886818 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 600/1146] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:26:26 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:26.905205 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4b2aae79-584b-4e4d-97e3-94dc772a32fb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:26.906027 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-4b2aae79-584b-4e4d-97e3-94dc772a32fb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 04ccef15-bb8d-4f4e-ac84-20c94c040b22] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:26.918621 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4b2aae79-584b-4e4d-97e3-94dc772a32fb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:26.919382 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4b2aae79-584b-4e4d-97e3-94dc772a32fb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:26.920019 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4b2aae79-584b-4e4d-97e3-94dc772a32fb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:26.958131 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4b2aae79-584b-4e4d-97e3-94dc772a32fb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:26.958999 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4b2aae79-584b-4e4d-97e3-94dc772a32fb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:26.959941 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4b2aae79-584b-4e4d-97e3-94dc772a32fb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:27.175300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-bf8c750f-9ccc-407c-b223-6cbbc15055e2 tempest-MultipleCreateTestJSON-314076388 tempest-MultipleCreateTestJSON-314076388-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-05851edf-a86f-4008-8ee2-e72d23fdc0a1) Oct 12 13:26:27.175300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:27.175300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:27.175300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:27.175300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:27.175300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:27.175300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:27.175300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:27.175300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:27.175300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:27.175300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:27.175300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:27.175300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:27.175300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:27.175300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:27.175300 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:27.181363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:27.181363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:27.181363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:27.181363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:27.181363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:27.181363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:27.181363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:27.181363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:27.181363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:27.181363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:27.181363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:27.181363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:27.181363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:27.181363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:27.181363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:27.181363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:27.181363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:27.181363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:27.182971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:27.182971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:27.182971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:27.182971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:27.182971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:27.182971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:27.182971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:27.182971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:27.182971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:27.182971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:27.182971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:27.182971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:27.182971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:27.182971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:27.182971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:27.182971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:27.182971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:27.182971 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:27.184314 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:27.184314 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:27.184314 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:27.184314 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:27.184314 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:27.184314 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:27.184314 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:27.184314 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:27.184314 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:27.184314 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:27.184314 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:27.184314 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:27.184314 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:27.184314 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:27.184314 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-05851edf-a86f-4008-8ee2-e72d23fdc0a1) Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-bf8c750f-9ccc-407c-b223-6cbbc15055e2 tempest-MultipleCreateTestJSON-314076388 tempest-MultipleCreateTestJSON-314076388-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bf8c750f-9ccc-407c-b223-6cbbc15055e2 tempest-MultipleCreateTestJSON-314076388 tempest-MultipleCreateTestJSON-314076388-project] Request method failure captured: Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 225 Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsB-PnXZATDnNpjOE8kT-xFFRtqZvAfv7NL8OQPNHlzn4mkeAbX3XY5zoprvcHR2o7DGiq5owErgeBt_N_5PpHMcLFAFWpkbl6AhKBxVOZj0mugOwZbmqqhy0qXgkZjYuZSwsMSVXdnjx9Eb-BrkqfKDwg6dDOlm9hhkLFRGWjuG7LY Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: cbdebd56134d4353a14a7171b0110878 Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-MultipleCreateTestJSON-314076388 Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:26:27.185344 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:26:27.187201 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cbdebd56134d4353a14a7171b0110878"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cbdebd56134d4353a14a7171b0110878"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cbdebd56134d4353a14a7171b0110878"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cbdebd56134d4353a14a7171b0110878"}]}] Oct 12 13:26:27.187201 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-MultipleCreateTestJSON-314076388 Oct 12 13:26:27.187201 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: cbdebd56134d4353a14a7171b0110878 Oct 12 13:26:27.187201 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-MultipleCreateTestJSON-314076388 Oct 12 13:26:27.187201 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-MultipleCreateTestJSON-314076388-project Oct 12 13:26:27.187201 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:26:27.187201 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:26:27.187201 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 87e086e5b4c04021b25295f6d36a1292 Oct 12 13:26:27.187201 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-MultipleCreateTestJSON-314076388-project Oct 12 13:26:27.187201 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:26:27.187201 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-tempest.common.compute-instance-704294641", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "5739dc36-1178-4983-af4e-d7fbfc4e1c30"}]}} Oct 12 13:26:27.187974 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:26:27.187974 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:27.187974 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:26:27.187974 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-tempest.common.compute-instance-704294641', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'min_count': 2, 'networks': [{'uuid': '5739dc36-1178-4983-af4e-d7fbfc4e1c30'}]}}} Oct 12 13:26:27.187974 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:26:27.187974 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:27.187974 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:27.187974 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:27.187974 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:27.187974 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:27.187974 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:27.187974 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:27.187974 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:27.187974 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:27.187974 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:27.187974 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:27.187974 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:27.187974 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:27.187974 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:27.189429 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:27.189429 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:27.189429 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:27.189429 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:27.189429 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:27.189429 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:27.189429 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:27.189429 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:27.189429 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:27.189429 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:27.189429 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:27.189429 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:27.189429 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:27.189429 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:27.189429 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:27.189429 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:27.189429 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:27.189429 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:27.194114 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:27.194114 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:27.194114 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:27.194114 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:27.194114 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:27.194114 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:27.194114 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:27.194114 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:27.194114 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:27.194114 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:27.194114 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:27.194114 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:27.194114 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:27.194114 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:27.194114 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:27.194114 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:27.194114 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:27.194114 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:27.196206 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:27.196206 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:27.196206 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:27.196206 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:27.196206 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:27.196206 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:27.196206 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:27.196206 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:27.196206 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:27.196206 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:27.196206 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:27.196206 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:27.196206 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:27.196206 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:27.196206 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:27.196206 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:27.199999 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-05851edf-a86f-4008-8ee2-e72d23fdc0a1) Oct 12 13:26:27.199999 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:27.199999 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:27.199999 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:27.199999 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:27.199999 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:27.199999 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:27.199999 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:26:27.199999 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:26:27.199999 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:26:27.199999 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:26:27.199999 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:27.199999 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:27.199999 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:27.199999 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:27.199999 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:27.199999 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:27.199999 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:27.199999 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:27.202159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:26:27.202159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:26:27.202159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:27.202159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:27.202159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:27.202159 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bf8c750f-9ccc-407c-b223-6cbbc15055e2 tempest-MultipleCreateTestJSON-314076388 tempest-MultipleCreateTestJSON-314076388-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:27.202159 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:26:27.202159 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bf8c750f-9ccc-407c-b223-6cbbc15055e2 tempest-MultipleCreateTestJSON-314076388 tempest-MultipleCreateTestJSON-314076388-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 3.109307 Oct 12 13:26:27.202159 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 547/1147] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:26:24 2022] POST /compute/v2.1/servers => generated 214 bytes in 3118 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:26:27.203159 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f3ece2e4-f36d-4ffb-a327-ee95dcd7d482 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Action: 'create', calling method: .version_select at 0x7f8a9b92d430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1394229758", "description": "tempest-description-1237740985"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:27.297485 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-4b2aae79-584b-4e4d-97e3-94dc772a32fb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:27.310985 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4b2aae79-584b-4e4d-97e3-94dc772a32fb tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22" status: 200 len: 1275 microversion: 2.1 time: 0.422728 Oct 12 13:26:27.311980 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 601/1148] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:26 2022] GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22 => generated 1275 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:27.318693 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e00e5d02-6946-4a4a-9f12-027186765965 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:27.320013 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-e00e5d02-6946-4a4a-9f12-027186765965 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2e5ecdb4-eaf0-4b44-9a4c-e442345da741] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:27.327748 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e00e5d02-6946-4a4a-9f12-027186765965 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:27.328489 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e00e5d02-6946-4a4a-9f12-027186765965 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:27.329148 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e00e5d02-6946-4a4a-9f12-027186765965 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:27.330302 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e00e5d02-6946-4a4a-9f12-027186765965 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:27.331520 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e00e5d02-6946-4a4a-9f12-027186765965 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:27.332102 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e00e5d02-6946-4a4a-9f12-027186765965 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:27.394757 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:26:27.459670 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=6 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:26:27.719854 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e00e5d02-6946-4a4a-9f12-027186765965 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:27.730516 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e00e5d02-6946-4a4a-9f12-027186765965 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741" status: 200 len: 1314 microversion: 2.1 time: 0.416934 Oct 12 13:26:27.731508 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 602/1149] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:27 2022] GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:27.739043 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-5989eee0-64f6-4cf3-a309-fe2d2e5afca0 req-3e7d70e7-19a2-426a-af6b-d1e523e06966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fbda837-cf92-4aa6-8551-96cd4a3f1b80", "name": "network-vif-plugged", "status": "completed", "tag": "cf85a1bd-8e0c-48d6-9580-9faf6388ba80"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:27.756276 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-5989eee0-64f6-4cf3-a309-fe2d2e5afca0 req-3e7d70e7-19a2-426a-af6b-d1e523e06966 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:27.757308 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-5989eee0-64f6-4cf3-a309-fe2d2e5afca0 req-3e7d70e7-19a2-426a-af6b-d1e523e06966 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:27.757308 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-5989eee0-64f6-4cf3-a309-fe2d2e5afca0 req-3e7d70e7-19a2-426a-af6b-d1e523e06966 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:27.772715 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-5989eee0-64f6-4cf3-a309-fe2d2e5afca0 req-3e7d70e7-19a2-426a-af6b-d1e523e06966 service nova] Creating event network-vif-plugged:cf85a1bd-8e0c-48d6-9580-9faf6388ba80 for instance 3fbda837-cf92-4aa6-8551-96cd4a3f1b80 on n-h1-861076-2 Oct 12 13:26:27.783378 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-5989eee0-64f6-4cf3-a309-fe2d2e5afca0 req-3e7d70e7-19a2-426a-af6b-d1e523e06966 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048193 Oct 12 13:26:27.784331 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 603/1150] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:27.970658 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1ab27d7b-e872-4ce6-b33c-a4f9bf5078c2 tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-589262091", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "2ac46638-ae9e-42a4-bb0b-22f0e91dbfc8"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:28.079226 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-1ab27d7b-e872-4ce6-b33c-a4f9bf5078c2 tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] validate_networks() for [('2ac46638-ae9e-42a4-bb0b-22f0e91dbfc8', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:26:28.795363 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-1ab27d7b-e872-4ce6-b33c-a4f9bf5078c2 tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-10207faf-f637-4271-8fcb-34948d972db2) Oct 12 13:26:28.795363 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:28.795363 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:28.795363 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:28.795363 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:28.795363 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:28.795363 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:28.795363 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:28.795363 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:28.795363 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:28.795363 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:28.795363 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:28.795363 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:28.795363 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:28.795363 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:28.795363 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:28.796963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:28.796963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:28.796963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:28.796963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:28.796963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:28.796963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:28.796963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:28.796963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:28.796963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:28.796963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:28.796963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:28.796963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:28.796963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:28.796963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:28.796963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:28.796963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:28.796963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:28.796963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:28.798057 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:28.798057 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:28.798057 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:28.798057 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:28.798057 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:28.798057 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:28.798057 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:28.798057 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:28.798057 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:28.798057 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:28.798057 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:28.798057 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:28.798057 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:28.798057 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:28.798057 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:28.798057 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:28.798057 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:28.798057 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:28.800737 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:28.800737 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:28.800737 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:28.800737 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:28.800737 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:28.800737 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:28.800737 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:28.800737 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:28.800737 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:28.800737 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:28.800737 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:28.800737 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:28.800737 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:28.800737 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:28.800737 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-10207faf-f637-4271-8fcb-34948d972db2) Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-1ab27d7b-e872-4ce6-b33c-a4f9bf5078c2 tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1ab27d7b-e872-4ce6-b33c-a4f9bf5078c2 tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] Request method failure captured: Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 202 Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsBuKp2VByNdgfQrj0sMeYqojE_eczcPkIffWMyqj-Idx_zy7Z5xFTQjdVldszLkBK6xNruL0MKKC4-BfP9X2aVjFJRZ0zIBshu9L2xvXHvXOvhhepvh03I4jUVcyEv7s9lcsTTtJi_MtHKAFX-w0FG3xqUSK9fPnh_tb7vKMNTag30 Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: eeb7bf197c5c402fbb618ce9759228a0 Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-LiveMigrationTest-959108841 Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:26:28.802941 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:26:28.805702 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eeb7bf197c5c402fbb618ce9759228a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eeb7bf197c5c402fbb618ce9759228a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eeb7bf197c5c402fbb618ce9759228a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eeb7bf197c5c402fbb618ce9759228a0"}]}] Oct 12 13:26:28.805702 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-LiveMigrationTest-959108841 Oct 12 13:26:28.805702 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: eeb7bf197c5c402fbb618ce9759228a0 Oct 12 13:26:28.805702 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-LiveMigrationTest-959108841 Oct 12 13:26:28.805702 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-LiveMigrationTest-959108841-project Oct 12 13:26:28.805702 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:26:28.805702 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:26:28.805702 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: b01bb9e01bbd4feebbb3f965089245f4 Oct 12 13:26:28.805702 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-LiveMigrationTest-959108841-project Oct 12 13:26:28.805702 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:26:28.805702 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-LiveMigrationTest-server-589262091", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "2ac46638-ae9e-42a4-bb0b-22f0e91dbfc8"}]}} Oct 12 13:26:28.805702 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:26:28.807547 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:28.807547 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:26:28.807547 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-LiveMigrationTest-server-589262091', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '2ac46638-ae9e-42a4-bb0b-22f0e91dbfc8'}]}}} Oct 12 13:26:28.807547 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:26:28.807547 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:28.807547 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:28.807547 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:28.807547 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:28.807547 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:28.807547 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:28.807547 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:28.807547 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:28.807547 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:28.807547 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:28.807547 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:28.807547 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:28.807547 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:28.807547 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:28.807547 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:28.819223 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:28.819223 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:28.819223 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:28.819223 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:28.819223 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:28.819223 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:28.819223 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:28.819223 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:28.819223 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:28.819223 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:28.819223 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:28.819223 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:28.819223 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:28.819223 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:28.819223 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:28.819223 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:28.819223 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:28.819223 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:28.820345 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:28.820345 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:28.820345 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:28.820345 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:28.820345 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:28.820345 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:28.820345 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:28.820345 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:28.820345 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:28.820345 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:28.820345 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:28.820345 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:28.820345 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:28.820345 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:28.820345 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:28.820345 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:28.820345 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:28.820345 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:28.821857 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:28.821857 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:28.821857 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:28.821857 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:28.821857 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:28.821857 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:28.821857 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:28.821857 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:28.821857 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:28.821857 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:28.821857 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:28.821857 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:28.821857 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:28.821857 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:28.821857 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:28.822815 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-10207faf-f637-4271-8fcb-34948d972db2) Oct 12 13:26:28.822815 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:28.822815 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:28.822815 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:28.822815 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:28.822815 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:28.822815 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:28.822815 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:26:28.822815 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:26:28.822815 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:26:28.822815 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:26:28.822815 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:28.822815 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:28.822815 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:28.822815 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:28.822815 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:28.822815 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:28.822815 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:28.822815 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:28.824861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:26:28.824861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:26:28.824861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:28.824861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:28.824861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:28.824861 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1ab27d7b-e872-4ce6-b33c-a4f9bf5078c2 tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:28.824861 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:26:28.824861 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1ab27d7b-e872-4ce6-b33c-a4f9bf5078c2 tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.014214 Oct 12 13:26:28.824861 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 604/1151] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:26:27 2022] POST /compute/v2.1/servers => generated 214 bytes in 1016 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:26:28.850232 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fcfa5a55-cce9-4797-8558-9902f6b60676 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1002933674", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "35f69b3e-54a3-4d3a-9bbb-6d43dd211917"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:28.920547 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:26:28.990813 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-fcfa5a55-cce9-4797-8558-9902f6b60676 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] validate_networks() for [('35f69b3e-54a3-4d3a-9bbb-6d43dd211917', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:26:29.226662 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f3ece2e4-f36d-4ffb-a327-ee95dcd7d482 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 2.069140 Oct 12 13:26:29.227734 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 548/1152] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:26:27 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 2071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:29.243577 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fdd4a185-dfb5-4b4a-bafe-1cf53d094ad7 tempest-MultipleCreateTestJSON-314076388 tempest-MultipleCreateTestJSON-314076388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1671123327", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "5739dc36-1178-4983-af4e-d7fbfc4e1c30"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:29.356582 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-fdd4a185-dfb5-4b4a-bafe-1cf53d094ad7 tempest-MultipleCreateTestJSON-314076388 tempest-MultipleCreateTestJSON-314076388-project] validate_networks() for [('5739dc36-1178-4983-af4e-d7fbfc4e1c30', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:26:29.668201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-fcfa5a55-cce9-4797-8558-9902f6b60676 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-10ad7a91-b09c-4298-99a1-da063827f9a4) Oct 12 13:26:29.668201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:29.668201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:29.668201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:29.668201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:29.668201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:29.668201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:29.668201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:29.668201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:29.668201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:29.668201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:29.668201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:29.668201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:29.668201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:29.668201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:29.668201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:29.669366 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:29.669366 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:29.669366 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:29.669366 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:29.669366 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:29.669366 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:29.669366 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:29.669366 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:29.669366 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:29.669366 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:29.669366 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:29.669366 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:29.669366 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:29.669366 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:29.669366 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:29.669366 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:29.669366 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:29.669366 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:29.670507 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:29.670507 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:29.670507 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:29.670507 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:29.670507 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:29.670507 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:29.670507 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:29.670507 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:29.670507 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:29.670507 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:29.670507 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:29.670507 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:29.670507 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:29.670507 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:29.670507 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:29.670507 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:29.670507 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:29.670507 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:29.674194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:29.674194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:29.674194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:29.674194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:29.674194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:29.674194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:29.674194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:29.674194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:29.674194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:29.674194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:29.674194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:29.674194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:29.674194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:29.674194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:29.674194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-10ad7a91-b09c-4298-99a1-da063827f9a4) Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-fcfa5a55-cce9-4797-8558-9902f6b60676 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fcfa5a55-cce9-4797-8558-9902f6b60676 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Request method failure captured: Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 207 Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsB69ycY6emTEF7VKNmSiWucG5hf4zJqAS0qllNTR3QOE0HbuWc3IP0qp9UjEdcrgVVND6UpCY_jIANWKl-PFnlYhqe6aUOGKrPdzQd8B12CFMVl8o8_cfbZpEo2Q-eo-Py_qD3IXZ8-S0wAjivvd-T9o669T0CfjXP2ItDPUd8LF9Y Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 9a13e12acfc242d49d32baadf18b0fe4 Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-DeleteServersTestJSON-700119419 Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:26:29.677655 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:26:29.683120 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9a13e12acfc242d49d32baadf18b0fe4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9a13e12acfc242d49d32baadf18b0fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a13e12acfc242d49d32baadf18b0fe4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a13e12acfc242d49d32baadf18b0fe4"}]}] Oct 12 13:26:29.683120 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-DeleteServersTestJSON-700119419 Oct 12 13:26:29.683120 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 9a13e12acfc242d49d32baadf18b0fe4 Oct 12 13:26:29.683120 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-DeleteServersTestJSON-700119419 Oct 12 13:26:29.683120 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-DeleteServersTestJSON-700119419-project Oct 12 13:26:29.683120 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:26:29.683120 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:26:29.683120 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 9ca6b75658f94803bd9088aa7f23d2c8 Oct 12 13:26:29.683120 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-DeleteServersTestJSON-700119419-project Oct 12 13:26:29.683120 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:26:29.683120 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-DeleteServersTestJSON-server-1002933674", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "35f69b3e-54a3-4d3a-9bbb-6d43dd211917"}]}} Oct 12 13:26:29.685782 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:26:29.685782 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:29.685782 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:26:29.685782 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-1002933674', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '35f69b3e-54a3-4d3a-9bbb-6d43dd211917'}]}}} Oct 12 13:26:29.685782 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:26:29.685782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:29.685782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:29.685782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:29.685782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:29.685782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:29.685782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:29.685782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:29.685782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:29.685782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:29.685782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:29.685782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:29.685782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:29.685782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:29.685782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:29.688592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:29.688592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:29.688592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:29.688592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:29.688592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:29.688592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:29.688592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:29.688592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:29.688592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:29.688592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:29.688592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:29.688592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:29.688592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:29.688592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:29.688592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:29.688592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:29.688592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:29.688592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:29.691515 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:29.691515 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:29.691515 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:29.691515 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:29.691515 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:29.691515 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:29.691515 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:29.691515 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:29.691515 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:29.691515 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:29.691515 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:29.691515 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:29.691515 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:29.691515 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:29.691515 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:29.691515 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:29.691515 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:29.691515 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:29.694403 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:29.694403 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:29.694403 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:29.694403 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:29.694403 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:29.694403 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:29.694403 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:29.694403 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:29.694403 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:29.694403 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:29.694403 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:29.694403 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:29.694403 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:29.694403 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:29.694403 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:29.694403 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:29.697740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-10ad7a91-b09c-4298-99a1-da063827f9a4) Oct 12 13:26:29.697740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:29.697740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:29.697740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:29.697740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:29.697740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:29.697740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:29.697740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:26:29.697740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:26:29.697740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:26:29.697740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:26:29.697740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:29.697740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:29.697740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:29.697740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:29.697740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:29.697740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:29.697740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:29.697740 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:29.702202 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:26:29.702202 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:26:29.702202 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:29.702202 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:29.702202 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:29.702202 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fcfa5a55-cce9-4797-8558-9902f6b60676 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:29.702202 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:26:29.702202 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fcfa5a55-cce9-4797-8558-9902f6b60676 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.854772 Oct 12 13:26:29.702202 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 605/1153] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:26:28 2022] POST /compute/v2.1/servers => generated 214 bytes in 868 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:26:29.703102 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=48 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:26:29.703190 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2673ab47-a578-4666-a51f-8194b595f7b3 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa00601f0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:29.777201 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2673ab47-a578-4666-a51f-8194b595f7b3 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1455 microversion: 2.1 time: 0.085267 Oct 12 13:26:29.778043 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 606/1154] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:26:29 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:29.790469 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-94679849-cc49-41d4-ae29-cc774266f130 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:29.794160 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-94679849-cc49-41d4-ae29-cc774266f130 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 04ccef15-bb8d-4f4e-ac84-20c94c040b22] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:29.806357 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-94679849-cc49-41d4-ae29-cc774266f130 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:29.810036 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-94679849-cc49-41d4-ae29-cc774266f130 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:29.810036 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-94679849-cc49-41d4-ae29-cc774266f130 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:29.811299 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-94679849-cc49-41d4-ae29-cc774266f130 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:29.811795 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-94679849-cc49-41d4-ae29-cc774266f130 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:29.812227 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-94679849-cc49-41d4-ae29-cc774266f130 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:30.231090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-fdd4a185-dfb5-4b4a-bafe-1cf53d094ad7 tempest-MultipleCreateTestJSON-314076388 tempest-MultipleCreateTestJSON-314076388-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-23485cbc-345a-4b26-bdb6-73bc4be5c551) Oct 12 13:26:30.231090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:30.231090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:30.231090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:30.231090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:30.231090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:30.231090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:30.231090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:30.231090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:30.231090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:30.231090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:30.231090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:30.231090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:30.231090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:30.231090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:30.231090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:30.232644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:30.232644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:30.232644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:30.232644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:30.232644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:30.232644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:30.232644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:30.232644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:30.232644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:30.232644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:30.232644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:30.232644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:30.232644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:30.232644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:30.232644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:30.232644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:30.232644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:30.232644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:30.233783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:30.233783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:30.233783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:30.233783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:30.233783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:30.233783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:30.233783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:30.233783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:30.233783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:30.233783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:30.233783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:30.233783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:30.233783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:30.233783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:30.233783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:30.233783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:30.233783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:30.233783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:30.234864 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:30.234864 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:30.234864 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:30.234864 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:30.234864 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:30.234864 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:30.234864 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:30.234864 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:30.234864 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:30.234864 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:30.234864 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:30.234864 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:30.234864 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:30.234864 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:30.234864 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-23485cbc-345a-4b26-bdb6-73bc4be5c551) Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-fdd4a185-dfb5-4b4a-bafe-1cf53d094ad7 tempest-MultipleCreateTestJSON-314076388 tempest-MultipleCreateTestJSON-314076388-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fdd4a185-dfb5-4b4a-bafe-1cf53d094ad7 tempest-MultipleCreateTestJSON-314076388 tempest-MultipleCreateTestJSON-314076388-project] Request method failure captured: Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 271 Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsB-PnXZATDnNpjOE8kT-xFFRtqZvAfv7NL8OQPNHlzn4mkeAbX3XY5zoprvcHR2o7DGiq5owErgeBt_N_5PpHMcLFAFWpkbl6AhKBxVOZj0mugOwZbmqqhy0qXgkZjYuZSwsMSVXdnjx9Eb-BrkqfKDwg6dDOlm9hhkLFRGWjuG7LY Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: cbdebd56134d4353a14a7171b0110878 Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-MultipleCreateTestJSON-314076388 Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:26:30.235942 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:26:30.242237 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cbdebd56134d4353a14a7171b0110878"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cbdebd56134d4353a14a7171b0110878"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cbdebd56134d4353a14a7171b0110878"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cbdebd56134d4353a14a7171b0110878"}]}] Oct 12 13:26:30.242237 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-MultipleCreateTestJSON-314076388 Oct 12 13:26:30.242237 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: cbdebd56134d4353a14a7171b0110878 Oct 12 13:26:30.242237 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-MultipleCreateTestJSON-314076388 Oct 12 13:26:30.242237 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-MultipleCreateTestJSON-314076388-project Oct 12 13:26:30.242237 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:26:30.242237 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:26:30.242237 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 87e086e5b4c04021b25295f6d36a1292 Oct 12 13:26:30.242237 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-MultipleCreateTestJSON-314076388-project Oct 12 13:26:30.242237 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:26:30.242237 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1671123327", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "5739dc36-1178-4983-af4e-d7fbfc4e1c30"}]}} Oct 12 13:26:30.245922 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:26:30.245922 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:30.245922 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:26:30.245922 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateTestJSON-server-1671123327', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'min_count': 1, 'max_count': 2, 'return_reservation_id': True, 'networks': [{'uuid': '5739dc36-1178-4983-af4e-d7fbfc4e1c30'}]}}} Oct 12 13:26:30.245922 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:26:30.245922 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:30.245922 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:30.245922 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:30.245922 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:30.245922 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:30.245922 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:30.245922 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:30.245922 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:30.245922 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:30.245922 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:30.245922 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:30.245922 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:30.245922 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:30.249798 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:30.249798 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:30.249798 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:30.249798 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:30.249798 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:30.249798 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:30.249798 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:30.249798 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:30.249798 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:30.249798 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:30.249798 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:30.249798 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:30.249798 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:30.249798 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:30.249798 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:30.249798 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:30.249798 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:30.249798 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:30.253118 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:30.253118 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:30.253118 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:30.253118 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:30.253118 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:30.253118 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:30.253118 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:30.253118 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:30.253118 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:30.253118 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:30.253118 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:30.253118 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:30.253118 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:30.253118 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:30.253118 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:30.253118 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:30.253118 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:30.253118 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:30.257355 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:30.257355 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:30.257355 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:30.257355 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:30.257355 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:30.257355 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:30.257355 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:30.257355 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:30.257355 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:30.257355 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:30.257355 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:30.257355 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:30.257355 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:30.257355 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:30.257355 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:30.257355 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:30.257355 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:30.260397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-23485cbc-345a-4b26-bdb6-73bc4be5c551) Oct 12 13:26:30.260397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:30.260397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:30.260397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:30.260397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:30.260397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:30.260397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:30.260397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:26:30.260397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:26:30.260397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:26:30.260397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:26:30.260397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:30.260397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:30.260397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:30.260397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:30.260397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:30.260397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:30.260397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:30.260397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:30.266126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:26:30.266126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:26:30.266126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:30.266126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:30.266126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:30.266126 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fdd4a185-dfb5-4b4a-bafe-1cf53d094ad7 tempest-MultipleCreateTestJSON-314076388 tempest-MultipleCreateTestJSON-314076388-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:30.266126 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:26:30.266126 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fdd4a185-dfb5-4b4a-bafe-1cf53d094ad7 tempest-MultipleCreateTestJSON-314076388 tempest-MultipleCreateTestJSON-314076388-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.006950 Oct 12 13:26:30.266126 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 549/1155] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:26:29 2022] POST /compute/v2.1/servers => generated 214 bytes in 1016 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:26:30.266126 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5097c67d-1592-4f83-b7e5-13284067def7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:30.267667 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5097c67d-1592-4f83-b7e5-13284067def7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2e5ecdb4-eaf0-4b44-9a4c-e442345da741] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:30.286447 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5097c67d-1592-4f83-b7e5-13284067def7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:30.286945 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5097c67d-1592-4f83-b7e5-13284067def7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:30.287390 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5097c67d-1592-4f83-b7e5-13284067def7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:30.295604 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5097c67d-1592-4f83-b7e5-13284067def7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:30.296107 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5097c67d-1592-4f83-b7e5-13284067def7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:30.296563 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5097c67d-1592-4f83-b7e5-13284067def7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:30.694204 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-94679849-cc49-41d4-ae29-cc774266f130 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:30.716286 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-94679849-cc49-41d4-ae29-cc774266f130 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22" status: 200 len: 1317 microversion: 2.1 time: 0.936716 Oct 12 13:26:30.717228 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 607/1156] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:29 2022] GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22 => generated 1317 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:30.731414 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-22613ba2-03cb-48c4-8c8d-91b8441f448b tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1217848857", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "2ac46638-ae9e-42a4-bb0b-22f0e91dbfc8"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:30.832753 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-22613ba2-03cb-48c4-8c8d-91b8441f448b tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] validate_networks() for [('2ac46638-ae9e-42a4-bb0b-22f0e91dbfc8', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:26:30.839894 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-5097c67d-1592-4f83-b7e5-13284067def7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:30.859923 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5097c67d-1592-4f83-b7e5-13284067def7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741" status: 200 len: 1314 microversion: 2.1 time: 0.614011 Oct 12 13:26:30.861787 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 550/1157] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:30 2022] GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741 => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:30.869539 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0634b7ce-d5d9-4ce1-be22-3453c0714e31 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Action: 'update', calling method: .version_select at 0x7f8a9b935ca0>, body: {"security_group": {"name": "tempest-sg-hth-465516961", "description": "tempest-description-hth-565716641"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:31.625833 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-22613ba2-03cb-48c4-8c8d-91b8441f448b tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2f30d79c-e5a4-4811-a740-3195ca39be4f) Oct 12 13:26:31.625833 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:31.625833 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:31.625833 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:31.625833 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:31.625833 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:31.625833 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:31.625833 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:31.625833 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:31.625833 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:31.625833 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:31.625833 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:31.625833 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:31.625833 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:31.625833 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:31.625833 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:31.628430 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:31.628430 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:31.628430 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:31.628430 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:31.628430 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:31.628430 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:31.628430 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:31.628430 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:31.628430 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:31.628430 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:31.628430 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:31.628430 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:31.628430 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:31.628430 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:31.628430 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:31.628430 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:31.628430 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:31.628430 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:31.630332 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:31.630332 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:31.630332 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:31.630332 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:31.630332 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:31.630332 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:31.630332 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:31.630332 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:31.630332 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:31.630332 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:31.630332 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:31.630332 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:31.630332 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:31.630332 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:31.630332 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:31.630332 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:31.630332 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:31.630332 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:31.631712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:31.631712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:31.631712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:31.631712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:31.631712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:31.631712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:31.631712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:31.631712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:31.631712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:31.631712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:31.631712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:31.631712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:31.631712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:31.631712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:31.631712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:31.632963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2f30d79c-e5a4-4811-a740-3195ca39be4f) Oct 12 13:26:31.632963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:31.632963 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-22613ba2-03cb-48c4-8c8d-91b8441f448b tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:31.632963 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:26:31.639830 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-22613ba2-03cb-48c4-8c8d-91b8441f448b tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] Request method failure captured: Oct 12 13:26:31.639830 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:26:31.639830 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:26:31.639830 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:26:31.639830 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:26:31.639830 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 203 Oct 12 13:26:31.639830 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:26:31.639830 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:26:31.639830 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:26:31.639830 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:26:31.639830 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsBuKp2VByNdgfQrj0sMeYqojE_eczcPkIffWMyqj-Idx_zy7Z5xFTQjdVldszLkBK6xNruL0MKKC4-BfP9X2aVjFJRZ0zIBshu9L2xvXHvXOvhhepvh03I4jUVcyEv7s9lcsTTtJi_MtHKAFX-w0FG3xqUSK9fPnh_tb7vKMNTag30 Oct 12 13:26:31.639830 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:26:31.639830 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:26:31.639830 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:26:31.639830 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:26:31.639830 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:26:31.639830 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:26:31.639830 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: eeb7bf197c5c402fbb618ce9759228a0 Oct 12 13:26:31.639830 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-LiveMigrationTest-959108841 Oct 12 13:26:31.639830 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:26:31.639830 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:26:31.641524 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eeb7bf197c5c402fbb618ce9759228a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eeb7bf197c5c402fbb618ce9759228a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eeb7bf197c5c402fbb618ce9759228a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eeb7bf197c5c402fbb618ce9759228a0"}]}] Oct 12 13:26:31.641524 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-LiveMigrationTest-959108841 Oct 12 13:26:31.641524 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: eeb7bf197c5c402fbb618ce9759228a0 Oct 12 13:26:31.641524 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-LiveMigrationTest-959108841 Oct 12 13:26:31.641524 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-LiveMigrationTest-959108841-project Oct 12 13:26:31.641524 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:26:31.641524 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:26:31.641524 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: b01bb9e01bbd4feebbb3f965089245f4 Oct 12 13:26:31.641524 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-LiveMigrationTest-959108841-project Oct 12 13:26:31.641524 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:26:31.641524 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-LiveMigrationTest-server-1217848857", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "2ac46638-ae9e-42a4-bb0b-22f0e91dbfc8"}]}} Oct 12 13:26:31.641524 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:26:31.642439 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:31.642439 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:26:31.642439 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-LiveMigrationTest-server-1217848857', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '2ac46638-ae9e-42a4-bb0b-22f0e91dbfc8'}]}}} Oct 12 13:26:31.642439 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:26:31.642439 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:31.642439 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:31.642439 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:31.642439 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:31.642439 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:31.642439 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:31.642439 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:31.642439 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:31.642439 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:31.642439 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:31.642439 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:31.642439 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:31.642439 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:31.642439 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:31.642439 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:31.644186 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:31.644186 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:31.644186 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:31.644186 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:31.644186 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:31.644186 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:31.644186 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:31.644186 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:31.644186 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:31.644186 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:31.644186 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:31.644186 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:31.644186 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:31.644186 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:31.644186 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:31.644186 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:31.644186 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:31.644186 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:31.646222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:31.646222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:31.646222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:31.646222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:31.646222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:31.646222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:31.646222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:31.646222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:31.646222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:31.646222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:31.646222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:31.646222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:31.646222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:31.646222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:31.646222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:31.646222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:31.646222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:31.646222 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:31.647846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:31.647846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:31.647846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:31.647846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:31.647846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:31.647846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:31.647846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:31.647846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:31.647846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:31.647846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:31.647846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:31.647846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:31.647846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:31.647846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:31.647846 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:31.650265 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2f30d79c-e5a4-4811-a740-3195ca39be4f) Oct 12 13:26:31.650265 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:31.650265 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:31.650265 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:31.650265 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:31.650265 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:31.650265 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:31.650265 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:26:31.650265 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:26:31.650265 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:26:31.650265 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:26:31.650265 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:31.650265 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:31.650265 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:31.650265 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:31.650265 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:31.650265 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:31.650265 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:31.650265 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:31.651871 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:26:31.651871 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:26:31.651871 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:31.651871 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:31.651871 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:31.651871 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-22613ba2-03cb-48c4-8c8d-91b8441f448b tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:31.651871 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:26:31.651871 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-22613ba2-03cb-48c4-8c8d-91b8441f448b tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.926995 Oct 12 13:26:31.664341 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 608/1158] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:26:30 2022] POST /compute/v2.1/servers => generated 214 bytes in 946 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:26:31.676376 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c0dc0194-a1a0-435e-a388-e335d6f1c462 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-938282056", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "35f69b3e-54a3-4d3a-9bbb-6d43dd211917"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:31.772402 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-c0dc0194-a1a0-435e-a388-e335d6f1c462 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] validate_networks() for [('35f69b3e-54a3-4d3a-9bbb-6d43dd211917', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:26:31.782958 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0634b7ce-d5d9-4ce1-be22-3453c0714e31 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "PUT /compute/v2.1/os-security-groups/1e615d87-5346-45c0-b664-4f3ebf6e069a" status: 200 len: 216 microversion: 2.1 time: 0.914178 Oct 12 13:26:31.782958 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 551/1159] 10.222.0.52 () {60 vars in 1290 bytes} [Wed Oct 12 13:26:30 2022] PUT /compute/v2.1/os-security-groups/1e615d87-5346-45c0-b664-4f3ebf6e069a => generated 216 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:31.785187 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-6085ec5a-1c85-445c-9c54-b897ea931a3b req-25af4489-7df4-4695-9f0b-50d0b02e8c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e5ecdb4-eaf0-4b44-9a4c-e442345da741", "name": "network-vif-plugged", "status": "completed", "tag": "695f956c-e26c-42e8-9eef-abbf05e8c6fb"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:31.841642 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-6085ec5a-1c85-445c-9c54-b897ea931a3b req-25af4489-7df4-4695-9f0b-50d0b02e8c16 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:31.842124 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-6085ec5a-1c85-445c-9c54-b897ea931a3b req-25af4489-7df4-4695-9f0b-50d0b02e8c16 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:31.850555 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-6085ec5a-1c85-445c-9c54-b897ea931a3b req-25af4489-7df4-4695-9f0b-50d0b02e8c16 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:31.879808 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-6085ec5a-1c85-445c-9c54-b897ea931a3b req-25af4489-7df4-4695-9f0b-50d0b02e8c16 service nova] Creating event network-vif-plugged:695f956c-e26c-42e8-9eef-abbf05e8c6fb for instance 2e5ecdb4-eaf0-4b44-9a4c-e442345da741 on n-h1-861076-2 Oct 12 13:26:31.918036 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-6085ec5a-1c85-445c-9c54-b897ea931a3b req-25af4489-7df4-4695-9f0b-50d0b02e8c16 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136697 Oct 12 13:26:31.920646 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 552/1160] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:31.943792 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e6777529-941e-4286-8390-f93ef641da1f tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9b933d30>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:32.056364 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e6777529-941e-4286-8390-f93ef641da1f tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1464 microversion: 2.1 time: 0.130568 Oct 12 13:26:32.062128 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 553/1161] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:26:31 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1464 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:32.068767 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9f511fb7-6aa9-4ff9-849d-05fb3da2b540 tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] Action: 'create', calling method: .version_select at 0x7f8a9b935550>, body: {"keypair": {"name": "tempest-keypair-2057394471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5jPIDCCSsKk/IZovV8MUaTfcVCeb1992PE/BvCUwbXFeRWlt4rAioVgy+8qm7iPCmUcSK/+n7KcspZFLW68Pfuq1OGLcbCRHeTYQyjgyVb7kWIJ5MUCjQ8uJ/yJNi/bA=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:32.100427 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-9f511fb7-6aa9-4ff9-849d-05fb3da2b540 tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] Getting quotas for project eeb7bf197c5c402fbb618ce9759228a0. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:26:32.108551 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-9f511fb7-6aa9-4ff9-849d-05fb3da2b540 tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] Getting quotas for user b01bb9e01bbd4feebbb3f965089245f4 and project eeb7bf197c5c402fbb618ce9759228a0. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:26:32.200969 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9f511fb7-6aa9-4ff9-849d-05fb3da2b540 tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.140915 Oct 12 13:26:32.202065 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 554/1162] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:26:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:32.210926 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a8bdf449-62d4-4ca6-bbbf-bf7a7c127b6c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:32.212147 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a8bdf449-62d4-4ca6-bbbf-bf7a7c127b6c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 04ccef15-bb8d-4f4e-ac84-20c94c040b22] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:32.222710 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a8bdf449-62d4-4ca6-bbbf-bf7a7c127b6c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:32.224316 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a8bdf449-62d4-4ca6-bbbf-bf7a7c127b6c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:32.225255 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a8bdf449-62d4-4ca6-bbbf-bf7a7c127b6c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:32.226712 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a8bdf449-62d4-4ca6-bbbf-bf7a7c127b6c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:32.227564 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a8bdf449-62d4-4ca6-bbbf-bf7a7c127b6c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:32.230058 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a8bdf449-62d4-4ca6-bbbf-bf7a7c127b6c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:32.699749 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-c0dc0194-a1a0-435e-a388-e335d6f1c462 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ea8d3f0e-a1a2-41aa-85da-cb596774fb81) Oct 12 13:26:32.699749 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:32.699749 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:32.699749 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:32.699749 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:32.699749 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:32.699749 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:32.699749 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:32.699749 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:32.699749 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:32.699749 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:32.699749 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:32.699749 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:32.699749 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:32.699749 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:32.699749 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:32.701451 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:32.701451 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:32.701451 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:32.701451 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:32.701451 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:32.701451 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:32.701451 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:32.701451 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:32.701451 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:32.701451 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:32.701451 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:32.701451 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:32.701451 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:32.701451 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:32.701451 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:32.701451 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:32.701451 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:32.701451 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:32.702800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:32.702800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:32.702800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:32.702800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:32.702800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:32.702800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:32.702800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:32.702800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:32.702800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:32.702800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:32.702800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:32.702800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:32.702800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:32.702800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:32.702800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:32.702800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:32.702800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:32.702800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:32.709041 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:32.709041 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:32.709041 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:32.709041 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:32.709041 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:32.709041 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:32.709041 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:32.709041 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:32.709041 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:32.709041 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:32.709041 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:32.709041 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:32.709041 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:32.709041 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:32.709041 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ea8d3f0e-a1a2-41aa-85da-cb596774fb81) Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-c0dc0194-a1a0-435e-a388-e335d6f1c462 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c0dc0194-a1a0-435e-a388-e335d6f1c462 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Request method failure captured: Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 206 Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsB69ycY6emTEF7VKNmSiWucG5hf4zJqAS0qllNTR3QOE0HbuWc3IP0qp9UjEdcrgVVND6UpCY_jIANWKl-PFnlYhqe6aUOGKrPdzQd8B12CFMVl8o8_cfbZpEo2Q-eo-Py_qD3IXZ8-S0wAjivvd-T9o669T0CfjXP2ItDPUd8LF9Y Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 9a13e12acfc242d49d32baadf18b0fe4 Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-DeleteServersTestJSON-700119419 Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:26:32.710193 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:26:32.712176 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9a13e12acfc242d49d32baadf18b0fe4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9a13e12acfc242d49d32baadf18b0fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a13e12acfc242d49d32baadf18b0fe4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a13e12acfc242d49d32baadf18b0fe4"}]}] Oct 12 13:26:32.712176 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-DeleteServersTestJSON-700119419 Oct 12 13:26:32.712176 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 9a13e12acfc242d49d32baadf18b0fe4 Oct 12 13:26:32.712176 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-DeleteServersTestJSON-700119419 Oct 12 13:26:32.712176 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-DeleteServersTestJSON-700119419-project Oct 12 13:26:32.712176 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:26:32.712176 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:26:32.712176 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 9ca6b75658f94803bd9088aa7f23d2c8 Oct 12 13:26:32.712176 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-DeleteServersTestJSON-700119419-project Oct 12 13:26:32.712176 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:26:32.712176 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-DeleteServersTestJSON-server-938282056", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "35f69b3e-54a3-4d3a-9bbb-6d43dd211917"}]}} Oct 12 13:26:32.713017 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:26:32.713017 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:32.713017 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:26:32.713017 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-938282056', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '35f69b3e-54a3-4d3a-9bbb-6d43dd211917'}]}}} Oct 12 13:26:32.713017 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:26:32.713017 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:32.713017 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:32.713017 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:32.713017 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:32.713017 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:32.713017 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:32.713017 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:32.713017 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:32.713017 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:32.713017 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:32.713017 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:32.713017 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:32.713017 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:32.713017 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:32.714396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:32.714396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:32.714396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:32.714396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:32.714396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:32.714396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:32.714396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:32.714396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:32.714396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:32.714396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:32.714396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:32.714396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:32.714396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:32.714396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:32.714396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:32.714396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:32.714396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:32.714396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:32.715748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:32.715748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:32.715748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:32.715748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:32.715748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:32.715748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:32.715748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:32.715748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:32.715748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:32.715748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:32.715748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:32.715748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:32.715748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:32.715748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:32.715748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:32.715748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:32.715748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:32.715748 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:32.718301 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:32.718301 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:32.718301 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:32.718301 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:32.718301 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:32.718301 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:32.718301 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:32.718301 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:32.718301 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:32.718301 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:32.718301 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:32.718301 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:32.718301 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:32.718301 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:32.718301 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:32.718301 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:32.719794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ea8d3f0e-a1a2-41aa-85da-cb596774fb81) Oct 12 13:26:32.719794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:32.719794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:32.719794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:32.719794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:32.719794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:32.719794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:32.719794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:26:32.719794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:26:32.719794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:26:32.719794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:26:32.719794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:32.719794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:32.719794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:32.719794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:32.719794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:32.719794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:32.719794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:32.719794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:32.723211 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:26:32.723211 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:26:32.723211 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:32.723211 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:32.723211 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:32.723211 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c0dc0194-a1a0-435e-a388-e335d6f1c462 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:32.723211 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:26:32.723211 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c0dc0194-a1a0-435e-a388-e335d6f1c462 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.038937 Oct 12 13:26:32.723211 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 609/1163] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:26:31 2022] POST /compute/v2.1/servers => generated 214 bytes in 1051 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:26:32.729182 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-056bfd4a-9339-4a75-93af-37be80dfca45 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Calling method '.version_select at 0x7f8a9bdb1670>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:32.979339 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-056bfd4a-9339-4a75-93af-37be80dfca45 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/1e615d87-5346-45c0-b664-4f3ebf6e069a" status: 200 len: 216 microversion: 2.1 time: 0.260867 Oct 12 13:26:32.979339 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 610/1164] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 12 13:26:32 2022] GET /compute/v2.1/os-security-groups/1e615d87-5346-45c0-b664-4f3ebf6e069a => generated 216 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:32.985691 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-14e8e631-1259-493f-bfd7-3f80dfdd62a3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:32.988549 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-14e8e631-1259-493f-bfd7-3f80dfdd62a3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2e5ecdb4-eaf0-4b44-9a4c-e442345da741] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:33.000819 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-a8bdf449-62d4-4ca6-bbbf-bf7a7c127b6c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:33.008549 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-14e8e631-1259-493f-bfd7-3f80dfdd62a3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:33.009132 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-14e8e631-1259-493f-bfd7-3f80dfdd62a3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:33.009565 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-14e8e631-1259-493f-bfd7-3f80dfdd62a3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:33.010790 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-14e8e631-1259-493f-bfd7-3f80dfdd62a3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:33.011395 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-14e8e631-1259-493f-bfd7-3f80dfdd62a3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:33.012050 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-14e8e631-1259-493f-bfd7-3f80dfdd62a3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:33.017436 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a8bdf449-62d4-4ca6-bbbf-bf7a7c127b6c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22" status: 200 len: 1317 microversion: 2.1 time: 0.812279 Oct 12 13:26:33.031828 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 555/1165] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:32 2022] GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22 => generated 1317 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:33.040244 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-163c3519-e685-4c18-bdcc-202cf61d5839 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9ba05f70>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:33.119659 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-163c3519-e685-4c18-bdcc-202cf61d5839 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 200 len: 1464 microversion: 2.1 time: 0.083844 Oct 12 13:26:33.122043 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 556/1166] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:26:33 2022] GET /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 1464 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:33.139687 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-600941ad-6105-4cc0-b6a0-d1b115c7e5de tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1278397413", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "35f69b3e-54a3-4d3a-9bbb-6d43dd211917"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:33.245458 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-600941ad-6105-4cc0-b6a0-d1b115c7e5de tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] validate_networks() for [('35f69b3e-54a3-4d3a-9bbb-6d43dd211917', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:26:33.414777 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-14e8e631-1259-493f-bfd7-3f80dfdd62a3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:33.434580 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-14e8e631-1259-493f-bfd7-3f80dfdd62a3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741" status: 200 len: 1314 microversion: 2.1 time: 0.454128 Oct 12 13:26:33.435179 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 611/1167] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:32 2022] GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:33.458583 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-250b6537-995b-4c95-9d03-a6385c69f256 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Calling method '.version_select at 0x7f8a9bd014c0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:33.583397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-600941ad-6105-4cc0-b6a0-d1b115c7e5de tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-250c0d20-7f2f-4077-8938-0e3c58817486) Oct 12 13:26:33.583397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:33.583397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:33.583397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:33.583397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:33.583397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:33.583397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:33.583397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:33.583397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:33.583397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:33.583397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:33.583397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:33.583397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:33.583397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:33.583397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:33.583397 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:33.584588 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:33.584588 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:33.584588 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:33.584588 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:33.584588 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:33.584588 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:33.584588 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:33.584588 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:33.584588 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:33.584588 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:33.584588 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:33.584588 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:33.584588 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:33.584588 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:33.584588 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:33.584588 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:33.584588 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:33.584588 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:33.585911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:33.585911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:33.585911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:33.585911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:33.585911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:33.585911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:33.585911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:33.585911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:33.585911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:33.585911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:33.585911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:33.585911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:33.585911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:33.585911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:33.585911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:33.585911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:33.585911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:33.585911 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:33.587183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:33.587183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:33.587183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:33.587183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:33.587183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:33.587183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:33.587183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:33.587183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:33.587183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:33.587183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:33.587183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:33.587183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:33.587183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:33.587183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:33.587183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-250c0d20-7f2f-4077-8938-0e3c58817486) Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-600941ad-6105-4cc0-b6a0-d1b115c7e5de tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-600941ad-6105-4cc0-b6a0-d1b115c7e5de tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Request method failure captured: Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 207 Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsB69ycY6emTEF7VKNmSiWucG5hf4zJqAS0qllNTR3QOE0HbuWc3IP0qp9UjEdcrgVVND6UpCY_jIANWKl-PFnlYhqe6aUOGKrPdzQd8B12CFMVl8o8_cfbZpEo2Q-eo-Py_qD3IXZ8-S0wAjivvd-T9o669T0CfjXP2ItDPUd8LF9Y Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 9a13e12acfc242d49d32baadf18b0fe4 Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-DeleteServersTestJSON-700119419 Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:26:33.588258 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:26:33.589936 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9a13e12acfc242d49d32baadf18b0fe4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9a13e12acfc242d49d32baadf18b0fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a13e12acfc242d49d32baadf18b0fe4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a13e12acfc242d49d32baadf18b0fe4"}]}] Oct 12 13:26:33.589936 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-DeleteServersTestJSON-700119419 Oct 12 13:26:33.589936 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 9a13e12acfc242d49d32baadf18b0fe4 Oct 12 13:26:33.589936 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-DeleteServersTestJSON-700119419 Oct 12 13:26:33.589936 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-DeleteServersTestJSON-700119419-project Oct 12 13:26:33.589936 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:26:33.589936 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:26:33.589936 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 9ca6b75658f94803bd9088aa7f23d2c8 Oct 12 13:26:33.589936 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-DeleteServersTestJSON-700119419-project Oct 12 13:26:33.589936 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:26:33.589936 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-DeleteServersTestJSON-server-1278397413", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "35f69b3e-54a3-4d3a-9bbb-6d43dd211917"}]}} Oct 12 13:26:33.590789 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:26:33.590789 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:33.590789 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:26:33.590789 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-1278397413', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '35f69b3e-54a3-4d3a-9bbb-6d43dd211917'}]}}} Oct 12 13:26:33.590789 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:26:33.590789 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:33.590789 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:33.590789 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:33.590789 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:33.590789 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:33.590789 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:33.590789 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:33.590789 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:33.590789 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:33.590789 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:33.590789 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:33.590789 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:33.590789 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:33.590789 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:33.597247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:33.597247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:33.597247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:33.597247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:33.597247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:33.597247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:33.597247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:33.597247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:33.597247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:33.597247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:33.597247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:33.597247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:33.597247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:33.597247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:33.597247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:33.597247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:33.597247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:33.597247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:33.603434 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:33.603434 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:33.603434 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:33.603434 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:33.603434 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:33.603434 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:33.603434 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:33.603434 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:33.603434 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:33.603434 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:33.603434 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:33.603434 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:33.603434 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:33.603434 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:33.603434 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:33.603434 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:33.603434 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:33.603434 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:33.604812 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:33.604812 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:33.604812 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:33.604812 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:33.604812 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:33.604812 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:33.604812 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:33.604812 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:33.604812 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:33.604812 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:33.604812 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:33.604812 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:33.604812 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:33.604812 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:33.604812 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:33.604812 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:33.606126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-250c0d20-7f2f-4077-8938-0e3c58817486) Oct 12 13:26:33.606126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:33.606126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:33.606126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:33.606126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:33.606126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:33.606126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:33.606126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:26:33.606126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:26:33.606126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:26:33.606126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:26:33.606126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:33.606126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:33.606126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:33.606126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:33.606126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:33.606126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:33.606126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:33.606126 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:33.607537 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:26:33.607537 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:26:33.607537 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:33.607537 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:33.607537 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:33.607537 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-600941ad-6105-4cc0-b6a0-d1b115c7e5de tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:33.607537 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:26:33.607537 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-600941ad-6105-4cc0-b6a0-d1b115c7e5de tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.464987 Oct 12 13:26:33.607537 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 557/1168] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:26:33 2022] POST /compute/v2.1/servers => generated 214 bytes in 467 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:26:33.622881 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4e393369-0b3a-43e0-9df7-d9994f833eb8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:33.628406 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-4e393369-0b3a-43e0-9df7-d9994f833eb8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 14676667-3743-4d37-8ff9-f8d161a483d4] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:33.655161 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e393369-0b3a-43e0-9df7-d9994f833eb8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:33.655907 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e393369-0b3a-43e0-9df7-d9994f833eb8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:33.656248 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e393369-0b3a-43e0-9df7-d9994f833eb8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:33.671648 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e393369-0b3a-43e0-9df7-d9994f833eb8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:33.672450 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e393369-0b3a-43e0-9df7-d9994f833eb8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:33.672944 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e393369-0b3a-43e0-9df7-d9994f833eb8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:34.123569 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-4e393369-0b3a-43e0-9df7-d9994f833eb8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:34.134205 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4e393369-0b3a-43e0-9df7-d9994f833eb8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4" status: 200 len: 1466 microversion: 2.1 time: 0.543872 Oct 12 13:26:34.138916 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 558/1169] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:33 2022] GET /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4 => generated 1466 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:34.161722 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-bb487f31-6a4b-4a7c-b9c1-92d548fc1726 req-999ba022-9784-4d20-a421-f91cffb065c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04ccef15-bb8d-4f4e-ac84-20c94c040b22", "tag": "312993fd-3ce1-4bda-b627-09078ed03b95"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:34.180612 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-bb487f31-6a4b-4a7c-b9c1-92d548fc1726 req-999ba022-9784-4d20-a421-f91cffb065c1 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:34.181387 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-bb487f31-6a4b-4a7c-b9c1-92d548fc1726 req-999ba022-9784-4d20-a421-f91cffb065c1 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:34.182019 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-bb487f31-6a4b-4a7c-b9c1-92d548fc1726 req-999ba022-9784-4d20-a421-f91cffb065c1 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:34.194098 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-bb487f31-6a4b-4a7c-b9c1-92d548fc1726 req-999ba022-9784-4d20-a421-f91cffb065c1 service nova] Creating event network-changed:312993fd-3ce1-4bda-b627-09078ed03b95 for instance 04ccef15-bb8d-4f4e-ac84-20c94c040b22 on n-h1-861076-2 Oct 12 13:26:34.199725 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-bb487f31-6a4b-4a7c-b9c1-92d548fc1726 req-999ba022-9784-4d20-a421-f91cffb065c1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059368 Oct 12 13:26:34.201153 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 559/1170] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:34.206486 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-22dae62c-a83d-4215-acb5-56280b18293b tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-565950992", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "35f69b3e-54a3-4d3a-9bbb-6d43dd211917"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:34.276090 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-22dae62c-a83d-4215-acb5-56280b18293b tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] validate_networks() for [('35f69b3e-54a3-4d3a-9bbb-6d43dd211917', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:26:34.766949 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-250b6537-995b-4c95-9d03-a6385c69f256 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/1e615d87-5346-45c0-b664-4f3ebf6e069a" status: 202 len: 0 microversion: 2.1 time: 1.315178 Oct 12 13:26:34.767536 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 612/1171] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:26:33 2022] DELETE /compute/v2.1/os-security-groups/1e615d87-5346-45c0-b664-4f3ebf6e069a => generated 0 bytes in 1332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:26:34.773668 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fc34776e-ca49-4680-8d4f-3aed9b57d6dd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:34.774528 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-fc34776e-ca49-4680-8d4f-3aed9b57d6dd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 04ccef15-bb8d-4f4e-ac84-20c94c040b22] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:34.792556 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fc34776e-ca49-4680-8d4f-3aed9b57d6dd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:34.793129 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fc34776e-ca49-4680-8d4f-3aed9b57d6dd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:34.793566 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fc34776e-ca49-4680-8d4f-3aed9b57d6dd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:34.794377 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fc34776e-ca49-4680-8d4f-3aed9b57d6dd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:34.801370 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fc34776e-ca49-4680-8d4f-3aed9b57d6dd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:34.802735 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fc34776e-ca49-4680-8d4f-3aed9b57d6dd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:35.289297 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-fc34776e-ca49-4680-8d4f-3aed9b57d6dd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:35.301469 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fc34776e-ca49-4680-8d4f-3aed9b57d6dd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22" status: 200 len: 1317 microversion: 2.1 time: 0.530852 Oct 12 13:26:35.313092 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 613/1172] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:34 2022] GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22 => generated 1317 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:35.325406 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-39813e05-a6bf-400c-92b6-af3f094757e1 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa01d6b80>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:35.425717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-22dae62c-a83d-4215-acb5-56280b18293b tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-01af792e-b104-44bf-8dbf-247de501b81d) Oct 12 13:26:35.425717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:35.425717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:35.425717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:35.425717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:35.425717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:35.425717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:35.425717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:35.425717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:35.425717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:35.425717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:35.425717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:35.425717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:35.425717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:35.425717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:35.425717 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:35.427783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:35.427783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:35.427783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:35.427783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:35.427783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:35.427783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:35.427783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:35.427783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:35.427783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:35.427783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:35.427783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:35.427783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:35.427783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:35.427783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:35.427783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:35.427783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:35.427783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:35.427783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:35.429181 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:35.429181 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:35.429181 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:35.429181 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:35.429181 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:35.429181 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:35.429181 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:35.429181 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:35.429181 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:35.429181 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:35.429181 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:35.429181 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:35.429181 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:35.429181 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:35.429181 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:35.429181 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:35.429181 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:35.429181 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:35.430432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:35.430432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:35.430432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:35.430432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:35.430432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:35.430432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:35.430432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:35.430432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:35.430432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:35.430432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:35.430432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:35.430432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:35.430432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:35.430432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:35.430432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-01af792e-b104-44bf-8dbf-247de501b81d) Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-22dae62c-a83d-4215-acb5-56280b18293b tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-22dae62c-a83d-4215-acb5-56280b18293b tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Request method failure captured: Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 206 Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsB69ycY6emTEF7VKNmSiWucG5hf4zJqAS0qllNTR3QOE0HbuWc3IP0qp9UjEdcrgVVND6UpCY_jIANWKl-PFnlYhqe6aUOGKrPdzQd8B12CFMVl8o8_cfbZpEo2Q-eo-Py_qD3IXZ8-S0wAjivvd-T9o669T0CfjXP2ItDPUd8LF9Y Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 9a13e12acfc242d49d32baadf18b0fe4 Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-DeleteServersTestJSON-700119419 Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:26:35.432107 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:26:35.439737 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9a13e12acfc242d49d32baadf18b0fe4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9a13e12acfc242d49d32baadf18b0fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a13e12acfc242d49d32baadf18b0fe4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a13e12acfc242d49d32baadf18b0fe4"}]}] Oct 12 13:26:35.439737 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-DeleteServersTestJSON-700119419 Oct 12 13:26:35.439737 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 9a13e12acfc242d49d32baadf18b0fe4 Oct 12 13:26:35.439737 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-DeleteServersTestJSON-700119419 Oct 12 13:26:35.439737 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-DeleteServersTestJSON-700119419-project Oct 12 13:26:35.439737 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:26:35.439737 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:26:35.439737 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 9ca6b75658f94803bd9088aa7f23d2c8 Oct 12 13:26:35.439737 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-DeleteServersTestJSON-700119419-project Oct 12 13:26:35.439737 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:26:35.439737 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-DeleteServersTestJSON-server-565950992", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "35f69b3e-54a3-4d3a-9bbb-6d43dd211917"}]}} Oct 12 13:26:35.440436 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:26:35.440436 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:35.440436 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:26:35.440436 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-565950992', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '35f69b3e-54a3-4d3a-9bbb-6d43dd211917'}]}}} Oct 12 13:26:35.440436 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:26:35.440436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:35.440436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:35.440436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:35.440436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:35.440436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:35.440436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:35.440436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:35.440436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:35.440436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:35.440436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:35.440436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:35.440436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:35.440436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:35.440436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:35.441679 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:35.441679 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:35.441679 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:35.441679 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:35.441679 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:35.441679 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:35.441679 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:35.441679 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:35.441679 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:35.441679 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:35.441679 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:35.441679 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:35.441679 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:35.441679 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:35.441679 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:35.441679 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:35.441679 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:35.441679 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:35.442847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:35.442847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:35.442847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:35.442847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:35.442847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:35.442847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:35.442847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:35.442847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:35.442847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:35.442847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:35.442847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:35.442847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:35.442847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:35.442847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:35.442847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:35.442847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:35.442847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:35.442847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:35.444568 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:35.444568 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:35.444568 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:35.444568 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:35.444568 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:35.444568 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:35.444568 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:35.444568 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:35.444568 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:35.444568 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:35.444568 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:35.444568 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:35.444568 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:35.444568 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:35.444568 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:35.444568 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:35.445618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-01af792e-b104-44bf-8dbf-247de501b81d) Oct 12 13:26:35.445618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:35.445618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:35.445618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:35.445618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:35.445618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:35.445618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:35.445618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:26:35.445618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:26:35.445618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:26:35.445618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:26:35.445618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:35.445618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:35.445618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:35.445618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:35.445618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:35.445618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:35.445618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:35.445618 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:35.446803 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:26:35.446803 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:26:35.446803 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:35.446803 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:35.446803 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:35.446803 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-22dae62c-a83d-4215-acb5-56280b18293b tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:35.446803 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:26:35.446803 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-22dae62c-a83d-4215-acb5-56280b18293b tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.230491 Oct 12 13:26:35.446803 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 560/1173] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:26:34 2022] POST /compute/v2.1/servers => generated 214 bytes in 1232 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:26:35.453151 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-496672cf-1559-404d-869c-b6ea122137b7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:35.453151 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-496672cf-1559-404d-869c-b6ea122137b7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2e5ecdb4-eaf0-4b44-9a4c-e442345da741] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:35.468565 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-496672cf-1559-404d-869c-b6ea122137b7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:35.469502 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-496672cf-1559-404d-869c-b6ea122137b7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:35.471517 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-496672cf-1559-404d-869c-b6ea122137b7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:35.474858 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-496672cf-1559-404d-869c-b6ea122137b7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:35.474858 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-496672cf-1559-404d-869c-b6ea122137b7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:35.474858 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-496672cf-1559-404d-869c-b6ea122137b7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:35.482991 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-39813e05-a6bf-400c-92b6-af3f094757e1 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images?changes-since=2022-10-12T13%3A23%3A40Z" status: 200 len: 1901 microversion: 2.1 time: 0.165585 Oct 12 13:26:35.485467 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 614/1174] 10.222.0.52 () {58 vars in 1199 bytes} [Wed Oct 12 13:26:35 2022] GET /compute/v2.1/images?changes-since=2022-10-12T13%3A23%3A40Z => generated 1901 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:35.491600 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8f57aba7-0e86-4858-b6ce-c7d59a4f19f3 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Calling method '.version_select at 0x7f8a9bd1cb80>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:35.744849 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-496672cf-1559-404d-869c-b6ea122137b7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:35.754519 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-496672cf-1559-404d-869c-b6ea122137b7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741" status: 200 len: 1464 microversion: 2.1 time: 0.318316 Oct 12 13:26:35.769661 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 561/1175] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:35 2022] GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741 => generated 1464 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:35.776185 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c9d57200-7247-41e1-9766-673bab57253c tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9ba134c0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:35.882693 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c9d57200-7247-41e1-9766-673bab57253c tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1694929237" status: 200 len: 485 microversion: 2.1 time: 0.110677 Oct 12 13:26:35.884123 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 562/1176] 10.222.0.52 () {58 vars in 1231 bytes} [Wed Oct 12 13:26:35 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1694929237 => generated 485 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:35.889842 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6c9a9742-cf4e-4f85-ab28-adcf27734905 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-109047232", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "35f69b3e-54a3-4d3a-9bbb-6d43dd211917"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:35.951390 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-6c9a9742-cf4e-4f85-ab28-adcf27734905 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] validate_networks() for [('35f69b3e-54a3-4d3a-9bbb-6d43dd211917', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:26:36.039406 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-8f57aba7-0e86-4858-b6ce-c7d59a4f19f3 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/b3dbab86-e373-4dcb-a631-6b42b762e286" status: 202 len: 0 microversion: 2.1 time: 0.552645 Oct 12 13:26:36.041653 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 615/1177] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:26:35 2022] DELETE /compute/v2.1/os-security-groups/b3dbab86-e373-4dcb-a631-6b42b762e286 => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:26:36.047450 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-87d7a012-a00f-4e09-9caa-f4e87d6ef57d tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:36.048314 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-87d7a012-a00f-4e09-9caa-f4e87d6ef57d tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:36.085292 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-87d7a012-a00f-4e09-9caa-f4e87d6ef57d tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:36.090349 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-87d7a012-a00f-4e09-9caa-f4e87d6ef57d tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:36.091094 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-87d7a012-a00f-4e09-9caa-f4e87d6ef57d tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:36.092690 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-87d7a012-a00f-4e09-9caa-f4e87d6ef57d tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:36.093455 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-87d7a012-a00f-4e09-9caa-f4e87d6ef57d tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:36.096391 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-87d7a012-a00f-4e09-9caa-f4e87d6ef57d tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:36.269653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-6c9a9742-cf4e-4f85-ab28-adcf27734905 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c253d895-badd-48e5-83a3-2582ac37faac) Oct 12 13:26:36.269653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:36.269653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:36.269653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:36.269653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:36.269653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:36.269653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:36.269653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:36.269653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:36.269653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:36.269653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:36.269653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:36.269653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:36.269653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:36.269653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:36.269653 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:36.270859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:36.270859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:36.270859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:36.270859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:36.270859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:36.270859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:36.270859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:36.270859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:36.270859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:36.270859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:36.270859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:36.270859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:36.270859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:36.270859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:36.270859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:36.270859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:36.270859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:36.270859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:36.272235 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:36.272235 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:36.272235 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:36.272235 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:36.272235 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:36.272235 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:36.272235 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:36.272235 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:36.272235 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:36.272235 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:36.272235 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:36.272235 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:36.272235 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:36.272235 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:36.272235 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:36.272235 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:36.272235 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:36.272235 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:36.281959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:36.281959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:36.281959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:36.281959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:36.281959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:36.281959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:36.281959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:36.281959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:36.281959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:36.281959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:36.281959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:36.281959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:36.281959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:36.281959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:36.281959 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c253d895-badd-48e5-83a3-2582ac37faac) Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-6c9a9742-cf4e-4f85-ab28-adcf27734905 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6c9a9742-cf4e-4f85-ab28-adcf27734905 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Request method failure captured: Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 206 Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsB69ycY6emTEF7VKNmSiWucG5hf4zJqAS0qllNTR3QOE0HbuWc3IP0qp9UjEdcrgVVND6UpCY_jIANWKl-PFnlYhqe6aUOGKrPdzQd8B12CFMVl8o8_cfbZpEo2Q-eo-Py_qD3IXZ8-S0wAjivvd-T9o669T0CfjXP2ItDPUd8LF9Y Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 9a13e12acfc242d49d32baadf18b0fe4 Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-DeleteServersTestJSON-700119419 Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:26:36.284315 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:26:36.292579 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9a13e12acfc242d49d32baadf18b0fe4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9a13e12acfc242d49d32baadf18b0fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a13e12acfc242d49d32baadf18b0fe4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a13e12acfc242d49d32baadf18b0fe4"}]}] Oct 12 13:26:36.292579 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-DeleteServersTestJSON-700119419 Oct 12 13:26:36.292579 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 9a13e12acfc242d49d32baadf18b0fe4 Oct 12 13:26:36.292579 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-DeleteServersTestJSON-700119419 Oct 12 13:26:36.292579 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-DeleteServersTestJSON-700119419-project Oct 12 13:26:36.292579 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:26:36.292579 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:26:36.292579 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 9ca6b75658f94803bd9088aa7f23d2c8 Oct 12 13:26:36.292579 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-DeleteServersTestJSON-700119419-project Oct 12 13:26:36.292579 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:26:36.292579 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-DeleteServersTestJSON-server-109047232", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "35f69b3e-54a3-4d3a-9bbb-6d43dd211917"}]}} Oct 12 13:26:36.294881 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:26:36.294881 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:36.294881 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:26:36.294881 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-109047232', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '35f69b3e-54a3-4d3a-9bbb-6d43dd211917'}]}}} Oct 12 13:26:36.294881 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:26:36.294881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:36.294881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:36.294881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:36.294881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:36.294881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:36.294881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:36.294881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:36.294881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:36.294881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:36.294881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:36.294881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:36.294881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:36.294881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:36.294881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:36.302672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:36.302672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:36.302672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:36.302672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:36.302672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:36.302672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:36.302672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:36.302672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:36.302672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:36.302672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:36.302672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:36.302672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:36.302672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:36.302672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:36.302672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:36.302672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:36.302672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:36.302672 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:36.304064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:36.304064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:36.304064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:36.304064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:36.304064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:36.304064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:36.304064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:36.304064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:36.304064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:36.304064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:36.304064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:36.304064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:36.304064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:36.304064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:36.304064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:36.304064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:36.304064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:36.304064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:36.305601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:36.305601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:36.305601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:36.305601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:36.305601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:36.305601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:36.305601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:36.305601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:36.305601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:36.305601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:36.305601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:36.305601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:36.305601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:36.305601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:36.305601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:36.305601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:36.306816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c253d895-badd-48e5-83a3-2582ac37faac) Oct 12 13:26:36.306816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:36.306816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:36.306816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:36.306816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:36.306816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:36.306816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:36.306816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:26:36.306816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:26:36.306816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:26:36.306816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:26:36.306816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:36.306816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:36.306816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:36.306816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:36.306816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:36.306816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:36.306816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:36.306816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:36.308264 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:26:36.308264 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:26:36.308264 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:36.308264 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:36.308264 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:36.308264 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6c9a9742-cf4e-4f85-ab28-adcf27734905 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:36.308264 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:26:36.308264 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6c9a9742-cf4e-4f85-ab28-adcf27734905 tempest-DeleteServersTestJSON-700119419 tempest-DeleteServersTestJSON-700119419-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.389441 Oct 12 13:26:36.308264 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 563/1178] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:26:35 2022] POST /compute/v2.1/servers => generated 214 bytes in 392 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:26:36.308264 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ded287d1-d614-440f-9056-990b6046b493 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9be700d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:36.461848 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ded287d1-d614-440f-9056-990b6046b493 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images?server=14676667-3743-4d37-8ff9-f8d161a483d4" status: 200 len: 957 microversion: 2.1 time: 0.184045 Oct 12 13:26:36.462503 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 564/1179] 10.222.0.52 () {58 vars in 1209 bytes} [Wed Oct 12 13:26:36 2022] GET /compute/v2.1/images?server=14676667-3743-4d37-8ff9-f8d161a483d4 => generated 957 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:36.478949 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a12b8120-88c4-493c-9e70-db941df88630 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Calling method '.version_select at 0x7f8a9b9f9820>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:36.580297 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-87d7a012-a00f-4e09-9caa-f4e87d6ef57d tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:36.596930 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-87d7a012-a00f-4e09-9caa-f4e87d6ef57d tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1463 microversion: 2.1 time: 0.553546 Oct 12 13:26:36.599995 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 616/1180] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:36 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1463 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:36.625223 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1ed2324e-2910-4b54-bfa2-52cf5946f8ab tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:36.635753 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-1ed2324e-2910-4b54-bfa2-52cf5946f8ab tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 04ccef15-bb8d-4f4e-ac84-20c94c040b22] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:36.650619 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1ed2324e-2910-4b54-bfa2-52cf5946f8ab tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:36.650619 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1ed2324e-2910-4b54-bfa2-52cf5946f8ab tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:36.651377 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1ed2324e-2910-4b54-bfa2-52cf5946f8ab tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:36.652341 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1ed2324e-2910-4b54-bfa2-52cf5946f8ab tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:36.653373 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1ed2324e-2910-4b54-bfa2-52cf5946f8ab tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:36.653963 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1ed2324e-2910-4b54-bfa2-52cf5946f8ab tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:37.175121 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-1ed2324e-2910-4b54-bfa2-52cf5946f8ab tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:37.185043 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1ed2324e-2910-4b54-bfa2-52cf5946f8ab tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22" status: 200 len: 1317 microversion: 2.1 time: 0.583620 Oct 12 13:26:37.186082 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 617/1181] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:36 2022] GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22 => generated 1317 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:37.191399 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-5a518f0d-e287-4937-9295-4b74f9cabda4 req-e35dee5e-80bd-4914-8221-01a363ddb143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14676667-3743-4d37-8ff9-f8d161a483d4", "name": "network-vif-unplugged", "status": "completed", "tag": "5170297d-0d3f-4e69-aa8a-6c0e40750532"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:37.202355 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-5a518f0d-e287-4937-9295-4b74f9cabda4 req-e35dee5e-80bd-4914-8221-01a363ddb143 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:37.203055 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-5a518f0d-e287-4937-9295-4b74f9cabda4 req-e35dee5e-80bd-4914-8221-01a363ddb143 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:37.203497 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-5a518f0d-e287-4937-9295-4b74f9cabda4 req-e35dee5e-80bd-4914-8221-01a363ddb143 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:37.215788 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-5a518f0d-e287-4937-9295-4b74f9cabda4 req-e35dee5e-80bd-4914-8221-01a363ddb143 service nova] Creating event network-vif-unplugged:5170297d-0d3f-4e69-aa8a-6c0e40750532 for instance 14676667-3743-4d37-8ff9-f8d161a483d4 on n-h2-861076-2 Oct 12 13:26:37.221410 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-5a518f0d-e287-4937-9295-4b74f9cabda4 req-e35dee5e-80bd-4914-8221-01a363ddb143 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033869 Oct 12 13:26:37.222699 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 618/1182] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:37.229309 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-eaa5c46a-bda2-4654-9e17-230936fd3042 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa0321040>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:37.330179 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-eaa5c46a-bda2-4654-9e17-230936fd3042 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2F5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 200 len: 484 microversion: 2.1 time: 0.105856 Oct 12 13:26:37.331414 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 619/1183] 10.222.0.52 () {58 vars in 1317 bytes} [Wed Oct 12 13:26:37 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2F5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 484 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:37.362983 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a12b8120-88c4-493c-9e70-db941df88630 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/e7633ece-410e-4001-867e-c1def18e9e39" status: 202 len: 0 microversion: 2.1 time: 0.899490 Oct 12 13:26:37.365359 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 565/1184] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:26:36 2022] DELETE /compute/v2.1/os-security-groups/e7633ece-410e-4001-867e-c1def18e9e39 => generated 0 bytes in 901 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:26:37.371837 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-97e6a3e0-5937-4f57-be64-a2cb24886874 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1607265498", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "3fbda837-cf92-4aa6-8551-96cd4a3f1b80"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:37.441723 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-10871c3f-3982-4562-8f4c-ebf0730e8203 tempest-FloatingIPsAssociationTestJSON-497429976 tempest-FloatingIPsAssociationTestJSON-497429976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2033527201", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "fb171f31-c4d0-42f0-8fa4-e389a7d02a28"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:37.458061 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-97e6a3e0-5937-4f57-be64-a2cb24886874 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] validate_networks() for None {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:26:37.548540 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-10871c3f-3982-4562-8f4c-ebf0730e8203 tempest-FloatingIPsAssociationTestJSON-497429976 tempest-FloatingIPsAssociationTestJSON-497429976-project] validate_networks() for [('fb171f31-c4d0-42f0-8fa4-e389a7d02a28', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:26:38.221321 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-97e6a3e0-5937-4f57-be64-a2cb24886874 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:26:38.222261 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-97e6a3e0-5937-4f57-be64-a2cb24886874 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:26:38.222915 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-97e6a3e0-5937-4f57-be64-a2cb24886874 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:26:38.223516 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-97e6a3e0-5937-4f57-be64-a2cb24886874 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:26:38.224220 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-97e6a3e0-5937-4f57-be64-a2cb24886874 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:26:38.229655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-10871c3f-3982-4562-8f4c-ebf0730e8203 tempest-FloatingIPsAssociationTestJSON-497429976 tempest-FloatingIPsAssociationTestJSON-497429976-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5a54fbb1-75e9-4a65-b6d2-f6fec39e51ab) Oct 12 13:26:38.229655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:38.229655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:38.229655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:38.229655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:38.229655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:38.229655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:38.229655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:38.229655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:38.229655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:38.229655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:38.229655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:38.229655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:38.229655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:38.229655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:38.229655 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:38.231239 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:38.231239 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:38.231239 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:38.231239 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:38.231239 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:38.231239 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:38.231239 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:38.231239 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:38.231239 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:38.231239 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:38.231239 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:38.231239 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:38.231239 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:38.231239 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:38.231239 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:38.231239 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:38.231239 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:38.231239 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:38.232852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:38.232852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:38.232852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:38.232852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:38.232852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:38.232852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:38.232852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:38.232852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:38.232852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:38.232852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:38.232852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:38.232852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:38.232852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:38.232852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:38.232852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:38.232852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:38.232852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:38.232852 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:38.234312 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:38.234312 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:38.234312 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:38.234312 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:38.234312 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:38.234312 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:38.234312 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:38.234312 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:38.234312 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:38.234312 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:38.234312 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:38.234312 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:38.234312 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:38.234312 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:38.234312 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5a54fbb1-75e9-4a65-b6d2-f6fec39e51ab) Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-10871c3f-3982-4562-8f4c-ebf0730e8203 tempest-FloatingIPsAssociationTestJSON-497429976 tempest-FloatingIPsAssociationTestJSON-497429976-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-10871c3f-3982-4562-8f4c-ebf0730e8203 tempest-FloatingIPsAssociationTestJSON-497429976 tempest-FloatingIPsAssociationTestJSON-497429976-project] Request method failure captured: Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 216 Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsCM286rwUbsZNcHWJ-rfm9dWxltRVx3hiOsTf85MBR2op2Tv0J9449VTJZe5sUi8v_syLxHG9njUHlA4Vk6YkKRLm4t2Cj9n3ywkfMSGVn2aM_5mIs6lIlrG_FG4yUtVnD6TX-xGoDf4m8k1dckfyrG0iQ5m1EotIR1pjapoaB0QVo Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 30c0da95afa94f3e97fcb1fd207c442f Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-497429976 Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:26:38.235710 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:26:38.237661 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/30c0da95afa94f3e97fcb1fd207c442f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_30c0da95afa94f3e97fcb1fd207c442f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/30c0da95afa94f3e97fcb1fd207c442f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/30c0da95afa94f3e97fcb1fd207c442f"}]}] Oct 12 13:26:38.237661 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-497429976 Oct 12 13:26:38.237661 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 30c0da95afa94f3e97fcb1fd207c442f Oct 12 13:26:38.237661 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-497429976 Oct 12 13:26:38.237661 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-FloatingIPsAssociationTestJSON-497429976-project Oct 12 13:26:38.237661 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:26:38.237661 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:26:38.237661 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: e27b6b8e9a0d43cfb32b5241717d2975 Oct 12 13:26:38.237661 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-497429976-project Oct 12 13:26:38.237661 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:26:38.237661 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2033527201", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "fb171f31-c4d0-42f0-8fa4-e389a7d02a28"}]}} Oct 12 13:26:38.238795 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:26:38.238795 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:38.238795 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:26:38.238795 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-FloatingIPsAssociationTestJSON-server-2033527201', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': 'fb171f31-c4d0-42f0-8fa4-e389a7d02a28'}]}}} Oct 12 13:26:38.238795 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:26:38.238795 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:38.238795 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:38.238795 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:38.238795 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:38.238795 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:38.238795 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:38.238795 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:38.238795 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:38.238795 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:38.238795 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:38.238795 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:38.238795 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:38.238795 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:38.238795 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:38.240282 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:38.240282 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:38.240282 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:38.240282 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:38.240282 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:38.240282 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:38.240282 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:38.240282 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:38.240282 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:38.240282 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:38.240282 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:38.240282 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:38.240282 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:38.240282 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:38.240282 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:38.240282 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:38.240282 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:38.240282 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:38.243042 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:38.243042 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:38.243042 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:38.243042 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:38.243042 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:38.243042 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:38.243042 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:38.243042 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:38.243042 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:38.243042 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:38.243042 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:38.243042 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:38.243042 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:38.243042 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:38.243042 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:38.243042 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:38.243042 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:38.243042 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:38.244437 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:38.244437 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:38.244437 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:38.244437 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:38.244437 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:38.244437 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:38.244437 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:38.244437 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:38.244437 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:38.244437 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:38.244437 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:38.244437 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:38.244437 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:38.244437 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:38.244437 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:38.244437 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:38.246660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5a54fbb1-75e9-4a65-b6d2-f6fec39e51ab) Oct 12 13:26:38.246660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:38.246660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:38.246660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:38.246660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:38.246660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:38.246660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:38.246660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:26:38.246660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:26:38.246660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:26:38.246660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:26:38.246660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:38.246660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:38.246660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:38.246660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:38.246660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:38.246660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:38.246660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:38.246660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:38.248046 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:26:38.248046 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:26:38.248046 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:38.248046 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:38.248046 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:38.248046 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-10871c3f-3982-4562-8f4c-ebf0730e8203 tempest-FloatingIPsAssociationTestJSON-497429976 tempest-FloatingIPsAssociationTestJSON-497429976-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:38.248046 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:26:38.248046 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-10871c3f-3982-4562-8f4c-ebf0730e8203 tempest-FloatingIPsAssociationTestJSON-497429976 tempest-FloatingIPsAssociationTestJSON-497429976-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.902107 Oct 12 13:26:38.248654 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97e6a3e0-5937-4f57-be64-a2cb24886874 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:38.248654 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97e6a3e0-5937-4f57-be64-a2cb24886874 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:38.248654 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97e6a3e0-5937-4f57-be64-a2cb24886874 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:38.248654 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97e6a3e0-5937-4f57-be64-a2cb24886874 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:38.249014 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97e6a3e0-5937-4f57-be64-a2cb24886874 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:38.249115 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 620/1185] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:26:37 2022] POST /compute/v2.1/servers => generated 214 bytes in 916 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:26:38.249205 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97e6a3e0-5937-4f57-be64-a2cb24886874 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:38.259542 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-996df13f-27c4-4e3f-9749-74f56dc7cdce tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa01d6b80>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:38.310747 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-97e6a3e0-5937-4f57-be64-a2cb24886874 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Getting quotas for project 2bb790004fd34993aeee9b0f5820b798. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:26:38.326468 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-97e6a3e0-5937-4f57-be64-a2cb24886874 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Getting quotas for user aecb9d3ecf9d4f29bc40f00736887149 and project 2bb790004fd34993aeee9b0f5820b798. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:26:38.348930 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-996df13f-27c4-4e3f-9749-74f56dc7cdce tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2F5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 200 len: 484 microversion: 2.1 time: 0.099333 Oct 12 13:26:38.349079 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-97e6a3e0-5937-4f57-be64-a2cb24886874 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:26:38.349787 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 621/1186] 10.222.0.52 () {58 vars in 1303 bytes} [Wed Oct 12 13:26:38 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2F5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 484 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:38.351630 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-97e6a3e0-5937-4f57-be64-a2cb24886874 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2d3ddb28-5b74-43dc-9579-d48a61b6d24e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:26:38.369893 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e7e7e65b-d9b4-4c84-8ba1-26eadf26c5d5 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Calling method '.version_select at 0x7f8a9bd013a0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:38.379579 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:26:38.485678 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-97e6a3e0-5937-4f57-be64-a2cb24886874 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.120266 Oct 12 13:26:38.492935 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 566/1187] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:26:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 13:26:38.496413 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2304273b-4151-4526-ad26-aa79cdf7821c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:38.499926 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2304273b-4151-4526-ad26-aa79cdf7821c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 04ccef15-bb8d-4f4e-ac84-20c94c040b22] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:38.515338 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2304273b-4151-4526-ad26-aa79cdf7821c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:38.517433 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2304273b-4151-4526-ad26-aa79cdf7821c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:38.517895 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2304273b-4151-4526-ad26-aa79cdf7821c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:38.518646 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2304273b-4151-4526-ad26-aa79cdf7821c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:38.519134 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2304273b-4151-4526-ad26-aa79cdf7821c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:38.519527 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2304273b-4151-4526-ad26-aa79cdf7821c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:38.838912 n-d-861076-2 devstack@n-api.service[120933]: DEBUG neutronclient.v2_0.client [None req-e7e7e65b-d9b4-4c84-8ba1-26eadf26c5d5 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725 does not exist", "detail": ""}} {{(pid=120933) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 13:26:38.839514 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.security_group_api [None req-e7e7e65b-d9b4-4c84-8ba1-26eadf26c5d5 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Neutron security group c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725 not found {{(pid=120933) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 13:26:38.840041 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-e7e7e65b-d9b4-4c84-8ba1-26eadf26c5d5 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] HTTP exception thrown: Security group c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725 does not exist Oct 12 13:26:38.840041 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-b2d9ff00-be41-4d5c-9259-fab88d0f4cc3'] Oct 12 13:26:38.841933 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e7e7e65b-d9b4-4c84-8ba1-26eadf26c5d5 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Request method failure captured: Oct 12 13:26:38.841933 n-d-861076-2 devstack@n-api.service[120933]: request: DELETE /compute/v2.1/os-security-groups/c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725 HTTP/1.1 Oct 12 13:26:38.841933 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:26:38.841933 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:26:38.841933 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:26:38.841933 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:26:38.841933 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:26:38.841933 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:26:38.841933 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:26:38.841933 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:26:38.841933 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsBdL7wyincMMZQwWVO4VXZ12yGjskbZB6RbMosVFiO3AhWsk3p3j49O8SLUIedaHGcczd4m4MpzaMoMcOa6aCWbbQi-5ZIc3ZUEa1lJskMXmN8Nc0ijYn_Q7UvKQVQkq2YKbmWhYhuHg_-gF1WghqCfIW01OCPDumgGkHJGO6VVHFs Oct 12 13:26:38.841933 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:26:38.841933 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:26:38.841933 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:26:38.841933 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:26:38.841933 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:26:38.841933 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:26:38.841933 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 3399cf92fd65427b8652320be1e501ad Oct 12 13:26:38.841933 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:38.841933 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:26:38.841933 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:26:38.843314 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3399cf92fd65427b8652320be1e501ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3399cf92fd65427b8652320be1e501ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3399cf92fd65427b8652320be1e501ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3399cf92fd65427b8652320be1e501ad"}]}] Oct 12 13:26:38.843314 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:38.843314 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 3399cf92fd65427b8652320be1e501ad Oct 12 13:26:38.843314 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:38.843314 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-SecurityGroupsTestJSON-1263036119-project Oct 12 13:26:38.843314 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:26:38.843314 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:26:38.843314 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 21315dd58bd4461bb41c70ccdfd27d47 Oct 12 13:26:38.843314 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-SecurityGroupsTestJSON-1263036119-project Oct 12 13:26:38.843314 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:26:38.843314 n-d-861076-2 devstack@n-api.service[120933]: exception: Security group c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725 does not exist Oct 12 13:26:38.843314 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-b2d9ff00-be41-4d5c-9259-fab88d0f4cc3'] Oct 12 13:26:38.843314 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725'} Oct 12 13:26:38.844124 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:26:38.844124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:38.844124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 13:26:38.844124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 13:26:38.844124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:38.844124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:38.844124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 13:26:38.844124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 13:26:38.844124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:38.844124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:38.844124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:38.844124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:38.844124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:38.844124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:38.844124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:38.844124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:38.844124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:38.844124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:38.844124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 13:26:38.847511 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 13:26:38.847511 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:38.847511 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:38.847511 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 13:26:38.847511 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 13:26:38.847511 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 13:26:38.847511 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 13:26:38.847511 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725 does not exist Oct 12 13:26:38.847511 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2d9ff00-be41-4d5c-9259-fab88d0f4cc3'] Oct 12 13:26:38.847511 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:38.847511 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:38.847511 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:38.847511 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:38.847511 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 13:26:38.847511 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 13:26:38.847511 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 13:26:38.847511 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 13:26:38.847511 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725 does not exist Oct 12 13:26:38.849352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2d9ff00-be41-4d5c-9259-fab88d0f4cc3'] Oct 12 13:26:38.849352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:38.849352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:38.849352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:38.849352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:38.849352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:38.849352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:38.849352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:26:38.849352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:26:38.849352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:26:38.849352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:26:38.849352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:38.849352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:38.849352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 13:26:38.849352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 13:26:38.849352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725 does not exist Oct 12 13:26:38.849352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2d9ff00-be41-4d5c-9259-fab88d0f4cc3'] Oct 12 13:26:38.849352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:38.849352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:38.849352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:38.849352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:38.850634 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:38.850634 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:38.850634 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:26:38.850634 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:26:38.850634 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725 does not exist Oct 12 13:26:38.850634 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2d9ff00-be41-4d5c-9259-fab88d0f4cc3'] Oct 12 13:26:38.850634 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:38.850634 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e7e7e65b-d9b4-4c84-8ba1-26eadf26c5d5 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Returning 404 to user: Security group c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725 does not exist Oct 12 13:26:38.850634 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-b2d9ff00-be41-4d5c-9259-fab88d0f4cc3'] {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:26:38.850634 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e7e7e65b-d9b4-4c84-8ba1-26eadf26c5d5 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725" status: 404 len: 194 microversion: 2.1 time: 0.479159 Oct 12 13:26:38.850634 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 622/1188] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:26:38 2022] DELETE /compute/v2.1/os-security-groups/c5c5cfc5-c94d-4c8c-a9ec-626bfe0d9725 => generated 194 bytes in 494 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:26:38.856585 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-af61436d-8aef-4a6d-a984-ee5a4900f1b6 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa03f3f70>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:39.063694 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-af61436d-8aef-4a6d-a984-ee5a4900f1b6 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.218718 Oct 12 13:26:39.064293 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 623/1189] 10.222.0.52 () {58 vars in 1149 bytes} [Wed Oct 12 13:26:38 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:39.097197 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1f8d117d-508b-46cc-b22b-67ebaf8b62e6 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:39.106000 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-1f8d117d-508b-46cc-b22b-67ebaf8b62e6 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2d3ddb28-5b74-43dc-9579-d48a61b6d24e] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:39.217218 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-2304273b-4151-4526-ad26-aa79cdf7821c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:39.230312 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2304273b-4151-4526-ad26-aa79cdf7821c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22" status: 200 len: 1317 microversion: 2.1 time: 0.740547 Oct 12 13:26:39.231605 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 567/1190] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:38 2022] GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22 => generated 1317 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:39.249834 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3fe9f44d-72ce-47b5-9b23-16123cf12eac tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Calling method '.version_select at 0x7f8a9ba424c0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:39.261743 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-1f8d117d-508b-46cc-b22b-67ebaf8b62e6 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:39.271774 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1f8d117d-508b-46cc-b22b-67ebaf8b62e6 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e" status: 200 len: 1214 microversion: 2.1 time: 0.206420 Oct 12 13:26:39.273172 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 624/1191] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:39 2022] GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e => generated 1214 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:39.277985 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5224d7da-55ca-46b9-9c92-1e23b1c16cd9 tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1971969160", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "2ac46638-ae9e-42a4-bb0b-22f0e91dbfc8"}], "security_groups": [{"name": "tempest-securitygroup--1334491825"}], "key_name": "tempest-keypair-2057394471", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:39.304824 n-d-861076-2 devstack@n-api.service[120932]: DEBUG neutronclient.v2_0.client [None req-3fe9f44d-72ce-47b5-9b23-16123cf12eac tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cb6601ae-389a-4077-aa94-e24f671cb79a does not exist", "detail": ""}} {{(pid=120932) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 13:26:39.305832 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.security_group_api [None req-3fe9f44d-72ce-47b5-9b23-16123cf12eac tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Neutron security group cb6601ae-389a-4077-aa94-e24f671cb79a not found {{(pid=120932) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 13:26:39.306583 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-3fe9f44d-72ce-47b5-9b23-16123cf12eac tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] HTTP exception thrown: Security group cb6601ae-389a-4077-aa94-e24f671cb79a does not exist Oct 12 13:26:39.306583 n-d-861076-2 devstack@n-api.service[120932]: Neutron server returns request_ids: ['req-c239880d-3bdb-4b4a-8904-a256f7123535'] Oct 12 13:26:39.310878 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3fe9f44d-72ce-47b5-9b23-16123cf12eac tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Request method failure captured: Oct 12 13:26:39.310878 n-d-861076-2 devstack@n-api.service[120932]: request: DELETE /compute/v2.1/os-security-groups/cb6601ae-389a-4077-aa94-e24f671cb79a HTTP/1.1 Oct 12 13:26:39.310878 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:26:39.310878 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:26:39.310878 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:26:39.310878 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:26:39.310878 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:26:39.310878 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:26:39.310878 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:26:39.310878 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:26:39.310878 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsBdL7wyincMMZQwWVO4VXZ12yGjskbZB6RbMosVFiO3AhWsk3p3j49O8SLUIedaHGcczd4m4MpzaMoMcOa6aCWbbQi-5ZIc3ZUEa1lJskMXmN8Nc0ijYn_Q7UvKQVQkq2YKbmWhYhuHg_-gF1WghqCfIW01OCPDumgGkHJGO6VVHFs Oct 12 13:26:39.310878 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:26:39.310878 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:26:39.310878 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:26:39.310878 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:26:39.310878 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:26:39.310878 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:26:39.310878 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 3399cf92fd65427b8652320be1e501ad Oct 12 13:26:39.310878 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:39.310878 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:26:39.310878 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:26:39.314374 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3399cf92fd65427b8652320be1e501ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3399cf92fd65427b8652320be1e501ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3399cf92fd65427b8652320be1e501ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3399cf92fd65427b8652320be1e501ad"}]}] Oct 12 13:26:39.314374 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:39.314374 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 3399cf92fd65427b8652320be1e501ad Oct 12 13:26:39.314374 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:39.314374 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-SecurityGroupsTestJSON-1263036119-project Oct 12 13:26:39.314374 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:26:39.314374 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:26:39.314374 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 21315dd58bd4461bb41c70ccdfd27d47 Oct 12 13:26:39.314374 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-SecurityGroupsTestJSON-1263036119-project Oct 12 13:26:39.314374 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:26:39.314374 n-d-861076-2 devstack@n-api.service[120932]: exception: Security group cb6601ae-389a-4077-aa94-e24f671cb79a does not exist Oct 12 13:26:39.314374 n-d-861076-2 devstack@n-api.service[120932]: Neutron server returns request_ids: ['req-c239880d-3bdb-4b4a-8904-a256f7123535'] Oct 12 13:26:39.314374 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'cb6601ae-389a-4077-aa94-e24f671cb79a'} Oct 12 13:26:39.315214 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:26:39.315214 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:39.315214 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 13:26:39.315214 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 13:26:39.315214 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:39.315214 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:39.315214 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 13:26:39.315214 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 13:26:39.315214 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:39.315214 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:39.315214 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:39.315214 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:39.315214 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:39.315214 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:39.315214 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:39.315214 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:39.315214 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:39.315214 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:39.315214 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 13:26:39.316482 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 13:26:39.316482 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:39.316482 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:39.316482 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 13:26:39.316482 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 13:26:39.316482 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 13:26:39.316482 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 13:26:39.316482 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cb6601ae-389a-4077-aa94-e24f671cb79a does not exist Oct 12 13:26:39.316482 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c239880d-3bdb-4b4a-8904-a256f7123535'] Oct 12 13:26:39.316482 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:39.316482 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:39.316482 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:39.316482 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:39.316482 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 13:26:39.316482 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 13:26:39.316482 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 13:26:39.316482 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 13:26:39.316482 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cb6601ae-389a-4077-aa94-e24f671cb79a does not exist Oct 12 13:26:39.317863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c239880d-3bdb-4b4a-8904-a256f7123535'] Oct 12 13:26:39.317863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:39.317863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:39.317863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:39.317863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:39.317863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:39.317863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:39.317863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:26:39.317863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:26:39.317863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:26:39.317863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:26:39.317863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:39.317863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:39.317863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 13:26:39.317863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 13:26:39.317863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cb6601ae-389a-4077-aa94-e24f671cb79a does not exist Oct 12 13:26:39.317863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c239880d-3bdb-4b4a-8904-a256f7123535'] Oct 12 13:26:39.317863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:39.317863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:39.317863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:39.317863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:39.319329 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:39.319329 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:39.319329 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:26:39.319329 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:26:39.319329 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cb6601ae-389a-4077-aa94-e24f671cb79a does not exist Oct 12 13:26:39.319329 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c239880d-3bdb-4b4a-8904-a256f7123535'] Oct 12 13:26:39.319329 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:39.319329 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3fe9f44d-72ce-47b5-9b23-16123cf12eac tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Returning 404 to user: Security group cb6601ae-389a-4077-aa94-e24f671cb79a does not exist Oct 12 13:26:39.319329 n-d-861076-2 devstack@n-api.service[120932]: Neutron server returns request_ids: ['req-c239880d-3bdb-4b4a-8904-a256f7123535'] {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:26:39.319329 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3fe9f44d-72ce-47b5-9b23-16123cf12eac tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/cb6601ae-389a-4077-aa94-e24f671cb79a" status: 404 len: 194 microversion: 2.1 time: 0.079415 Oct 12 13:26:39.320357 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 568/1192] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:26:39 2022] DELETE /compute/v2.1/os-security-groups/cb6601ae-389a-4077-aa94-e24f671cb79a => generated 194 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:26:39.346709 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6a62ab3a-0ac6-4497-bba1-14797454c1ba tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9ba51310>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:39.426499 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6a62ab3a-0ac6-4497-bba1-14797454c1ba tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.105294 Oct 12 13:26:39.427342 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 569/1193] 10.222.0.52 () {58 vars in 1149 bytes} [Wed Oct 12 13:26:39 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:39.441276 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7f624831-225f-4e61-be2a-fb28c5f7abd9 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Calling method '.version_select at 0x7f8a9b933c10>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:39.503066 n-d-861076-2 devstack@n-api.service[120932]: DEBUG neutronclient.v2_0.client [None req-7f624831-225f-4e61-be2a-fb28c5f7abd9 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9d6d1949-9d67-49e0-b14f-17f75af8d3d7 does not exist", "detail": ""}} {{(pid=120932) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 13:26:39.503887 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.security_group_api [None req-7f624831-225f-4e61-be2a-fb28c5f7abd9 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Neutron security group 9d6d1949-9d67-49e0-b14f-17f75af8d3d7 not found {{(pid=120932) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 13:26:39.504643 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-7f624831-225f-4e61-be2a-fb28c5f7abd9 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] HTTP exception thrown: Security group 9d6d1949-9d67-49e0-b14f-17f75af8d3d7 does not exist Oct 12 13:26:39.504643 n-d-861076-2 devstack@n-api.service[120932]: Neutron server returns request_ids: ['req-05875ebf-d4eb-4f7e-8022-ded0451868f8'] Oct 12 13:26:39.506583 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7f624831-225f-4e61-be2a-fb28c5f7abd9 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Request method failure captured: Oct 12 13:26:39.506583 n-d-861076-2 devstack@n-api.service[120932]: request: DELETE /compute/v2.1/os-security-groups/9d6d1949-9d67-49e0-b14f-17f75af8d3d7 HTTP/1.1 Oct 12 13:26:39.506583 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:26:39.506583 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:26:39.506583 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:26:39.506583 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:26:39.506583 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:26:39.506583 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:26:39.506583 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:26:39.506583 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:26:39.506583 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsBdL7wyincMMZQwWVO4VXZ12yGjskbZB6RbMosVFiO3AhWsk3p3j49O8SLUIedaHGcczd4m4MpzaMoMcOa6aCWbbQi-5ZIc3ZUEa1lJskMXmN8Nc0ijYn_Q7UvKQVQkq2YKbmWhYhuHg_-gF1WghqCfIW01OCPDumgGkHJGO6VVHFs Oct 12 13:26:39.506583 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:26:39.506583 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:26:39.506583 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:26:39.506583 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:26:39.506583 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:26:39.506583 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:26:39.506583 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 3399cf92fd65427b8652320be1e501ad Oct 12 13:26:39.506583 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:39.506583 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:26:39.506583 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:26:39.507976 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3399cf92fd65427b8652320be1e501ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3399cf92fd65427b8652320be1e501ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3399cf92fd65427b8652320be1e501ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3399cf92fd65427b8652320be1e501ad"}]}] Oct 12 13:26:39.507976 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:39.507976 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 3399cf92fd65427b8652320be1e501ad Oct 12 13:26:39.507976 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:39.507976 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-SecurityGroupsTestJSON-1263036119-project Oct 12 13:26:39.507976 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:26:39.507976 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:26:39.507976 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 21315dd58bd4461bb41c70ccdfd27d47 Oct 12 13:26:39.507976 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-SecurityGroupsTestJSON-1263036119-project Oct 12 13:26:39.507976 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:26:39.507976 n-d-861076-2 devstack@n-api.service[120932]: exception: Security group 9d6d1949-9d67-49e0-b14f-17f75af8d3d7 does not exist Oct 12 13:26:39.507976 n-d-861076-2 devstack@n-api.service[120932]: Neutron server returns request_ids: ['req-05875ebf-d4eb-4f7e-8022-ded0451868f8'] Oct 12 13:26:39.507976 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '9d6d1949-9d67-49e0-b14f-17f75af8d3d7'} Oct 12 13:26:39.508944 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:26:39.508944 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:39.508944 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 13:26:39.508944 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 13:26:39.508944 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:39.508944 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:39.508944 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 13:26:39.508944 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 13:26:39.508944 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:39.508944 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:39.508944 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:39.508944 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:39.508944 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:39.508944 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:39.508944 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:39.508944 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:39.508944 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:39.508944 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:39.508944 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 13:26:39.510166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 13:26:39.510166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:39.510166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:39.510166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 13:26:39.510166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 13:26:39.510166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 13:26:39.510166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 13:26:39.510166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9d6d1949-9d67-49e0-b14f-17f75af8d3d7 does not exist Oct 12 13:26:39.510166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05875ebf-d4eb-4f7e-8022-ded0451868f8'] Oct 12 13:26:39.510166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:39.510166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:39.510166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:39.510166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:39.510166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 13:26:39.510166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 13:26:39.510166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 13:26:39.510166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 13:26:39.510166 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9d6d1949-9d67-49e0-b14f-17f75af8d3d7 does not exist Oct 12 13:26:39.511288 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05875ebf-d4eb-4f7e-8022-ded0451868f8'] Oct 12 13:26:39.511288 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:39.511288 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:39.511288 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:39.511288 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:39.511288 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:39.511288 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:39.511288 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:26:39.511288 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:26:39.511288 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:26:39.511288 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:26:39.511288 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:39.511288 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:39.511288 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 13:26:39.511288 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 13:26:39.511288 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9d6d1949-9d67-49e0-b14f-17f75af8d3d7 does not exist Oct 12 13:26:39.511288 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05875ebf-d4eb-4f7e-8022-ded0451868f8'] Oct 12 13:26:39.511288 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:39.511288 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:39.511288 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:39.511288 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:39.512637 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:39.512637 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:39.512637 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:26:39.512637 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:26:39.512637 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9d6d1949-9d67-49e0-b14f-17f75af8d3d7 does not exist Oct 12 13:26:39.512637 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05875ebf-d4eb-4f7e-8022-ded0451868f8'] Oct 12 13:26:39.512637 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:39.515419 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7f624831-225f-4e61-be2a-fb28c5f7abd9 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Returning 404 to user: Security group 9d6d1949-9d67-49e0-b14f-17f75af8d3d7 does not exist Oct 12 13:26:39.515419 n-d-861076-2 devstack@n-api.service[120932]: Neutron server returns request_ids: ['req-05875ebf-d4eb-4f7e-8022-ded0451868f8'] {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:26:39.516524 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7f624831-225f-4e61-be2a-fb28c5f7abd9 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/9d6d1949-9d67-49e0-b14f-17f75af8d3d7" status: 404 len: 194 microversion: 2.1 time: 0.088009 Oct 12 13:26:39.517460 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 570/1194] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:26:39 2022] DELETE /compute/v2.1/os-security-groups/9d6d1949-9d67-49e0-b14f-17f75af8d3d7 => generated 194 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:26:39.521813 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-5224d7da-55ca-46b9-9c92-1e23b1c16cd9 tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] validate_networks() for [('2ac46638-ae9e-42a4-bb0b-22f0e91dbfc8', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:26:39.525221 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7eac756d-c95c-4d47-8cfc-42377c3aed32 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9ba51a60>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:39.605555 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7eac756d-c95c-4d47-8cfc-42377c3aed32 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.086708 Oct 12 13:26:39.606126 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 571/1195] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:26:39 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:39.610660 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-dccecd2b-d180-4121-b885-a0f1b7ce5692 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Calling method '.version_select at 0x7f8aa026f9d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:39.700292 n-d-861076-2 devstack@n-api.service[120932]: DEBUG neutronclient.v2_0.client [None req-dccecd2b-d180-4121-b885-a0f1b7ce5692 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4660681e-d98d-4065-8dc5-f3b783fc250b does not exist", "detail": ""}} {{(pid=120932) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 13:26:39.701228 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.security_group_api [None req-dccecd2b-d180-4121-b885-a0f1b7ce5692 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Neutron security group 4660681e-d98d-4065-8dc5-f3b783fc250b not found {{(pid=120932) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 13:26:39.701945 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-dccecd2b-d180-4121-b885-a0f1b7ce5692 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] HTTP exception thrown: Security group 4660681e-d98d-4065-8dc5-f3b783fc250b does not exist Oct 12 13:26:39.701945 n-d-861076-2 devstack@n-api.service[120932]: Neutron server returns request_ids: ['req-6091ea1d-00b4-4b82-92da-d22cc067e4e8'] Oct 12 13:26:39.704243 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-dccecd2b-d180-4121-b885-a0f1b7ce5692 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Request method failure captured: Oct 12 13:26:39.704243 n-d-861076-2 devstack@n-api.service[120932]: request: DELETE /compute/v2.1/os-security-groups/4660681e-d98d-4065-8dc5-f3b783fc250b HTTP/1.1 Oct 12 13:26:39.704243 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:26:39.704243 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:26:39.704243 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:26:39.704243 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:26:39.704243 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:26:39.704243 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:26:39.704243 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:26:39.704243 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:26:39.704243 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsBdL7wyincMMZQwWVO4VXZ12yGjskbZB6RbMosVFiO3AhWsk3p3j49O8SLUIedaHGcczd4m4MpzaMoMcOa6aCWbbQi-5ZIc3ZUEa1lJskMXmN8Nc0ijYn_Q7UvKQVQkq2YKbmWhYhuHg_-gF1WghqCfIW01OCPDumgGkHJGO6VVHFs Oct 12 13:26:39.704243 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:26:39.704243 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:26:39.704243 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:26:39.704243 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:26:39.704243 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:26:39.704243 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:26:39.704243 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 3399cf92fd65427b8652320be1e501ad Oct 12 13:26:39.704243 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:39.704243 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:26:39.704243 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:26:39.705726 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3399cf92fd65427b8652320be1e501ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3399cf92fd65427b8652320be1e501ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3399cf92fd65427b8652320be1e501ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3399cf92fd65427b8652320be1e501ad"}]}] Oct 12 13:26:39.705726 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:39.705726 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 3399cf92fd65427b8652320be1e501ad Oct 12 13:26:39.705726 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1263036119 Oct 12 13:26:39.705726 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-SecurityGroupsTestJSON-1263036119-project Oct 12 13:26:39.705726 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:26:39.705726 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:26:39.705726 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 21315dd58bd4461bb41c70ccdfd27d47 Oct 12 13:26:39.705726 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-SecurityGroupsTestJSON-1263036119-project Oct 12 13:26:39.705726 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:26:39.705726 n-d-861076-2 devstack@n-api.service[120932]: exception: Security group 4660681e-d98d-4065-8dc5-f3b783fc250b does not exist Oct 12 13:26:39.705726 n-d-861076-2 devstack@n-api.service[120932]: Neutron server returns request_ids: ['req-6091ea1d-00b4-4b82-92da-d22cc067e4e8'] Oct 12 13:26:39.705726 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '4660681e-d98d-4065-8dc5-f3b783fc250b'} Oct 12 13:26:39.706726 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:26:39.706726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:39.706726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 13:26:39.706726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 13:26:39.706726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:39.706726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:39.706726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 13:26:39.706726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 13:26:39.706726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:39.706726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:39.706726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:39.706726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:39.706726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:39.706726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:39.706726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:39.706726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:39.706726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:39.706726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:39.706726 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 13:26:39.708693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 13:26:39.708693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:39.708693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:39.708693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 13:26:39.708693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 13:26:39.708693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 13:26:39.708693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 13:26:39.708693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4660681e-d98d-4065-8dc5-f3b783fc250b does not exist Oct 12 13:26:39.708693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6091ea1d-00b4-4b82-92da-d22cc067e4e8'] Oct 12 13:26:39.708693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:39.708693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:39.708693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:39.708693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:39.708693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 13:26:39.708693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 13:26:39.708693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 13:26:39.708693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 13:26:39.708693 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4660681e-d98d-4065-8dc5-f3b783fc250b does not exist Oct 12 13:26:39.709901 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6091ea1d-00b4-4b82-92da-d22cc067e4e8'] Oct 12 13:26:39.709901 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:39.709901 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:39.709901 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:39.709901 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:39.709901 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:39.709901 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:39.709901 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:26:39.709901 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:26:39.709901 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:26:39.709901 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:26:39.709901 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:39.709901 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:39.709901 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 13:26:39.709901 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 13:26:39.709901 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4660681e-d98d-4065-8dc5-f3b783fc250b does not exist Oct 12 13:26:39.709901 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6091ea1d-00b4-4b82-92da-d22cc067e4e8'] Oct 12 13:26:39.709901 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:39.709901 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:39.709901 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:39.709901 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:39.711587 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:39.711587 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:39.711587 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:26:39.711587 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:26:39.711587 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4660681e-d98d-4065-8dc5-f3b783fc250b does not exist Oct 12 13:26:39.711587 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6091ea1d-00b4-4b82-92da-d22cc067e4e8'] Oct 12 13:26:39.711587 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:39.713490 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-dccecd2b-d180-4121-b885-a0f1b7ce5692 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Returning 404 to user: Security group 4660681e-d98d-4065-8dc5-f3b783fc250b does not exist Oct 12 13:26:39.713490 n-d-861076-2 devstack@n-api.service[120932]: Neutron server returns request_ids: ['req-6091ea1d-00b4-4b82-92da-d22cc067e4e8'] {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:26:39.714670 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-dccecd2b-d180-4121-b885-a0f1b7ce5692 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/4660681e-d98d-4065-8dc5-f3b783fc250b" status: 404 len: 194 microversion: 2.1 time: 0.107588 Oct 12 13:26:39.718654 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 572/1196] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:26:39 2022] DELETE /compute/v2.1/os-security-groups/4660681e-d98d-4065-8dc5-f3b783fc250b => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:26:39.725649 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d1a518c6-e090-4a05-89e1-fe776b3de607 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9b9f9dc0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:39.943610 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d1a518c6-e090-4a05-89e1-fe776b3de607 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/detail?changes-since=2022-10-12T13%3A23%3A35Z" status: 200 len: 6333 microversion: 2.1 time: 0.223613 Oct 12 13:26:39.949808 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 573/1197] 10.222.0.52 () {58 vars in 1220 bytes} [Wed Oct 12 13:26:39 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-12T13%3A23%3A35Z => generated 6333 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:39.957268 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bb1c607c-3d78-4357-b7d9-e76ee7a87d40 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Calling method '.version_select at 0x7f8a9ba05a60>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:40.174788 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-5224d7da-55ca-46b9-9c92-1e23b1c16cd9 tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3583f055-d958-4943-9b51-b8e6945b1449) Oct 12 13:26:40.174788 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:40.174788 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:40.174788 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:40.174788 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:40.174788 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:40.174788 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:40.174788 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:40.174788 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:40.174788 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:40.174788 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:40.174788 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:40.174788 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:40.174788 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:40.174788 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:40.174788 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:40.175921 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:40.175921 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:40.175921 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:40.175921 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:40.175921 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:40.175921 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:40.175921 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:40.175921 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:40.175921 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:40.175921 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:40.175921 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:40.175921 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:40.175921 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:40.175921 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:40.175921 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:40.175921 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:40.175921 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:40.175921 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:40.177727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:40.177727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:40.177727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:40.177727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:40.177727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:40.177727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:40.177727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:40.177727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:40.177727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:40.177727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:40.177727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:40.177727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:40.177727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:40.177727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:40.177727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:40.177727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:40.177727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:40.177727 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:40.178928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:40.178928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:40.178928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:40.178928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:40.178928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:40.178928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:40.178928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:40.178928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:40.178928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:40.178928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:40.178928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:40.178928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:40.178928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:40.178928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:40.178928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3583f055-d958-4943-9b51-b8e6945b1449) Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-5224d7da-55ca-46b9-9c92-1e23b1c16cd9 tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5224d7da-55ca-46b9-9c92-1e23b1c16cd9 tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] Request method failure captured: Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 458 Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsBuKp2VByNdgfQrj0sMeYqojE_eczcPkIffWMyqj-Idx_zy7Z5xFTQjdVldszLkBK6xNruL0MKKC4-BfP9X2aVjFJRZ0zIBshu9L2xvXHvXOvhhepvh03I4jUVcyEv7s9lcsTTtJi_MtHKAFX-w0FG3xqUSK9fPnh_tb7vKMNTag30 Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: eeb7bf197c5c402fbb618ce9759228a0 Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-LiveMigrationTest-959108841 Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:26:40.179882 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:26:40.184846 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eeb7bf197c5c402fbb618ce9759228a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eeb7bf197c5c402fbb618ce9759228a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eeb7bf197c5c402fbb618ce9759228a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eeb7bf197c5c402fbb618ce9759228a0"}]}] Oct 12 13:26:40.184846 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-LiveMigrationTest-959108841 Oct 12 13:26:40.184846 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: eeb7bf197c5c402fbb618ce9759228a0 Oct 12 13:26:40.184846 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-LiveMigrationTest-959108841 Oct 12 13:26:40.184846 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-LiveMigrationTest-959108841-project Oct 12 13:26:40.184846 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:26:40.184846 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:26:40.184846 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: b01bb9e01bbd4feebbb3f965089245f4 Oct 12 13:26:40.184846 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-LiveMigrationTest-959108841-project Oct 12 13:26:40.184846 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:26:40.187003 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-LiveMigrationTest-server-1971969160", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "2ac46638-ae9e-42a4-bb0b-22f0e91dbfc8"}], "security_groups": [{"name": "tempest-securitygroup--1334491825"}], "key_name": "tempest-keypair-2057394471", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 12 13:26:40.187003 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:26:40.187003 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:40.187003 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:26:40.187003 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-LiveMigrationTest-server-1971969160', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '2ac46638-ae9e-42a4-bb0b-22f0e91dbfc8'}], 'security_groups': [{'name': 'tempest-securitygroup--1334491825'}], 'key_name': 'tempest-keypair-2057394471', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 12 13:26:40.187003 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:26:40.187003 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:40.187003 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:40.187003 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:40.187003 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:40.187003 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:40.187003 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:40.187003 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:40.189352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:26:40.189352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:26:40.189352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:26:40.189352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:26:40.189352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:26:40.189352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:26:40.189352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:26:40.189352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:26:40.189352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:26:40.189352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:26:40.189352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:26:40.189352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:26:40.189352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:26:40.189352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:26:40.189352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:26:40.189352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:26:40.189352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:26:40.189352 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:26:40.190668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:26:40.190668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:40.190668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:40.190668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:26:40.190668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:26:40.190668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:40.190668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:40.190668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:26:40.190668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:26:40.190668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:40.190668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:40.190668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:26:40.190668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:26:40.190668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:26:40.190668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:26:40.190668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:26:40.190668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:26:40.190668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:26:40.191974 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:26:40.191974 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:26:40.191974 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:26:40.191974 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:26:40.191974 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:26:40.191974 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:26:40.191974 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:26:40.191974 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:26:40.191974 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:26:40.191974 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:26:40.191974 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:26:40.191974 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:26:40.191974 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:26:40.191974 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:26:40.191974 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:26:40.191974 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:26:40.191974 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:26:40.193775 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:26:40.193775 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:26:40.193775 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:26:40.193775 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:26:40.193775 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:26:40.193775 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:26:40.193775 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3583f055-d958-4943-9b51-b8e6945b1449) Oct 12 13:26:40.193775 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:40.193775 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:40.193775 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:40.193775 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:40.193775 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:40.193775 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:40.193775 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:26:40.193775 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:26:40.193775 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:26:40.193775 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:26:40.195028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:40.195028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:40.195028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:40.195028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:40.195028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:40.195028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:40.195028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:40.195028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:40.195028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:26:40.195028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:26:40.195028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:40.195028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:40.195028 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:26:40.195028 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5224d7da-55ca-46b9-9c92-1e23b1c16cd9 tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:26:40.195028 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:26:40.196046 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5224d7da-55ca-46b9-9c92-1e23b1c16cd9 tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.905459 Oct 12 13:26:40.196046 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 625/1198] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:26:39 2022] POST /compute/v2.1/servers => generated 214 bytes in 907 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:26:40.197145 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e2bd6c67-a426-4047-9a26-957458d092c1 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa0045d30>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:40.359573 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e2bd6c67-a426-4047-9a26-957458d092c1 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1694929237" status: 200 len: 665 microversion: 2.1 time: 0.177290 Oct 12 13:26:40.365646 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 626/1199] 10.222.0.52 () {58 vars in 1252 bytes} [Wed Oct 12 13:26:40 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1694929237 => generated 665 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:40.376704 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8faa06a2-8e70-475d-ae80-3630940dc08f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:40.377362 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-8faa06a2-8e70-475d-ae80-3630940dc08f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 04ccef15-bb8d-4f4e-ac84-20c94c040b22] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:40.392628 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8faa06a2-8e70-475d-ae80-3630940dc08f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:40.396959 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8faa06a2-8e70-475d-ae80-3630940dc08f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:40.399781 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8faa06a2-8e70-475d-ae80-3630940dc08f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:40.401703 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8faa06a2-8e70-475d-ae80-3630940dc08f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:40.402419 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8faa06a2-8e70-475d-ae80-3630940dc08f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:40.405969 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8faa06a2-8e70-475d-ae80-3630940dc08f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:41.343661 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-8faa06a2-8e70-475d-ae80-3630940dc08f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:41.353432 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-8faa06a2-8e70-475d-ae80-3630940dc08f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22" status: 200 len: 1317 microversion: 2.1 time: 0.987329 Oct 12 13:26:41.369926 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 627/1200] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:40 2022] GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22 => generated 1317 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:41.376584 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-26d01448-a68d-47ee-9690-a17c7217331b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:41.377635 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-26d01448-a68d-47ee-9690-a17c7217331b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2d3ddb28-5b74-43dc-9579-d48a61b6d24e] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:41.385154 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-26d01448-a68d-47ee-9690-a17c7217331b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:41.386082 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-26d01448-a68d-47ee-9690-a17c7217331b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:41.386598 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-26d01448-a68d-47ee-9690-a17c7217331b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:41.388452 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-26d01448-a68d-47ee-9690-a17c7217331b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:41.389892 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-26d01448-a68d-47ee-9690-a17c7217331b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:41.390343 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-26d01448-a68d-47ee-9690-a17c7217331b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:41.586285 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-26d01448-a68d-47ee-9690-a17c7217331b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:41.599266 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-26d01448-a68d-47ee-9690-a17c7217331b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e" status: 200 len: 1266 microversion: 2.1 time: 0.227326 Oct 12 13:26:41.599860 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 628/1201] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:41 2022] GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:41.617632 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-75a97406-6c4d-4a73-9013-ccdcc8e68cbb tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa0045ca0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:41.729429 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-75a97406-6c4d-4a73-9013-ccdcc8e68cbb tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2F5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 200 len: 1466 microversion: 2.1 time: 0.121561 Oct 12 13:26:41.734097 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 629/1202] 10.222.0.52 () {58 vars in 1338 bytes} [Wed Oct 12 13:26:41 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2F5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 1466 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:41.743266 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-a6284a57-666d-47d6-931a-abb47439a359 req-46bbcd97-c828-4e18-a515-a06d52e9bf09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ccef15-bb8d-4f4e-ac84-20c94c040b22", "name": "network-vif-plugged", "status": "completed", "tag": "312993fd-3ce1-4bda-b627-09078ed03b95"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:41.775300 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-a6284a57-666d-47d6-931a-abb47439a359 req-46bbcd97-c828-4e18-a515-a06d52e9bf09 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:41.775879 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-a6284a57-666d-47d6-931a-abb47439a359 req-46bbcd97-c828-4e18-a515-a06d52e9bf09 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:41.776386 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-a6284a57-666d-47d6-931a-abb47439a359 req-46bbcd97-c828-4e18-a515-a06d52e9bf09 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:41.790645 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-a6284a57-666d-47d6-931a-abb47439a359 req-46bbcd97-c828-4e18-a515-a06d52e9bf09 service nova] Creating event network-vif-plugged:312993fd-3ce1-4bda-b627-09078ed03b95 for instance 04ccef15-bb8d-4f4e-ac84-20c94c040b22 on n-h1-861076-2 Oct 12 13:26:41.796518 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-a6284a57-666d-47d6-931a-abb47439a359 req-46bbcd97-c828-4e18-a515-a06d52e9bf09 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060994 Oct 12 13:26:41.797189 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 630/1203] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:41.804445 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6a2ab85f-d832-4d2e-a34e-9b3b644e63e7 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bd1c1f0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:41.873340 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6a2ab85f-d832-4d2e-a34e-9b3b644e63e7 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2F5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 200 len: 1466 microversion: 2.1 time: 0.072239 Oct 12 13:26:41.887904 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 631/1204] 10.222.0.52 () {58 vars in 1324 bytes} [Wed Oct 12 13:26:41 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2F5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 1466 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:41.899248 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b4f830b8-6601-4d24-a335-05cca720b83e tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa038c550>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:42.015444 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b4f830b8-6601-4d24-a335-05cca720b83e tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.121638 Oct 12 13:26:42.028988 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 632/1205] 10.222.0.52 () {58 vars in 1170 bytes} [Wed Oct 12 13:26:41 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:42.042534 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2d34b0cb-a0a8-46bd-be4b-4c1ea6cb39a5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bd1c1f0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:42.105183 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bb1c607c-3d78-4357-b7d9-e76ee7a87d40 tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/0580d258-a97f-4d1d-b0f3-79ca0f77570e" status: 202 len: 0 microversion: 2.1 time: 2.153446 Oct 12 13:26:42.106064 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 574/1206] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:26:39 2022] DELETE /compute/v2.1/os-security-groups/0580d258-a97f-4d1d-b0f3-79ca0f77570e => generated 0 bytes in 2155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:26:42.113649 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-40ce8fa4-8048-4a99-ae50-4ffcbde94a6b tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] Calling method '.version_select at 0x7f8a9b92db80>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:42.135344 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2d34b0cb-a0a8-46bd-be4b-4c1ea6cb39a5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.097570 Oct 12 13:26:42.150158 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 633/1207] 10.222.0.52 () {58 vars in 1170 bytes} [Wed Oct 12 13:26:42 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:26:42.160095 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5481ecc4-9e37-4bc7-a7c8-486d0b71ddf9 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bd01670>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:42.208626 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5481ecc4-9e37-4bc7-a7c8-486d0b71ddf9 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/92c34f67-0f72-4439-9fdb-d8567b96935c" status: 200 len: 784 microversion: 2.1 time: 0.055927 Oct 12 13:26:42.209237 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 634/1208] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:26:42 2022] GET /compute/v2.1/images/92c34f67-0f72-4439-9fdb-d8567b96935c => generated 784 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:42.387119 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-dc012ff2-0e43-4f79-92ab-9e06dcd42d76 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-501440156", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": "none"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:42.511666 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-dc012ff2-0e43-4f79-92ab-9e06dcd42d76 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:26:42.512184 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-dc012ff2-0e43-4f79-92ab-9e06dcd42d76 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:26:42.512914 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-dc012ff2-0e43-4f79-92ab-9e06dcd42d76 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:26:42.513420 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-dc012ff2-0e43-4f79-92ab-9e06dcd42d76 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:26:42.514373 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-dc012ff2-0e43-4f79-92ab-9e06dcd42d76 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:26:42.533382 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dc012ff2-0e43-4f79-92ab-9e06dcd42d76 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:42.533775 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dc012ff2-0e43-4f79-92ab-9e06dcd42d76 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:42.534216 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dc012ff2-0e43-4f79-92ab-9e06dcd42d76 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:42.534941 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dc012ff2-0e43-4f79-92ab-9e06dcd42d76 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:42.535389 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dc012ff2-0e43-4f79-92ab-9e06dcd42d76 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:42.537681 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dc012ff2-0e43-4f79-92ab-9e06dcd42d76 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:42.615163 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-dc012ff2-0e43-4f79-92ab-9e06dcd42d76 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Getting quotas for project 94c2368f4aa44b319a3fa644d8ed5027. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:26:42.621102 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-dc012ff2-0e43-4f79-92ab-9e06dcd42d76 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Getting quotas for user 5005f3b6fbd54882aa5bee88adce5ca5 and project 94c2368f4aa44b319a3fa644d8ed5027. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:26:42.650723 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-dc012ff2-0e43-4f79-92ab-9e06dcd42d76 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Going to run 1 instances... {{(pid=120933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:26:42.653233 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-dc012ff2-0e43-4f79-92ab-9e06dcd42d76 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] [instance: adef3d1f-fbf2-4093-8151-af1bfe7c667e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:26:42.928880 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-dc012ff2-0e43-4f79-92ab-9e06dcd42d76 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.718318 Oct 12 13:26:42.929556 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 635/1209] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 12 13:26:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 13:26:42.940676 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a35d324a-15df-44cd-ad8b-4aa92fd189f0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa01d6940>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:43.045141 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a35d324a-15df-44cd-ad8b-4aa92fd189f0 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.107107 Oct 12 13:26:43.061322 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 636/1210] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 12 13:26:42 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:43.070240 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-934c9711-016d-4161-a0e8-ade1c5500b58 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:43.071025 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-934c9711-016d-4161-a0e8-ade1c5500b58 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 04ccef15-bb8d-4f4e-ac84-20c94c040b22] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:43.082473 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-934c9711-016d-4161-a0e8-ade1c5500b58 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:43.083521 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-934c9711-016d-4161-a0e8-ade1c5500b58 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:43.084010 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-934c9711-016d-4161-a0e8-ade1c5500b58 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:43.089442 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-934c9711-016d-4161-a0e8-ade1c5500b58 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:43.089955 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-934c9711-016d-4161-a0e8-ade1c5500b58 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:43.092184 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-934c9711-016d-4161-a0e8-ade1c5500b58 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:43.238984 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-40ce8fa4-8048-4a99-ae50-4ffcbde94a6b tempest-SecurityGroupsTestJSON-1263036119 tempest-SecurityGroupsTestJSON-1263036119-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/bb4019eb-1176-47e6-a5e1-e6414b7f46bb" status: 202 len: 0 microversion: 2.1 time: 1.128995 Oct 12 13:26:43.242859 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 575/1211] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:26:42 2022] DELETE /compute/v2.1/os-security-groups/bb4019eb-1176-47e6-a5e1-e6414b7f46bb => generated 0 bytes in 1131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 13:26:43.249728 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-51d4bf0d-0bc9-4832-87aa-3844d8d29b5a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:43.249728 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-51d4bf0d-0bc9-4832-87aa-3844d8d29b5a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2d3ddb28-5b74-43dc-9579-d48a61b6d24e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:43.261223 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-51d4bf0d-0bc9-4832-87aa-3844d8d29b5a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:43.263641 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-51d4bf0d-0bc9-4832-87aa-3844d8d29b5a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:43.264046 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-51d4bf0d-0bc9-4832-87aa-3844d8d29b5a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:43.264863 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-51d4bf0d-0bc9-4832-87aa-3844d8d29b5a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:43.271433 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-51d4bf0d-0bc9-4832-87aa-3844d8d29b5a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:43.272703 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-51d4bf0d-0bc9-4832-87aa-3844d8d29b5a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:43.600470 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-51d4bf0d-0bc9-4832-87aa-3844d8d29b5a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:43.619678 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-51d4bf0d-0bc9-4832-87aa-3844d8d29b5a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e" status: 200 len: 1272 microversion: 2.1 time: 0.378412 Oct 12 13:26:43.620267 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 576/1212] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:43 2022] GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e => generated 1272 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:43.626755 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-123ed0b6-f7ce-4943-924e-cbd8c31b1278 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:43.628057 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-123ed0b6-f7ce-4943-924e-cbd8c31b1278 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] [instance: adef3d1f-fbf2-4093-8151-af1bfe7c667e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:43.809990 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-123ed0b6-f7ce-4943-924e-cbd8c31b1278 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:43.823836 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-123ed0b6-f7ce-4943-924e-cbd8c31b1278 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:43.828437 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-123ed0b6-f7ce-4943-924e-cbd8c31b1278 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:43.830686 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-123ed0b6-f7ce-4943-924e-cbd8c31b1278 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] 10.222.0.52 "GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e" status: 200 len: 1280 microversion: 2.47 time: 0.208886 Oct 12 13:26:43.832091 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 577/1213] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:26:43 2022] GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e => generated 1280 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:26:43.836564 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c46f1b9a-de11-4844-bd95-67a30119503d tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9b92d0d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:44.223001 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-934c9711-016d-4161-a0e8-ade1c5500b58 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:44.227203 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=100 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:26:44.233773 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-934c9711-016d-4161-a0e8-ade1c5500b58 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22" status: 200 len: 1317 microversion: 2.1 time: 1.181747 Oct 12 13:26:44.237181 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 637/1214] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:43 2022] GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22 => generated 1317 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:44.643242 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cab4888f-558a-4884-bfa4-e20e057456b0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:44.644177 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-cab4888f-558a-4884-bfa4-e20e057456b0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2d3ddb28-5b74-43dc-9579-d48a61b6d24e] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:44.665295 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cab4888f-558a-4884-bfa4-e20e057456b0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:44.665803 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cab4888f-558a-4884-bfa4-e20e057456b0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:44.666253 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cab4888f-558a-4884-bfa4-e20e057456b0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:44.667230 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cab4888f-558a-4884-bfa4-e20e057456b0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:44.667915 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cab4888f-558a-4884-bfa4-e20e057456b0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:44.668829 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cab4888f-558a-4884-bfa4-e20e057456b0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:44.807414 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-cab4888f-558a-4884-bfa4-e20e057456b0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:44.816438 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-cab4888f-558a-4884-bfa4-e20e057456b0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e" status: 200 len: 1272 microversion: 2.1 time: 0.176509 Oct 12 13:26:44.817917 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 638/1215] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:44 2022] GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e => generated 1272 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:26:44.861861 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a4d2a52d-306f-4b37-919c-3c95c2d78d2c tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:44.862747 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a4d2a52d-306f-4b37-919c-3c95c2d78d2c tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] [instance: adef3d1f-fbf2-4093-8151-af1bfe7c667e] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:45.069522 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a4d2a52d-306f-4b37-919c-3c95c2d78d2c tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:45.083049 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a4d2a52d-306f-4b37-919c-3c95c2d78d2c tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:45.084506 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a4d2a52d-306f-4b37-919c-3c95c2d78d2c tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:45.103895 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a4d2a52d-306f-4b37-919c-3c95c2d78d2c tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] 10.222.0.52 "GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e" status: 200 len: 1280 microversion: 2.47 time: 0.247771 Oct 12 13:26:45.104808 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 639/1216] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:26:44 2022] GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e => generated 1280 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:26:45.262952 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d241aa7c-214b-41bb-b477-b90688d6af71 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:45.264643 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-d241aa7c-214b-41bb-b477-b90688d6af71 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 04ccef15-bb8d-4f4e-ac84-20c94c040b22] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:45.276241 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d241aa7c-214b-41bb-b477-b90688d6af71 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:45.279920 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d241aa7c-214b-41bb-b477-b90688d6af71 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:45.282265 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d241aa7c-214b-41bb-b477-b90688d6af71 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:45.284622 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d241aa7c-214b-41bb-b477-b90688d6af71 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:45.286714 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d241aa7c-214b-41bb-b477-b90688d6af71 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:45.288001 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d241aa7c-214b-41bb-b477-b90688d6af71 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:46.090297 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c46f1b9a-de11-4844-bd95-67a30119503d tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "DELETE /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e" status: 204 len: 0 microversion: 2.1 time: 2.257090 Oct 12 13:26:46.090956 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 578/1217] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:43 2022] DELETE /compute/v2.1/images/b2a8694f-6f16-4ce7-b0c7-be66c0c8f99e => generated 0 bytes in 2258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:26:46.096448 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1814fde8-f33d-41c6-b7a9-ab8de564d3bd tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:46.097467 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1814fde8-f33d-41c6-b7a9-ab8de564d3bd tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2d3ddb28-5b74-43dc-9579-d48a61b6d24e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:46.115610 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1814fde8-f33d-41c6-b7a9-ab8de564d3bd tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:46.116344 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1814fde8-f33d-41c6-b7a9-ab8de564d3bd tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:46.117255 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1814fde8-f33d-41c6-b7a9-ab8de564d3bd tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:46.118227 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1814fde8-f33d-41c6-b7a9-ab8de564d3bd tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:46.118870 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1814fde8-f33d-41c6-b7a9-ab8de564d3bd tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:46.119873 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1814fde8-f33d-41c6-b7a9-ab8de564d3bd tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:46.326089 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d241aa7c-214b-41bb-b477-b90688d6af71 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:46.337933 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d241aa7c-214b-41bb-b477-b90688d6af71 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22" status: 200 len: 1467 microversion: 2.1 time: 1.078098 Oct 12 13:26:46.339096 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 640/1218] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:45 2022] GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22 => generated 1467 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:26:46.346947 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-aba0caa9-0c4c-4c0b-9f9c-851cb702556a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bd38af0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:47.088060 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-1814fde8-f33d-41c6-b7a9-ab8de564d3bd tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:47.108020 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1814fde8-f33d-41c6-b7a9-ab8de564d3bd tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e" status: 200 len: 1314 microversion: 2.1 time: 1.015470 Oct 12 13:26:47.125119 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 579/1219] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:46 2022] GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e => generated 1314 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:47.131609 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-881090a0-3b8a-4bfd-8ed0-24dc030d60bc tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:47.135904 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-881090a0-3b8a-4bfd-8ed0-24dc030d60bc tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] [instance: adef3d1f-fbf2-4093-8151-af1bfe7c667e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:47.156031 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-881090a0-3b8a-4bfd-8ed0-24dc030d60bc tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:47.156539 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-881090a0-3b8a-4bfd-8ed0-24dc030d60bc tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:47.157012 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-881090a0-3b8a-4bfd-8ed0-24dc030d60bc tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:47.158018 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-881090a0-3b8a-4bfd-8ed0-24dc030d60bc tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:47.158463 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-881090a0-3b8a-4bfd-8ed0-24dc030d60bc tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:47.158883 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-881090a0-3b8a-4bfd-8ed0-24dc030d60bc tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:47.584835 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-881090a0-3b8a-4bfd-8ed0-24dc030d60bc tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:47.597872 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-881090a0-3b8a-4bfd-8ed0-24dc030d60bc tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:47.599756 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-881090a0-3b8a-4bfd-8ed0-24dc030d60bc tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:47.601764 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-881090a0-3b8a-4bfd-8ed0-24dc030d60bc tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] 10.222.0.52 "GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e" status: 200 len: 1332 microversion: 2.47 time: 0.475169 Oct 12 13:26:47.619958 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 580/1220] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:26:47 2022] GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e => generated 1332 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:26:47.632787 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bf3491f0-08a2-4bb6-a3e1-c1ddf2f1d2ea tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:47.633851 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-bf3491f0-08a2-4bb6-a3e1-c1ddf2f1d2ea tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] [instance: 04ccef15-bb8d-4f4e-ac84-20c94c040b22] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:47.640873 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf3491f0-08a2-4bb6-a3e1-c1ddf2f1d2ea tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:47.641781 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf3491f0-08a2-4bb6-a3e1-c1ddf2f1d2ea tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:47.642447 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf3491f0-08a2-4bb6-a3e1-c1ddf2f1d2ea tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:47.643375 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf3491f0-08a2-4bb6-a3e1-c1ddf2f1d2ea tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:47.644043 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf3491f0-08a2-4bb6-a3e1-c1ddf2f1d2ea tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:47.644692 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf3491f0-08a2-4bb6-a3e1-c1ddf2f1d2ea tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:47.869861 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bf3491f0-08a2-4bb6-a3e1-c1ddf2f1d2ea tempest-ServersOnMultiNodesTest-845803400 tempest-ServersOnMultiNodesTest-845803400-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22" status: 200 len: 1618 microversion: 2.1 time: 0.247610 Oct 12 13:26:47.884436 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 581/1221] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:47 2022] GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22 => generated 1618 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:47.896965 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b9256216-2b44-44b4-b0cd-9fab8188c83b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:48.011059 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b9256216-2b44-44b4-b0cd-9fab8188c83b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 04ccef15-bb8d-4f4e-ac84-20c94c040b22] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:48.011059 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b9256216-2b44-44b4-b0cd-9fab8188c83b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:48.011059 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b9256216-2b44-44b4-b0cd-9fab8188c83b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:48.011059 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b9256216-2b44-44b4-b0cd-9fab8188c83b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:48.012826 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b9256216-2b44-44b4-b0cd-9fab8188c83b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:48.012826 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b9256216-2b44-44b4-b0cd-9fab8188c83b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:48.012826 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b9256216-2b44-44b4-b0cd-9fab8188c83b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:48.012826 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b9256216-2b44-44b4-b0cd-9fab8188c83b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 04ccef15-bb8d-4f4e-ac84-20c94c040b22] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:26:48.279541 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:26:49.154842 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b9256216-2b44-44b4-b0cd-9fab8188c83b tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "DELETE /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22" status: 204 len: 0 microversion: 2.1 time: 1.262117 Oct 12 13:26:49.162643 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 582/1222] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:26:47 2022] DELETE /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22 => generated 0 bytes in 1265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:26:49.165258 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7f3ff916-243b-45db-838a-b7fb875a123a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:49.167550 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7f3ff916-243b-45db-838a-b7fb875a123a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2d3ddb28-5b74-43dc-9579-d48a61b6d24e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:49.195423 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-aba0caa9-0c4c-4c0b-9f9c-851cb702556a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "DELETE /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209" status: 204 len: 0 microversion: 2.1 time: 2.847265 Oct 12 13:26:49.195423 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 641/1223] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:46 2022] DELETE /compute/v2.1/images/083f973e-b1b6-4e12-a5a6-7c5152b14209 => generated 0 bytes in 2849 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:26:49.197275 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0d1d0ddb-bc35-4afe-80dc-25781f1dc3ad tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:49.197940 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-0d1d0ddb-bc35-4afe-80dc-25781f1dc3ad tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] [instance: adef3d1f-fbf2-4093-8151-af1bfe7c667e] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:49.209607 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f3ff916-243b-45db-838a-b7fb875a123a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:49.213276 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f3ff916-243b-45db-838a-b7fb875a123a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:49.215058 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f3ff916-243b-45db-838a-b7fb875a123a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:49.215196 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:26:49.219010 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f3ff916-243b-45db-838a-b7fb875a123a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:49.220160 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f3ff916-243b-45db-838a-b7fb875a123a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:49.221370 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f3ff916-243b-45db-838a-b7fb875a123a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:49.222157 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0d1d0ddb-bc35-4afe-80dc-25781f1dc3ad tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:49.223494 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0d1d0ddb-bc35-4afe-80dc-25781f1dc3ad tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:49.245875 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0d1d0ddb-bc35-4afe-80dc-25781f1dc3ad tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:49.247707 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0d1d0ddb-bc35-4afe-80dc-25781f1dc3ad tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:49.248640 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0d1d0ddb-bc35-4afe-80dc-25781f1dc3ad tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:49.249409 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0d1d0ddb-bc35-4afe-80dc-25781f1dc3ad tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:49.523856 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-0d1d0ddb-bc35-4afe-80dc-25781f1dc3ad tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:49.550812 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-0d1d0ddb-bc35-4afe-80dc-25781f1dc3ad tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:49.553327 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-0d1d0ddb-bc35-4afe-80dc-25781f1dc3ad tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:49.554920 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0d1d0ddb-bc35-4afe-80dc-25781f1dc3ad tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] 10.222.0.52 "GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e" status: 200 len: 1338 microversion: 2.47 time: 0.363820 Oct 12 13:26:49.556139 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 642/1224] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:26:49 2022] GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e => generated 1338 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:26:49.574131 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4b2e814b-976d-4fd1-9173-154586adf013 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:49.574750 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-4b2e814b-976d-4fd1-9173-154586adf013 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 04ccef15-bb8d-4f4e-ac84-20c94c040b22] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:49.604333 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4b2e814b-976d-4fd1-9173-154586adf013 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:49.605023 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4b2e814b-976d-4fd1-9173-154586adf013 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:49.605849 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4b2e814b-976d-4fd1-9173-154586adf013 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:49.606777 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4b2e814b-976d-4fd1-9173-154586adf013 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:49.607660 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4b2e814b-976d-4fd1-9173-154586adf013 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:49.608263 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4b2e814b-976d-4fd1-9173-154586adf013 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:49.692556 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-7f3ff916-243b-45db-838a-b7fb875a123a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:49.702525 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7f3ff916-243b-45db-838a-b7fb875a123a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e" status: 200 len: 1314 microversion: 2.1 time: 0.545401 Oct 12 13:26:49.709879 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 583/1225] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:49 2022] GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:49.737431 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f78d25f5-a606-4ec7-87b5-c718efc5bcaf tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9b9bcf70>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:50.006449 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-4b2e814b-976d-4fd1-9173-154586adf013 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:50.018893 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4b2e814b-976d-4fd1-9173-154586adf013 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22" status: 200 len: 1473 microversion: 2.1 time: 0.460676 Oct 12 13:26:50.021298 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 643/1226] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:49 2022] GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22 => generated 1473 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:50.232936 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-41f8588d-ffb7-4abc-a81c-a998e2f3191c req-a41173c8-db43-4cb8-90c8-de4e294fa65e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d3ddb28-5b74-43dc-9579-d48a61b6d24e", "tag": "75aaeb66-849a-4294-a96c-56858c711618"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:50.263936 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-41f8588d-ffb7-4abc-a81c-a998e2f3191c req-a41173c8-db43-4cb8-90c8-de4e294fa65e service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:50.268404 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-41f8588d-ffb7-4abc-a81c-a998e2f3191c req-a41173c8-db43-4cb8-90c8-de4e294fa65e service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:50.271213 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-41f8588d-ffb7-4abc-a81c-a998e2f3191c req-a41173c8-db43-4cb8-90c8-de4e294fa65e service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:50.366818 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-41f8588d-ffb7-4abc-a81c-a998e2f3191c req-a41173c8-db43-4cb8-90c8-de4e294fa65e service nova] Creating event network-changed:75aaeb66-849a-4294-a96c-56858c711618 for instance 2d3ddb28-5b74-43dc-9579-d48a61b6d24e on n-h1-861076-2 Oct 12 13:26:50.375354 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-41f8588d-ffb7-4abc-a81c-a998e2f3191c req-a41173c8-db43-4cb8-90c8-de4e294fa65e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147350 Oct 12 13:26:50.377687 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 644/1227] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:26:50.592959 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b078672c-01ad-4a7a-944e-89c56ec37489 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:50.594019 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-b078672c-01ad-4a7a-944e-89c56ec37489 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] [instance: adef3d1f-fbf2-4093-8151-af1bfe7c667e] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:50.613616 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b078672c-01ad-4a7a-944e-89c56ec37489 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:50.619706 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b078672c-01ad-4a7a-944e-89c56ec37489 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:50.624249 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b078672c-01ad-4a7a-944e-89c56ec37489 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:50.624249 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b078672c-01ad-4a7a-944e-89c56ec37489 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:50.624249 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b078672c-01ad-4a7a-944e-89c56ec37489 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:50.628796 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b078672c-01ad-4a7a-944e-89c56ec37489 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:50.912402 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b078672c-01ad-4a7a-944e-89c56ec37489 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:50.921407 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b078672c-01ad-4a7a-944e-89c56ec37489 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:50.923595 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b078672c-01ad-4a7a-944e-89c56ec37489 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:50.925666 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b078672c-01ad-4a7a-944e-89c56ec37489 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] 10.222.0.52 "GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e" status: 200 len: 1338 microversion: 2.47 time: 0.337519 Oct 12 13:26:50.963840 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 645/1228] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:26:50 2022] GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e => generated 1338 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:26:50.970448 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a4e07ec0-643c-4b92-a19f-08d41f12e931 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:50.995206 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a4e07ec0-643c-4b92-a19f-08d41f12e931 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2d3ddb28-5b74-43dc-9579-d48a61b6d24e] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:51.025042 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a4e07ec0-643c-4b92-a19f-08d41f12e931 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:51.031865 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a4e07ec0-643c-4b92-a19f-08d41f12e931 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:51.032471 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a4e07ec0-643c-4b92-a19f-08d41f12e931 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:51.035770 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a4e07ec0-643c-4b92-a19f-08d41f12e931 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:51.038006 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a4e07ec0-643c-4b92-a19f-08d41f12e931 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:51.038649 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a4e07ec0-643c-4b92-a19f-08d41f12e931 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:51.552380 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a4e07ec0-643c-4b92-a19f-08d41f12e931 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:51.564505 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a4e07ec0-643c-4b92-a19f-08d41f12e931 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e" status: 200 len: 1314 microversion: 2.1 time: 0.597728 Oct 12 13:26:51.565445 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 646/1229] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:50 2022] GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e => generated 1314 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:51.571936 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d2561889-25ec-4fb4-8f2c-f147d0f28545 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:51.578654 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-d2561889-25ec-4fb4-8f2c-f147d0f28545 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 04ccef15-bb8d-4f4e-ac84-20c94c040b22] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:51.583300 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d2561889-25ec-4fb4-8f2c-f147d0f28545 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:51.583914 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d2561889-25ec-4fb4-8f2c-f147d0f28545 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:51.584531 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d2561889-25ec-4fb4-8f2c-f147d0f28545 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:51.585618 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d2561889-25ec-4fb4-8f2c-f147d0f28545 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:51.586087 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d2561889-25ec-4fb4-8f2c-f147d0f28545 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:51.586816 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d2561889-25ec-4fb4-8f2c-f147d0f28545 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:52.588378 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f78d25f5-a606-4ec7-87b5-c718efc5bcaf tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "DELETE /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9" status: 204 len: 0 microversion: 2.1 time: 2.860459 Oct 12 13:26:52.588978 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 584/1230] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:49 2022] DELETE /compute/v2.1/images/407ff7c1-26a9-4fca-9e3b-413eaf120aa9 => generated 0 bytes in 2862 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:26:52.595727 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:26:52.597811 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a6ad6245-1fed-4b90-88a5-e46fab58a58f tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:52.599687 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a6ad6245-1fed-4b90-88a5-e46fab58a58f tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] [instance: adef3d1f-fbf2-4093-8151-af1bfe7c667e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:52.619695 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a6ad6245-1fed-4b90-88a5-e46fab58a58f tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:52.621065 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a6ad6245-1fed-4b90-88a5-e46fab58a58f tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:52.621743 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a6ad6245-1fed-4b90-88a5-e46fab58a58f tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:52.623887 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d2561889-25ec-4fb4-8f2c-f147d0f28545 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:52.624293 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a6ad6245-1fed-4b90-88a5-e46fab58a58f tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:52.628471 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a6ad6245-1fed-4b90-88a5-e46fab58a58f tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:52.631986 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a6ad6245-1fed-4b90-88a5-e46fab58a58f tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:52.641563 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d2561889-25ec-4fb4-8f2c-f147d0f28545 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22" status: 200 len: 1473 microversion: 2.1 time: 1.068313 Oct 12 13:26:52.643155 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 647/1231] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:51 2022] GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22 => generated 1473 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:52.661312 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3341d36b-2402-4013-9645-044fbcd0e227 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:52.664860 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-3341d36b-2402-4013-9645-044fbcd0e227 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2d3ddb28-5b74-43dc-9579-d48a61b6d24e] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:52.705649 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3341d36b-2402-4013-9645-044fbcd0e227 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:52.705649 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3341d36b-2402-4013-9645-044fbcd0e227 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:52.705649 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3341d36b-2402-4013-9645-044fbcd0e227 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:52.711981 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3341d36b-2402-4013-9645-044fbcd0e227 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:52.712488 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3341d36b-2402-4013-9645-044fbcd0e227 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:52.712956 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3341d36b-2402-4013-9645-044fbcd0e227 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:52.766619 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-a6ad6245-1fed-4b90-88a5-e46fab58a58f tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:52.777057 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-a6ad6245-1fed-4b90-88a5-e46fab58a58f tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:52.781953 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-a6ad6245-1fed-4b90-88a5-e46fab58a58f tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:52.783359 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a6ad6245-1fed-4b90-88a5-e46fab58a58f tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] 10.222.0.52 "GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e" status: 200 len: 1338 microversion: 2.47 time: 0.192743 Oct 12 13:26:52.784851 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 585/1232] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:26:52 2022] GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e => generated 1338 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:26:52.792384 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1ee30d81-1080-469e-81e9-b975e5023bec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:52.792881 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1ee30d81-1080-469e-81e9-b975e5023bec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:52.804610 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1ee30d81-1080-469e-81e9-b975e5023bec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:52.805376 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1ee30d81-1080-469e-81e9-b975e5023bec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:52.810528 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1ee30d81-1080-469e-81e9-b975e5023bec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:52.813351 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1ee30d81-1080-469e-81e9-b975e5023bec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:52.814161 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1ee30d81-1080-469e-81e9-b975e5023bec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:52.816162 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1ee30d81-1080-469e-81e9-b975e5023bec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:52.853473 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1ee30d81-1080-469e-81e9-b975e5023bec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:26:52.906976 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:26:53.179403 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-3341d36b-2402-4013-9645-044fbcd0e227 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:53.188258 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3341d36b-2402-4013-9645-044fbcd0e227 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e" status: 200 len: 1314 microversion: 2.1 time: 0.543787 Oct 12 13:26:53.213066 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 648/1233] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:52 2022] GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:53.218278 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-fadc705c-c461-469b-adaf-522b7b958e3e req-2f31c0be-44a1-43b3-9321-5d95eb4d5283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ccef15-bb8d-4f4e-ac84-20c94c040b22", "name": "network-vif-deleted", "tag": "312993fd-3ce1-4bda-b627-09078ed03b95"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:53.240791 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-fadc705c-c461-469b-adaf-522b7b958e3e req-2f31c0be-44a1-43b3-9321-5d95eb4d5283 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:53.241910 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-fadc705c-c461-469b-adaf-522b7b958e3e req-2f31c0be-44a1-43b3-9321-5d95eb4d5283 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:53.242732 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-fadc705c-c461-469b-adaf-522b7b958e3e req-2f31c0be-44a1-43b3-9321-5d95eb4d5283 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:53.271238 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-fadc705c-c461-469b-adaf-522b7b958e3e req-2f31c0be-44a1-43b3-9321-5d95eb4d5283 service nova] Creating event network-vif-deleted:312993fd-3ce1-4bda-b627-09078ed03b95 for instance 04ccef15-bb8d-4f4e-ac84-20c94c040b22 on n-h1-861076-2 Oct 12 13:26:53.283802 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-fadc705c-c461-469b-adaf-522b7b958e3e req-2f31c0be-44a1-43b3-9321-5d95eb4d5283 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071538 Oct 12 13:26:53.285067 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 649/1234] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:53.320735 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1ee30d81-1080-469e-81e9-b975e5023bec tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 204 len: 0 microversion: 2.1 time: 0.534635 Oct 12 13:26:53.321575 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 586/1235] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:26:52 2022] DELETE /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:26:53.330924 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-af2865b8-ce85-4c38-bbca-2a4715460ef2 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:53.331630 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-af2865b8-ce85-4c38-bbca-2a4715460ef2 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:53.338574 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-af2865b8-ce85-4c38-bbca-2a4715460ef2 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:53.339323 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-af2865b8-ce85-4c38-bbca-2a4715460ef2 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:53.340587 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-af2865b8-ce85-4c38-bbca-2a4715460ef2 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:53.341509 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-af2865b8-ce85-4c38-bbca-2a4715460ef2 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:53.342132 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-af2865b8-ce85-4c38-bbca-2a4715460ef2 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:53.343136 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-af2865b8-ce85-4c38-bbca-2a4715460ef2 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:53.553302 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-af2865b8-ce85-4c38-bbca-2a4715460ef2 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:53.561932 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-af2865b8-ce85-4c38-bbca-2a4715460ef2 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 200 len: 1474 microversion: 2.1 time: 0.235178 Oct 12 13:26:53.562505 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 650/1236] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:53 2022] GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 1474 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:53.671401 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9a2cc102-e742-4ef7-b120-8be94d084c46 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:53.672699 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9a2cc102-e742-4ef7-b120-8be94d084c46 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 04ccef15-bb8d-4f4e-ac84-20c94c040b22] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:53.679510 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9a2cc102-e742-4ef7-b120-8be94d084c46 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:53.680783 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9a2cc102-e742-4ef7-b120-8be94d084c46 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:53.681640 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9a2cc102-e742-4ef7-b120-8be94d084c46 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:53.683232 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9a2cc102-e742-4ef7-b120-8be94d084c46 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:53.683930 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9a2cc102-e742-4ef7-b120-8be94d084c46 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:53.685209 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9a2cc102-e742-4ef7-b120-8be94d084c46 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:53.802340 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-9a2cc102-e742-4ef7-b120-8be94d084c46 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:53.812545 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e17c4018-b15c-45f4-99dc-472ce4340c3e tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:53.813956 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-e17c4018-b15c-45f4-99dc-472ce4340c3e tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] [instance: adef3d1f-fbf2-4093-8151-af1bfe7c667e] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:53.814184 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9a2cc102-e742-4ef7-b120-8be94d084c46 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22" status: 200 len: 1431 microversion: 2.1 time: 0.147634 Oct 12 13:26:53.818902 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 587/1237] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:53 2022] GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22 => generated 1431 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:53.825338 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e17c4018-b15c-45f4-99dc-472ce4340c3e tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:53.826062 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e17c4018-b15c-45f4-99dc-472ce4340c3e tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:53.826654 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e17c4018-b15c-45f4-99dc-472ce4340c3e tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:53.827680 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e17c4018-b15c-45f4-99dc-472ce4340c3e tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:53.828316 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e17c4018-b15c-45f4-99dc-472ce4340c3e tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:53.828924 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e17c4018-b15c-45f4-99dc-472ce4340c3e tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:54.012127 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e17c4018-b15c-45f4-99dc-472ce4340c3e tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:54.022019 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e17c4018-b15c-45f4-99dc-472ce4340c3e tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:54.027904 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e17c4018-b15c-45f4-99dc-472ce4340c3e tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:54.031221 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e17c4018-b15c-45f4-99dc-472ce4340c3e tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] 10.222.0.52 "GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e" status: 200 len: 1338 microversion: 2.47 time: 0.222802 Oct 12 13:26:54.035914 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 651/1238] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:26:53 2022] GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e => generated 1338 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:26:54.217726 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9af8b13e-1c5e-4730-a8c8-4b5528ee27db tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:54.219464 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9af8b13e-1c5e-4730-a8c8-4b5528ee27db tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2d3ddb28-5b74-43dc-9579-d48a61b6d24e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:54.227758 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=12 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:26:54.230245 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9af8b13e-1c5e-4730-a8c8-4b5528ee27db tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:54.231275 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9af8b13e-1c5e-4730-a8c8-4b5528ee27db tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:54.231882 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9af8b13e-1c5e-4730-a8c8-4b5528ee27db tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:54.232858 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9af8b13e-1c5e-4730-a8c8-4b5528ee27db tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:54.233513 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9af8b13e-1c5e-4730-a8c8-4b5528ee27db tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:54.234198 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9af8b13e-1c5e-4730-a8c8-4b5528ee27db tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:54.559253 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-9af8b13e-1c5e-4730-a8c8-4b5528ee27db tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:54.567469 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9af8b13e-1c5e-4730-a8c8-4b5528ee27db tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e" status: 200 len: 1314 microversion: 2.1 time: 0.354693 Oct 12 13:26:54.580246 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 588/1239] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:54 2022] GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:54.585268 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1fe8600a-0986-4c2a-b988-cc6b0ce50e98 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:54.586264 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-1fe8600a-0986-4c2a-b988-cc6b0ce50e98 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:54.594428 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1fe8600a-0986-4c2a-b988-cc6b0ce50e98 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:54.595012 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1fe8600a-0986-4c2a-b988-cc6b0ce50e98 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:54.596109 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1fe8600a-0986-4c2a-b988-cc6b0ce50e98 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:54.597508 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1fe8600a-0986-4c2a-b988-cc6b0ce50e98 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:54.598663 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1fe8600a-0986-4c2a-b988-cc6b0ce50e98 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:54.599086 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1fe8600a-0986-4c2a-b988-cc6b0ce50e98 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:54.842959 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5d0dafdb-339f-407d-b370-c549ca2fc351 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:54.843582 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5d0dafdb-339f-407d-b370-c549ca2fc351 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 04ccef15-bb8d-4f4e-ac84-20c94c040b22] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:54.855378 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-1fe8600a-0986-4c2a-b988-cc6b0ce50e98 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:54.858399 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d0dafdb-339f-407d-b370-c549ca2fc351 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:54.869280 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d0dafdb-339f-407d-b370-c549ca2fc351 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:54.869280 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d0dafdb-339f-407d-b370-c549ca2fc351 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:54.869280 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d0dafdb-339f-407d-b370-c549ca2fc351 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:54.869280 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d0dafdb-339f-407d-b370-c549ca2fc351 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:54.869829 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d0dafdb-339f-407d-b370-c549ca2fc351 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:54.869926 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1fe8600a-0986-4c2a-b988-cc6b0ce50e98 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 200 len: 1474 microversion: 2.1 time: 0.281858 Oct 12 13:26:54.869926 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 652/1240] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:54 2022] GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 1474 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:26:54.960650 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d0dafdb-339f-407d-b370-c549ca2fc351 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:54.961176 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d0dafdb-339f-407d-b370-c549ca2fc351 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:54.961612 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d0dafdb-339f-407d-b370-c549ca2fc351 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:54.973854 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-5d0dafdb-339f-407d-b370-c549ca2fc351 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lazy-loading 'fault' on Instance uuid 04ccef15-bb8d-4f4e-ac84-20c94c040b22 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:26:55.063637 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-467d605e-8dfb-4c42-986b-7d9d64913530 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:55.064540 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-467d605e-8dfb-4c42-986b-7d9d64913530 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] [instance: adef3d1f-fbf2-4093-8151-af1bfe7c667e] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:55.072023 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-467d605e-8dfb-4c42-986b-7d9d64913530 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:55.078470 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-467d605e-8dfb-4c42-986b-7d9d64913530 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:55.079156 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-467d605e-8dfb-4c42-986b-7d9d64913530 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:55.080084 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-467d605e-8dfb-4c42-986b-7d9d64913530 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:55.080718 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-467d605e-8dfb-4c42-986b-7d9d64913530 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:55.081327 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-467d605e-8dfb-4c42-986b-7d9d64913530 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:55.082092 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=10 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:26:55.151292 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-5d0dafdb-339f-407d-b370-c549ca2fc351 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:55.185342 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5d0dafdb-339f-407d-b370-c549ca2fc351 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22" status: 200 len: 1307 microversion: 2.1 time: 0.338792 Oct 12 13:26:55.188249 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 589/1241] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:54 2022] GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22 => generated 1307 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:55.220488 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-467d605e-8dfb-4c42-986b-7d9d64913530 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:55.246573 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-467d605e-8dfb-4c42-986b-7d9d64913530 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:55.248076 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-467d605e-8dfb-4c42-986b-7d9d64913530 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:55.252119 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-467d605e-8dfb-4c42-986b-7d9d64913530 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] 10.222.0.52 "GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e" status: 200 len: 1338 microversion: 2.47 time: 0.190062 Oct 12 13:26:55.253606 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 653/1242] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:26:55 2022] GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e => generated 1338 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:26:55.593883 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f3a23a9b-fd5a-43fa-be11-497b93014201 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:55.594938 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f3a23a9b-fd5a-43fa-be11-497b93014201 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2d3ddb28-5b74-43dc-9579-d48a61b6d24e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:55.603276 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f3a23a9b-fd5a-43fa-be11-497b93014201 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:55.603931 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f3a23a9b-fd5a-43fa-be11-497b93014201 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:55.604571 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f3a23a9b-fd5a-43fa-be11-497b93014201 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:55.605690 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f3a23a9b-fd5a-43fa-be11-497b93014201 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:55.606363 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f3a23a9b-fd5a-43fa-be11-497b93014201 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:55.606855 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f3a23a9b-fd5a-43fa-be11-497b93014201 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:55.886406 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1799ae3a-1a31-467f-884c-69807e53793c tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:55.888194 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-1799ae3a-1a31-467f-884c-69807e53793c tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:55.917164 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1799ae3a-1a31-467f-884c-69807e53793c tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:55.917429 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1799ae3a-1a31-467f-884c-69807e53793c tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:55.918437 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1799ae3a-1a31-467f-884c-69807e53793c tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:55.919789 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1799ae3a-1a31-467f-884c-69807e53793c tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:55.920608 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1799ae3a-1a31-467f-884c-69807e53793c tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:55.922023 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1799ae3a-1a31-467f-884c-69807e53793c tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:55.941443 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f3a23a9b-fd5a-43fa-be11-497b93014201 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:55.949762 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f3a23a9b-fd5a-43fa-be11-497b93014201 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e" status: 200 len: 1314 microversion: 2.1 time: 0.361891 Oct 12 13:26:55.965240 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 590/1243] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:55 2022] GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:56.207915 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5f1daa15-d08d-4996-a307-08489959274c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:56.208535 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5f1daa15-d08d-4996-a307-08489959274c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 04ccef15-bb8d-4f4e-ac84-20c94c040b22] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:56.215894 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f1daa15-d08d-4996-a307-08489959274c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:56.216375 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f1daa15-d08d-4996-a307-08489959274c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:56.216812 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f1daa15-d08d-4996-a307-08489959274c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:56.225964 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f1daa15-d08d-4996-a307-08489959274c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:56.226681 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f1daa15-d08d-4996-a307-08489959274c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:56.227293 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f1daa15-d08d-4996-a307-08489959274c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:56.258840 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-5f1daa15-d08d-4996-a307-08489959274c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] HTTP exception thrown: Instance 04ccef15-bb8d-4f4e-ac84-20c94c040b22 could not be found. Oct 12 13:26:56.260514 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5f1daa15-d08d-4996-a307-08489959274c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Request method failure captured: Oct 12 13:26:56.260514 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22 HTTP/1.1 Oct 12 13:26:56.260514 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:26:56.260514 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:26:56.260514 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:26:56.260514 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:26:56.260514 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:26:56.260514 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:26:56.260514 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:26:56.260514 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:26:56.260514 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr_CCC7LiW_hy7m97LgwkFPF9p6huyY-CWLyQ6oZUHSaBS0K99iV_bpm0lEjAWwlhR5ZBm_SyiP0a6LEf1zwW7PqsfI2rGUmQ5fC8cBIWNpgn3dQQDgP9Y9DZPHDnybACv0UadoqhUY-B-6kowhluEo_e2Vq2P-MSnih4jhQxgwR_Q8 Oct 12 13:26:56.260514 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:26:56.260514 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:26:56.260514 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:26:56.260514 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:26:56.260514 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:26:56.260514 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:26:56.260514 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: be50900be6b246aa9289de6ec5d366f9 Oct 12 13:26:56.260514 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:26:56.260514 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:26:56.260514 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:26:56.262387 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be50900be6b246aa9289de6ec5d366f9"}]}] Oct 12 13:26:56.262387 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:26:56.262387 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: be50900be6b246aa9289de6ec5d366f9 Oct 12 13:26:56.262387 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:26:56.262387 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServersOnMultiNodesTest-1850216957-project Oct 12 13:26:56.262387 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:26:56.262387 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:26:56.262387 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: a0fd9458bb2842829a1e13ac93fade30 Oct 12 13:26:56.262387 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServersOnMultiNodesTest-1850216957-project Oct 12 13:26:56.262387 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:26:56.262387 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance 04ccef15-bb8d-4f4e-ac84-20c94c040b22 could not be found. Oct 12 13:26:56.262387 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '04ccef15-bb8d-4f4e-ac84-20c94c040b22'} Oct 12 13:26:56.263552 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:26:56.263552 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:56.263552 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:26:56.263552 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:26:56.263552 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:26:56.263552 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:26:56.263552 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:26:56.263552 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:26:56.263552 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:26:56.263552 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:26:56.263552 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04ccef15-bb8d-4f4e-ac84-20c94c040b22 could not be found. Oct 12 13:26:56.263552 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:56.263552 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:56.263552 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:56.263552 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:56.263552 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:56.263552 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:56.263552 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:26:56.263552 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:26:56.263552 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:26:56.265145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:26:56.265145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:26:56.265145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:26:56.265145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:26:56.265145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:26:56.265145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:26:56.265145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:26:56.265145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04ccef15-bb8d-4f4e-ac84-20c94c040b22 could not be found. Oct 12 13:26:56.265145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:56.265145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:26:56.265145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:56.265145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:26:56.265145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:26:56.265145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:26:56.265145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:26:56.265145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:26:56.265145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04ccef15-bb8d-4f4e-ac84-20c94c040b22 could not be found. Oct 12 13:26:56.265145 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:26:56.267289 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5f1daa15-d08d-4996-a307-08489959274c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Returning 404 to user: Instance 04ccef15-bb8d-4f4e-ac84-20c94c040b22 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:26:56.268378 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5f1daa15-d08d-4996-a307-08489959274c tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22" status: 404 len: 111 microversion: 2.1 time: 0.064644 Oct 12 13:26:56.275446 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 591/1244] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:56 2022] GET /compute/v2.1/servers/04ccef15-bb8d-4f4e-ac84-20c94c040b22 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:26:56.282701 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-845a11e4-46bd-48e7-8db5-abfefe78edf0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:56.283430 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-845a11e4-46bd-48e7-8db5-abfefe78edf0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:56.292487 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-845a11e4-46bd-48e7-8db5-abfefe78edf0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:56.294772 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-845a11e4-46bd-48e7-8db5-abfefe78edf0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:56.298258 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-845a11e4-46bd-48e7-8db5-abfefe78edf0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:56.300341 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-845a11e4-46bd-48e7-8db5-abfefe78edf0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:56.300831 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-845a11e4-46bd-48e7-8db5-abfefe78edf0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:56.302221 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-845a11e4-46bd-48e7-8db5-abfefe78edf0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:56.345167 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-845a11e4-46bd-48e7-8db5-abfefe78edf0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:26:56.375909 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-1799ae3a-1a31-467f-884c-69807e53793c tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:56.397527 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1799ae3a-1a31-467f-884c-69807e53793c tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 200 len: 1474 microversion: 2.1 time: 0.507396 Oct 12 13:26:56.397945 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 654/1245] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:55 2022] GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 1474 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:26:56.404673 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a4f948b7-eb22-4163-9a63-7f589c35fdde tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:56.407532 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a4f948b7-eb22-4163-9a63-7f589c35fdde tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] [instance: adef3d1f-fbf2-4093-8151-af1bfe7c667e] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:56.427749 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a4f948b7-eb22-4163-9a63-7f589c35fdde tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:56.429024 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a4f948b7-eb22-4163-9a63-7f589c35fdde tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:56.429669 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a4f948b7-eb22-4163-9a63-7f589c35fdde tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:56.430761 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a4f948b7-eb22-4163-9a63-7f589c35fdde tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:56.437800 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a4f948b7-eb22-4163-9a63-7f589c35fdde tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:56.437800 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a4f948b7-eb22-4163-9a63-7f589c35fdde tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:56.590403 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a4f948b7-eb22-4163-9a63-7f589c35fdde tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:56.602127 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a4f948b7-eb22-4163-9a63-7f589c35fdde tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:56.609034 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a4f948b7-eb22-4163-9a63-7f589c35fdde tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:56.610588 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a4f948b7-eb22-4163-9a63-7f589c35fdde tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] 10.222.0.52 "GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e" status: 200 len: 1359 microversion: 2.47 time: 0.211293 Oct 12 13:26:56.615370 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 655/1246] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:26:56 2022] GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:26:56.644573 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b4d5cd5d-a441-4d5d-9e53-ab484fb0de6d tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-737666816"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:56.650969 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-b4d5cd5d-a441-4d5d-9e53-ab484fb0de6d tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] [instance: adef3d1f-fbf2-4093-8151-af1bfe7c667e] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:56.668206 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4d5cd5d-a441-4d5d-9e53-ab484fb0de6d tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:56.669198 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4d5cd5d-a441-4d5d-9e53-ab484fb0de6d tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:56.669900 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4d5cd5d-a441-4d5d-9e53-ab484fb0de6d tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:56.677410 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4d5cd5d-a441-4d5d-9e53-ab484fb0de6d tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:56.677916 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4d5cd5d-a441-4d5d-9e53-ab484fb0de6d tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:56.678360 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4d5cd5d-a441-4d5d-9e53-ab484fb0de6d tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:56.867057 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-845a11e4-46bd-48e7-8db5-abfefe78edf0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d" status: 204 len: 0 microversion: 2.1 time: 0.589555 Oct 12 13:26:56.867990 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 592/1247] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:26:56 2022] DELETE /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d => generated 0 bytes in 592 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:26:56.884938 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-908a7ce6-4bb0-410d-839d-70dfce383ca0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:56.885692 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-908a7ce6-4bb0-410d-839d-70dfce383ca0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:56.916464 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-908a7ce6-4bb0-410d-839d-70dfce383ca0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:56.921757 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-908a7ce6-4bb0-410d-839d-70dfce383ca0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:56.923512 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-908a7ce6-4bb0-410d-839d-70dfce383ca0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:56.929497 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-908a7ce6-4bb0-410d-839d-70dfce383ca0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:56.930018 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-908a7ce6-4bb0-410d-839d-70dfce383ca0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:56.939903 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-908a7ce6-4bb0-410d-839d-70dfce383ca0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:57.207091 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:26:57.416361 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b4d5cd5d-a441-4d5d-9e53-ab484fb0de6d tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] 10.222.0.52 "POST /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e/action" status: 202 len: 52 microversion: 2.47 time: 0.778426 Oct 12 13:26:57.422631 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 656/1248] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Oct 12 13:26:56 2022] POST /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e/action => generated 52 bytes in 787 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 12 13:26:57.428366 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-617e407e-fedf-471a-be80-037c460670b7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:57.429113 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-617e407e-fedf-471a-be80-037c460670b7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2d3ddb28-5b74-43dc-9579-d48a61b6d24e] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:57.438016 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-617e407e-fedf-471a-be80-037c460670b7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:57.439386 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-617e407e-fedf-471a-be80-037c460670b7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:57.456582 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-617e407e-fedf-471a-be80-037c460670b7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:57.456582 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-617e407e-fedf-471a-be80-037c460670b7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:57.456582 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-617e407e-fedf-471a-be80-037c460670b7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:57.456582 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-617e407e-fedf-471a-be80-037c460670b7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:57.498111 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-908a7ce6-4bb0-410d-839d-70dfce383ca0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:57.508669 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-908a7ce6-4bb0-410d-839d-70dfce383ca0 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d" status: 200 len: 1473 microversion: 2.1 time: 0.636415 Oct 12 13:26:57.510945 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 593/1249] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:56 2022] GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d => generated 1473 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:26:57.529365 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-16757e84-8aca-4d08-aaba-a621d543bb91 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:57.530029 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-16757e84-8aca-4d08-aaba-a621d543bb91 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:57.536488 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-16757e84-8aca-4d08-aaba-a621d543bb91 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:57.537274 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-16757e84-8aca-4d08-aaba-a621d543bb91 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:57.537904 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-16757e84-8aca-4d08-aaba-a621d543bb91 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:57.538792 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-16757e84-8aca-4d08-aaba-a621d543bb91 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:57.539508 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-16757e84-8aca-4d08-aaba-a621d543bb91 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:57.540096 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-16757e84-8aca-4d08-aaba-a621d543bb91 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:57.655387 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-16757e84-8aca-4d08-aaba-a621d543bb91 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:57.664666 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-16757e84-8aca-4d08-aaba-a621d543bb91 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 200 len: 1432 microversion: 2.1 time: 0.152435 Oct 12 13:26:57.676656 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 594/1250] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:57 2022] GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 1432 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:57.681303 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2f3486a9-41d8-4f24-9242-67ff858bcdf3 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:57.681811 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2f3486a9-41d8-4f24-9242-67ff858bcdf3 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] [instance: adef3d1f-fbf2-4093-8151-af1bfe7c667e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:57.702022 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f3486a9-41d8-4f24-9242-67ff858bcdf3 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:57.702022 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f3486a9-41d8-4f24-9242-67ff858bcdf3 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:57.702445 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f3486a9-41d8-4f24-9242-67ff858bcdf3 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:57.703165 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f3486a9-41d8-4f24-9242-67ff858bcdf3 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:57.703628 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f3486a9-41d8-4f24-9242-67ff858bcdf3 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:57.704224 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f3486a9-41d8-4f24-9242-67ff858bcdf3 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:57.764029 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2f3486a9-41d8-4f24-9242-67ff858bcdf3 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] [instance: adef3d1f-fbf2-4093-8151-af1bfe7c667e] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:26:57.812477 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-617e407e-fedf-471a-be80-037c460670b7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:57.826986 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-617e407e-fedf-471a-be80-037c460670b7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e" status: 200 len: 1314 microversion: 2.1 time: 0.405083 Oct 12 13:26:57.832559 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 657/1251] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:57 2022] GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:57.840435 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-c206d951-bf2c-4d3d-9a69-2f2357489dba req-5d2e9aa0-fe39-4eca-86d3-f205d20df958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb212be-202b-4e4d-993a-80dfa753aa9d", "name": "network-vif-deleted", "tag": "59a191b0-d550-4432-be96-95cccb474ded"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:26:57.868360 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-c206d951-bf2c-4d3d-9a69-2f2357489dba req-5d2e9aa0-fe39-4eca-86d3-f205d20df958 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:57.871759 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-c206d951-bf2c-4d3d-9a69-2f2357489dba req-5d2e9aa0-fe39-4eca-86d3-f205d20df958 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:57.872457 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-c206d951-bf2c-4d3d-9a69-2f2357489dba req-5d2e9aa0-fe39-4eca-86d3-f205d20df958 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:57.908722 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-c206d951-bf2c-4d3d-9a69-2f2357489dba req-5d2e9aa0-fe39-4eca-86d3-f205d20df958 service nova] Creating event network-vif-deleted:59a191b0-d550-4432-be96-95cccb474ded for instance 5fb212be-202b-4e4d-993a-80dfa753aa9d on n-h2-861076-2 Oct 12 13:26:57.921425 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-c206d951-bf2c-4d3d-9a69-2f2357489dba req-5d2e9aa0-fe39-4eca-86d3-f205d20df958 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083880 Oct 12 13:26:57.928550 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 658/1252] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:26:58.142090 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2f3486a9-41d8-4f24-9242-67ff858bcdf3 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] 10.222.0.52 "DELETE /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e" status: 204 len: 0 microversion: 2.47 time: 0.464261 Oct 12 13:26:58.143003 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 595/1253] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 12 13:26:57 2022] DELETE /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 13:26:58.155205 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-dbf5bc46-d223-4133-a437-2a6912c75fe0 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:58.156217 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-dbf5bc46-d223-4133-a437-2a6912c75fe0 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] [instance: adef3d1f-fbf2-4093-8151-af1bfe7c667e] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:58.174181 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dbf5bc46-d223-4133-a437-2a6912c75fe0 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:58.174995 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dbf5bc46-d223-4133-a437-2a6912c75fe0 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:58.177334 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dbf5bc46-d223-4133-a437-2a6912c75fe0 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:58.178991 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dbf5bc46-d223-4133-a437-2a6912c75fe0 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:58.180330 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dbf5bc46-d223-4133-a437-2a6912c75fe0 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:58.181970 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dbf5bc46-d223-4133-a437-2a6912c75fe0 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:58.427362 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-dbf5bc46-d223-4133-a437-2a6912c75fe0 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:58.444255 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-dbf5bc46-d223-4133-a437-2a6912c75fe0 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:58.447731 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-dbf5bc46-d223-4133-a437-2a6912c75fe0 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:58.452024 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-dbf5bc46-d223-4133-a437-2a6912c75fe0 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] 10.222.0.52 "GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e" status: 200 len: 1365 microversion: 2.47 time: 0.303404 Oct 12 13:26:58.455191 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 659/1254] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:26:58 2022] GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e => generated 1365 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:26:58.544471 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1c770bdc-21d5-4313-80c7-960e447662f5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:58.549510 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1c770bdc-21d5-4313-80c7-960e447662f5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:58.578134 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c770bdc-21d5-4313-80c7-960e447662f5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:58.578134 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c770bdc-21d5-4313-80c7-960e447662f5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:58.578604 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c770bdc-21d5-4313-80c7-960e447662f5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:58.580346 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c770bdc-21d5-4313-80c7-960e447662f5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:58.581403 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c770bdc-21d5-4313-80c7-960e447662f5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:58.583130 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c770bdc-21d5-4313-80c7-960e447662f5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:58.706189 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6558b993-76eb-4619-9536-d1f3999830b8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:58.707106 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-6558b993-76eb-4619-9536-d1f3999830b8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:58.723499 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6558b993-76eb-4619-9536-d1f3999830b8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:58.724421 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6558b993-76eb-4619-9536-d1f3999830b8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:58.726271 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6558b993-76eb-4619-9536-d1f3999830b8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:58.728844 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6558b993-76eb-4619-9536-d1f3999830b8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:58.730355 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6558b993-76eb-4619-9536-d1f3999830b8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:58.732868 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6558b993-76eb-4619-9536-d1f3999830b8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:58.865363 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6558b993-76eb-4619-9536-d1f3999830b8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:58.865772 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6558b993-76eb-4619-9536-d1f3999830b8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:58.866827 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6558b993-76eb-4619-9536-d1f3999830b8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:58.869049 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-6558b993-76eb-4619-9536-d1f3999830b8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lazy-loading 'fault' on Instance uuid 5fb212be-202b-4e4d-993a-80dfa753aa9d {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:26:59.083978 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-6558b993-76eb-4619-9536-d1f3999830b8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:59.102649 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6558b993-76eb-4619-9536-d1f3999830b8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 200 len: 1308 microversion: 2.1 time: 0.394318 Oct 12 13:26:59.102649 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 660/1255] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:58 2022] GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 1308 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:59.114263 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c2a82113-7a63-4893-9c35-ae65466cda02 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:59.115024 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c2a82113-7a63-4893-9c35-ae65466cda02 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2d3ddb28-5b74-43dc-9579-d48a61b6d24e] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:59.127320 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2a82113-7a63-4893-9c35-ae65466cda02 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:59.130152 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2a82113-7a63-4893-9c35-ae65466cda02 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:59.130708 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2a82113-7a63-4893-9c35-ae65466cda02 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:59.131526 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2a82113-7a63-4893-9c35-ae65466cda02 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:59.134251 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2a82113-7a63-4893-9c35-ae65466cda02 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:59.135115 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2a82113-7a63-4893-9c35-ae65466cda02 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:59.624150 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-1c770bdc-21d5-4313-80c7-960e447662f5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:59.633349 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1c770bdc-21d5-4313-80c7-960e447662f5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d" status: 200 len: 1473 microversion: 2.1 time: 1.100130 Oct 12 13:26:59.637193 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 596/1256] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:58 2022] GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d => generated 1473 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:26:59.648077 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c6ca2e90-31ce-4046-9253-18f3ef9c4722 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:26:59.651989 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c6ca2e90-31ce-4046-9253-18f3ef9c4722 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] [instance: adef3d1f-fbf2-4093-8151-af1bfe7c667e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:26:59.663701 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c6ca2e90-31ce-4046-9253-18f3ef9c4722 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:59.666340 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c6ca2e90-31ce-4046-9253-18f3ef9c4722 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:59.671480 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c6ca2e90-31ce-4046-9253-18f3ef9c4722 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:59.672588 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c6ca2e90-31ce-4046-9253-18f3ef9c4722 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:26:59.673373 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c6ca2e90-31ce-4046-9253-18f3ef9c4722 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:26:59.674346 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c6ca2e90-31ce-4046-9253-18f3ef9c4722 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:26:59.846783 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c6ca2e90-31ce-4046-9253-18f3ef9c4722 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:59.856406 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c6ca2e90-31ce-4046-9253-18f3ef9c4722 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:59.858017 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c6ca2e90-31ce-4046-9253-18f3ef9c4722 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:26:59.859551 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c6ca2e90-31ce-4046-9253-18f3ef9c4722 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] 10.222.0.52 "GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e" status: 200 len: 1365 microversion: 2.47 time: 0.220054 Oct 12 13:26:59.860586 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 597/1257] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:26:59 2022] GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:26:59.992457 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-c2a82113-7a63-4893-9c35-ae65466cda02 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:00.001557 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c2a82113-7a63-4893-9c35-ae65466cda02 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e" status: 200 len: 1314 microversion: 2.1 time: 0.899044 Oct 12 13:27:00.006449 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 661/1258] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:26:59 2022] GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e => generated 1314 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:00.122481 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-45ec5391-68d3-4694-82dc-e0866e896598 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:00.123923 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-45ec5391-68d3-4694-82dc-e0866e896598 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 5fb212be-202b-4e4d-993a-80dfa753aa9d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:00.140721 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-45ec5391-68d3-4694-82dc-e0866e896598 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:00.143708 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-45ec5391-68d3-4694-82dc-e0866e896598 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:00.144249 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-45ec5391-68d3-4694-82dc-e0866e896598 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:00.151155 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-45ec5391-68d3-4694-82dc-e0866e896598 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:00.151155 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-45ec5391-68d3-4694-82dc-e0866e896598 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:00.151155 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-45ec5391-68d3-4694-82dc-e0866e896598 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:00.172227 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-45ec5391-68d3-4694-82dc-e0866e896598 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] HTTP exception thrown: Instance 5fb212be-202b-4e4d-993a-80dfa753aa9d could not be found. Oct 12 13:27:00.177676 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-45ec5391-68d3-4694-82dc-e0866e896598 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Request method failure captured: Oct 12 13:27:00.177676 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d HTTP/1.1 Oct 12 13:27:00.177676 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:27:00.177676 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:27:00.177676 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:27:00.177676 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:27:00.177676 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:27:00.177676 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:27:00.177676 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:27:00.177676 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:00.177676 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr_WL4vGSnYaDaz2X9ZP2oh1C8ZndYGgDgTP8FKj2tDyrW4RPOEqpQZaj1dE3yXRuRpTcBC0Ipwxn_NVmE3EXopk6ZQYOvp5y0vxe2867kR-wilWVrhFORlrGeKY0M2tTUg71QfHwCJBv8QIHJ7tJpNOtEKjhrU04AkOn6vygt0VuMo Oct 12 13:27:00.177676 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:27:00.177676 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:27:00.177676 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:27:00.177676 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:27:00.177676 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:27:00.177676 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:27:00.177676 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 85881fdc9e214dae8009054e5cd0bad8 Oct 12 13:27:00.177676 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ListImageFiltersTestJSON-1397987456 Oct 12 13:27:00.177676 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:27:00.177676 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:27:00.179377 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/85881fdc9e214dae8009054e5cd0bad8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_85881fdc9e214dae8009054e5cd0bad8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/85881fdc9e214dae8009054e5cd0bad8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/85881fdc9e214dae8009054e5cd0bad8"}]}] Oct 12 13:27:00.179377 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ListImageFiltersTestJSON-1397987456 Oct 12 13:27:00.179377 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 85881fdc9e214dae8009054e5cd0bad8 Oct 12 13:27:00.179377 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1397987456 Oct 12 13:27:00.179377 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ListImageFiltersTestJSON-1397987456-project Oct 12 13:27:00.179377 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:27:00.179377 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:27:00.179377 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 72b6dea3b64b4418b9bf590c4519cda3 Oct 12 13:27:00.179377 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ListImageFiltersTestJSON-1397987456-project Oct 12 13:27:00.179377 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:27:00.179377 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance 5fb212be-202b-4e4d-993a-80dfa753aa9d could not be found. Oct 12 13:27:00.179377 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '5fb212be-202b-4e4d-993a-80dfa753aa9d'} Oct 12 13:27:00.180322 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:00.180322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:00.180322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:27:00.180322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:27:00.180322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:27:00.180322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:27:00.180322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:27:00.180322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:27:00.180322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:27:00.180322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:27:00.180322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb212be-202b-4e4d-993a-80dfa753aa9d could not be found. Oct 12 13:27:00.180322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:00.180322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:00.180322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:00.180322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:00.180322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:00.180322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:00.180322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:00.180322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:00.180322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:00.182472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:00.182472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:27:00.182472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:27:00.182472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:27:00.182472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:27:00.182472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:27:00.182472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:27:00.182472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb212be-202b-4e4d-993a-80dfa753aa9d could not be found. Oct 12 13:27:00.182472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:00.182472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:00.182472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:00.182472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:00.182472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:00.182472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:00.182472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:00.182472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:00.182472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb212be-202b-4e4d-993a-80dfa753aa9d could not be found. Oct 12 13:27:00.182472 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:00.186949 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-45ec5391-68d3-4694-82dc-e0866e896598 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Returning 404 to user: Instance 5fb212be-202b-4e4d-993a-80dfa753aa9d could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:00.188843 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-45ec5391-68d3-4694-82dc-e0866e896598 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d" status: 404 len: 111 microversion: 2.1 time: 0.070594 Oct 12 13:27:00.199633 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 598/1259] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:00 2022] GET /compute/v2.1/servers/5fb212be-202b-4e4d-993a-80dfa753aa9d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:27:00.200253 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-98dde883-5b80-4d3e-b66e-654346fc37b5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:00.201675 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-98dde883-5b80-4d3e-b66e-654346fc37b5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 14676667-3743-4d37-8ff9-f8d161a483d4] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:00.213981 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-98dde883-5b80-4d3e-b66e-654346fc37b5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:00.219268 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-98dde883-5b80-4d3e-b66e-654346fc37b5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:00.219813 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-98dde883-5b80-4d3e-b66e-654346fc37b5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:00.220714 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-98dde883-5b80-4d3e-b66e-654346fc37b5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:00.221286 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-98dde883-5b80-4d3e-b66e-654346fc37b5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:00.224067 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-98dde883-5b80-4d3e-b66e-654346fc37b5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:00.285562 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-98dde883-5b80-4d3e-b66e-654346fc37b5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 14676667-3743-4d37-8ff9-f8d161a483d4] Going to try to terminate instance {{(pid=120933) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:27:00.666089 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7cd9633a-fc8e-4dc7-bb42-eedbe36cfaa7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:00.666973 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7cd9633a-fc8e-4dc7-bb42-eedbe36cfaa7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:00.687611 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7cd9633a-fc8e-4dc7-bb42-eedbe36cfaa7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:00.688112 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7cd9633a-fc8e-4dc7-bb42-eedbe36cfaa7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:00.696950 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7cd9633a-fc8e-4dc7-bb42-eedbe36cfaa7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:00.699904 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7cd9633a-fc8e-4dc7-bb42-eedbe36cfaa7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:00.700561 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7cd9633a-fc8e-4dc7-bb42-eedbe36cfaa7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:00.702271 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7cd9633a-fc8e-4dc7-bb42-eedbe36cfaa7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:00.788663 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-98dde883-5b80-4d3e-b66e-654346fc37b5 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "DELETE /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4" status: 204 len: 0 microversion: 2.1 time: 0.592808 Oct 12 13:27:00.793202 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 662/1260] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:27:00 2022] DELETE /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:27:00.807984 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f6f833df-1c40-49f0-8172-6974b46e6653 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:00.809130 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f6f833df-1c40-49f0-8172-6974b46e6653 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 14676667-3743-4d37-8ff9-f8d161a483d4] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:00.824152 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f6f833df-1c40-49f0-8172-6974b46e6653 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:00.830660 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f6f833df-1c40-49f0-8172-6974b46e6653 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:00.830660 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f6f833df-1c40-49f0-8172-6974b46e6653 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:00.830660 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f6f833df-1c40-49f0-8172-6974b46e6653 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:00.830660 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f6f833df-1c40-49f0-8172-6974b46e6653 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:00.831639 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f6f833df-1c40-49f0-8172-6974b46e6653 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:00.852252 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-7cd9633a-fc8e-4dc7-bb42-eedbe36cfaa7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:00.863744 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7cd9633a-fc8e-4dc7-bb42-eedbe36cfaa7 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d" status: 200 len: 1431 microversion: 2.1 time: 0.203430 Oct 12 13:27:00.872208 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 599/1261] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:00 2022] GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d => generated 1431 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:00.896263 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a645b5df-cf09-463c-ac85-a4823bfb5605 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:00.897663 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a645b5df-cf09-463c-ac85-a4823bfb5605 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] [instance: adef3d1f-fbf2-4093-8151-af1bfe7c667e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:00.917240 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a645b5df-cf09-463c-ac85-a4823bfb5605 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:00.919608 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a645b5df-cf09-463c-ac85-a4823bfb5605 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:00.922780 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a645b5df-cf09-463c-ac85-a4823bfb5605 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:00.925555 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a645b5df-cf09-463c-ac85-a4823bfb5605 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:00.926274 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a645b5df-cf09-463c-ac85-a4823bfb5605 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:00.931771 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a645b5df-cf09-463c-ac85-a4823bfb5605 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:00.980622 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:27:01.110308 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-a645b5df-cf09-463c-ac85-a4823bfb5605 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:01.124278 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-a645b5df-cf09-463c-ac85-a4823bfb5605 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:01.125995 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-a645b5df-cf09-463c-ac85-a4823bfb5605 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:01.127201 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a645b5df-cf09-463c-ac85-a4823bfb5605 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] 10.222.0.52 "GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e" status: 200 len: 1365 microversion: 2.47 time: 0.240829 Oct 12 13:27:01.136277 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 600/1262] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:27:00 2022] GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:27:01.412054 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f6f833df-1c40-49f0-8172-6974b46e6653 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:01.424390 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f6f833df-1c40-49f0-8172-6974b46e6653 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4" status: 200 len: 1472 microversion: 2.1 time: 0.629005 Oct 12 13:27:01.425010 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 663/1263] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:00 2022] GET /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4 => generated 1472 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:01.440030 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-dda0f7f8-d3de-4cc9-be32-b6d6df255f3e tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:01.453932 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-dda0f7f8-d3de-4cc9-be32-b6d6df255f3e tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2d3ddb28-5b74-43dc-9579-d48a61b6d24e] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:01.484123 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dda0f7f8-d3de-4cc9-be32-b6d6df255f3e tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:01.486732 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dda0f7f8-d3de-4cc9-be32-b6d6df255f3e tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:01.490031 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dda0f7f8-d3de-4cc9-be32-b6d6df255f3e tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:01.496923 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dda0f7f8-d3de-4cc9-be32-b6d6df255f3e tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:01.499004 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dda0f7f8-d3de-4cc9-be32-b6d6df255f3e tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:01.500041 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dda0f7f8-d3de-4cc9-be32-b6d6df255f3e tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:01.598775 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-62188702-be04-4416-90bb-ba0ee19beded req-3806fe29-c7f9-40d9-ac1a-5eb851ded474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e37b5b43-6124-4cd8-bdba-1c489326db1d", "name": "network-vif-deleted", "tag": "0b9eae89-c32d-4a0b-9567-be443a4f3d00"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:01.635026 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-62188702-be04-4416-90bb-ba0ee19beded req-3806fe29-c7f9-40d9-ac1a-5eb851ded474 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:01.635514 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-62188702-be04-4416-90bb-ba0ee19beded req-3806fe29-c7f9-40d9-ac1a-5eb851ded474 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:01.635966 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-62188702-be04-4416-90bb-ba0ee19beded req-3806fe29-c7f9-40d9-ac1a-5eb851ded474 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:01.722527 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-62188702-be04-4416-90bb-ba0ee19beded req-3806fe29-c7f9-40d9-ac1a-5eb851ded474 service nova] Creating event network-vif-deleted:0b9eae89-c32d-4a0b-9567-be443a4f3d00 for instance e37b5b43-6124-4cd8-bdba-1c489326db1d on n-h2-861076-2 Oct 12 13:27:01.743328 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-62188702-be04-4416-90bb-ba0ee19beded req-3806fe29-c7f9-40d9-ac1a-5eb851ded474 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.604908 Oct 12 13:27:01.752217 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 601/1264] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:01.904244 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ccfd93be-4779-4bd1-b4ad-3154b3cfb9a5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:01.905134 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ccfd93be-4779-4bd1-b4ad-3154b3cfb9a5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:01.914206 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccfd93be-4779-4bd1-b4ad-3154b3cfb9a5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:01.917008 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccfd93be-4779-4bd1-b4ad-3154b3cfb9a5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:01.919838 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccfd93be-4779-4bd1-b4ad-3154b3cfb9a5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:01.922490 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccfd93be-4779-4bd1-b4ad-3154b3cfb9a5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:01.924114 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccfd93be-4779-4bd1-b4ad-3154b3cfb9a5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:01.926650 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccfd93be-4779-4bd1-b4ad-3154b3cfb9a5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:02.154336 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-ccfd93be-4779-4bd1-b4ad-3154b3cfb9a5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:02.166363 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ccfd93be-4779-4bd1-b4ad-3154b3cfb9a5 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d" status: 200 len: 1302 microversion: 2.1 time: 0.266505 Oct 12 13:27:02.185339 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 602/1265] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:01 2022] GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d => generated 1302 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:27:02.191589 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-378580c7-f1f1-440d-9dbe-e99fb6adce45 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:02.197794 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-378580c7-f1f1-440d-9dbe-e99fb6adce45 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] [instance: adef3d1f-fbf2-4093-8151-af1bfe7c667e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:02.209525 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-378580c7-f1f1-440d-9dbe-e99fb6adce45 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:02.210136 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-378580c7-f1f1-440d-9dbe-e99fb6adce45 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:02.213297 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-378580c7-f1f1-440d-9dbe-e99fb6adce45 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:02.215371 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-378580c7-f1f1-440d-9dbe-e99fb6adce45 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:02.215371 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-378580c7-f1f1-440d-9dbe-e99fb6adce45 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:02.215371 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-378580c7-f1f1-440d-9dbe-e99fb6adce45 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:02.256538 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-dda0f7f8-d3de-4cc9-be32-b6d6df255f3e tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:02.284794 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-dda0f7f8-d3de-4cc9-be32-b6d6df255f3e tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e" status: 200 len: 1314 microversion: 2.1 time: 0.852756 Oct 12 13:27:02.287153 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 664/1266] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:01 2022] GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e => generated 1314 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:02.396144 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-378580c7-f1f1-440d-9dbe-e99fb6adce45 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:02.410763 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-378580c7-f1f1-440d-9dbe-e99fb6adce45 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:02.412649 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-378580c7-f1f1-440d-9dbe-e99fb6adce45 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:02.416924 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-378580c7-f1f1-440d-9dbe-e99fb6adce45 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] 10.222.0.52 "GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e" status: 200 len: 1365 microversion: 2.47 time: 0.229701 Oct 12 13:27:02.418708 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 603/1267] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:27:02 2022] GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:27:02.458323 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9a343ec3-1b9e-42fd-b2b9-ebb7c4a3b68a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:02.471160 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-9a343ec3-1b9e-42fd-b2b9-ebb7c4a3b68a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 14676667-3743-4d37-8ff9-f8d161a483d4] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:02.481511 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9a343ec3-1b9e-42fd-b2b9-ebb7c4a3b68a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:02.482372 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9a343ec3-1b9e-42fd-b2b9-ebb7c4a3b68a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:02.486419 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9a343ec3-1b9e-42fd-b2b9-ebb7c4a3b68a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:02.489090 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9a343ec3-1b9e-42fd-b2b9-ebb7c4a3b68a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:02.489973 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9a343ec3-1b9e-42fd-b2b9-ebb7c4a3b68a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:02.490653 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9a343ec3-1b9e-42fd-b2b9-ebb7c4a3b68a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:02.837505 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-88fe7c94-3caa-4651-a70d-d83d0a72704c req-a2bd68c1-4a61-4b97-b98a-a859f8cafa85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3ddb28-5b74-43dc-9579-d48a61b6d24e", "name": "network-vif-plugged", "status": "completed", "tag": "75aaeb66-849a-4294-a96c-56858c711618"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:02.864581 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-88fe7c94-3caa-4651-a70d-d83d0a72704c req-a2bd68c1-4a61-4b97-b98a-a859f8cafa85 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:02.865360 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-88fe7c94-3caa-4651-a70d-d83d0a72704c req-a2bd68c1-4a61-4b97-b98a-a859f8cafa85 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:02.866217 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-88fe7c94-3caa-4651-a70d-d83d0a72704c req-a2bd68c1-4a61-4b97-b98a-a859f8cafa85 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:02.902146 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-88fe7c94-3caa-4651-a70d-d83d0a72704c req-a2bd68c1-4a61-4b97-b98a-a859f8cafa85 service nova] Creating event network-vif-plugged:75aaeb66-849a-4294-a96c-56858c711618 for instance 2d3ddb28-5b74-43dc-9579-d48a61b6d24e on n-h1-861076-2 Oct 12 13:27:02.924332 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-88fe7c94-3caa-4651-a70d-d83d0a72704c req-a2bd68c1-4a61-4b97-b98a-a859f8cafa85 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089952 Oct 12 13:27:02.932451 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 604/1268] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:27:03.206892 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e0d3db45-2465-4361-a4e0-8b39ac7e4824 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:03.207070 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e0d3db45-2465-4361-a4e0-8b39ac7e4824 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:03.226278 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0d3db45-2465-4361-a4e0-8b39ac7e4824 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:03.226278 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0d3db45-2465-4361-a4e0-8b39ac7e4824 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:03.230326 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0d3db45-2465-4361-a4e0-8b39ac7e4824 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:03.231196 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0d3db45-2465-4361-a4e0-8b39ac7e4824 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:03.231787 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0d3db45-2465-4361-a4e0-8b39ac7e4824 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:03.234435 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0d3db45-2465-4361-a4e0-8b39ac7e4824 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:03.477726 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9a343ec3-1b9e-42fd-b2b9-ebb7c4a3b68a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:03.487885 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9a343ec3-1b9e-42fd-b2b9-ebb7c4a3b68a tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4" status: 200 len: 1472 microversion: 2.1 time: 1.038477 Oct 12 13:27:03.492620 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 665/1269] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:02 2022] GET /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4 => generated 1472 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:03.504742 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6b1ce3bf-c499-453d-8e3d-cd93b34252bb tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:03.513367 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-6b1ce3bf-c499-453d-8e3d-cd93b34252bb tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2d3ddb28-5b74-43dc-9579-d48a61b6d24e] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:03.532090 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6b1ce3bf-c499-453d-8e3d-cd93b34252bb tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:03.534823 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6b1ce3bf-c499-453d-8e3d-cd93b34252bb tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:03.537044 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6b1ce3bf-c499-453d-8e3d-cd93b34252bb tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:03.538076 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6b1ce3bf-c499-453d-8e3d-cd93b34252bb tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:03.541008 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6b1ce3bf-c499-453d-8e3d-cd93b34252bb tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:03.541716 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6b1ce3bf-c499-453d-8e3d-cd93b34252bb tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:03.661836 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-e0d3db45-2465-4361-a4e0-8b39ac7e4824 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:03.675508 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e0d3db45-2465-4361-a4e0-8b39ac7e4824 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d" status: 200 len: 1302 microversion: 2.1 time: 0.487198 Oct 12 13:27:03.678821 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 605/1270] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:03 2022] GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d => generated 1302 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:03.690789 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-86e9c56c-b2a4-4885-9e56-eb773149b9ec tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:03.694001 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-86e9c56c-b2a4-4885-9e56-eb773149b9ec tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] [instance: adef3d1f-fbf2-4093-8151-af1bfe7c667e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:03.715709 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-86e9c56c-b2a4-4885-9e56-eb773149b9ec tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:03.716237 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-86e9c56c-b2a4-4885-9e56-eb773149b9ec tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:03.716683 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-86e9c56c-b2a4-4885-9e56-eb773149b9ec tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:03.717436 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-86e9c56c-b2a4-4885-9e56-eb773149b9ec tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:03.718976 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-86e9c56c-b2a4-4885-9e56-eb773149b9ec tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:03.734593 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-86e9c56c-b2a4-4885-9e56-eb773149b9ec tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:04.139717 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-86e9c56c-b2a4-4885-9e56-eb773149b9ec tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:04.157122 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-86e9c56c-b2a4-4885-9e56-eb773149b9ec tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:04.159080 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-86e9c56c-b2a4-4885-9e56-eb773149b9ec tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:04.165844 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-86e9c56c-b2a4-4885-9e56-eb773149b9ec tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] 10.222.0.52 "GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e" status: 200 len: 1365 microversion: 2.47 time: 0.481171 Oct 12 13:27:04.181186 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 606/1271] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:27:03 2022] GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e => generated 1365 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:27:04.281399 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-6b1ce3bf-c499-453d-8e3d-cd93b34252bb tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:04.309098 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6b1ce3bf-c499-453d-8e3d-cd93b34252bb tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e" status: 200 len: 1314 microversion: 2.1 time: 0.799988 Oct 12 13:27:04.309098 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 666/1272] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:03 2022] GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e => generated 1314 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:04.517263 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-aa18d361-d132-49db-9bc1-1d89cef91d95 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:04.519186 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-aa18d361-d132-49db-9bc1-1d89cef91d95 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 14676667-3743-4d37-8ff9-f8d161a483d4] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:04.542225 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aa18d361-d132-49db-9bc1-1d89cef91d95 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:04.542745 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aa18d361-d132-49db-9bc1-1d89cef91d95 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:04.543199 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aa18d361-d132-49db-9bc1-1d89cef91d95 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:04.543945 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aa18d361-d132-49db-9bc1-1d89cef91d95 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:04.544408 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aa18d361-d132-49db-9bc1-1d89cef91d95 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:04.547770 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aa18d361-d132-49db-9bc1-1d89cef91d95 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:04.711748 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7e88350c-4d94-4080-bf1f-fd27db501249 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:04.713358 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7e88350c-4d94-4080-bf1f-fd27db501249 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:04.746988 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7e88350c-4d94-4080-bf1f-fd27db501249 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:04.749043 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7e88350c-4d94-4080-bf1f-fd27db501249 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:04.751048 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7e88350c-4d94-4080-bf1f-fd27db501249 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:04.752694 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7e88350c-4d94-4080-bf1f-fd27db501249 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:04.757734 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7e88350c-4d94-4080-bf1f-fd27db501249 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:04.758926 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7e88350c-4d94-4080-bf1f-fd27db501249 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:04.861429 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7e88350c-4d94-4080-bf1f-fd27db501249 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:04.864413 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7e88350c-4d94-4080-bf1f-fd27db501249 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:04.865127 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7e88350c-4d94-4080-bf1f-fd27db501249 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:04.869052 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-7e88350c-4d94-4080-bf1f-fd27db501249 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lazy-loading 'fault' on Instance uuid e37b5b43-6124-4cd8-bdba-1c489326db1d {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:27:05.146846 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-7e88350c-4d94-4080-bf1f-fd27db501249 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:05.159303 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-7e88350c-4d94-4080-bf1f-fd27db501249 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d" status: 200 len: 1307 microversion: 2.1 time: 0.458700 Oct 12 13:27:05.162084 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 667/1273] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:04 2022] GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d => generated 1307 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:05.196265 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-30eb007f-1700-4cff-96c6-f17f22253e5b tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:05.196990 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-30eb007f-1700-4cff-96c6-f17f22253e5b tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] [instance: adef3d1f-fbf2-4093-8151-af1bfe7c667e] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:05.206531 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-30eb007f-1700-4cff-96c6-f17f22253e5b tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:05.207064 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-30eb007f-1700-4cff-96c6-f17f22253e5b tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:05.207575 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-30eb007f-1700-4cff-96c6-f17f22253e5b tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:05.208444 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-30eb007f-1700-4cff-96c6-f17f22253e5b tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:05.209108 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-30eb007f-1700-4cff-96c6-f17f22253e5b tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:05.209751 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-30eb007f-1700-4cff-96c6-f17f22253e5b tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:05.367115 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-30eb007f-1700-4cff-96c6-f17f22253e5b tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:05.367699 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-30eb007f-1700-4cff-96c6-f17f22253e5b tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:05.372974 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-30eb007f-1700-4cff-96c6-f17f22253e5b tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:05.373525 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-30eb007f-1700-4cff-96c6-f17f22253e5b tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lazy-loading 'fault' on Instance uuid adef3d1f-fbf2-4093-8151-af1bfe7c667e {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:27:05.469466 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-aa18d361-d132-49db-9bc1-1d89cef91d95 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:05.469466 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-aa18d361-d132-49db-9bc1-1d89cef91d95 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4" status: 200 len: 1472 microversion: 2.1 time: 0.937509 Oct 12 13:27:05.469466 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 607/1274] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:04 2022] GET /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4 => generated 1472 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:05.476973 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-19832793-2356-46de-9c76-d1264d7b3799 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:05.480620 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-19832793-2356-46de-9c76-d1264d7b3799 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2d3ddb28-5b74-43dc-9579-d48a61b6d24e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:05.503726 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-19832793-2356-46de-9c76-d1264d7b3799 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:05.506584 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-19832793-2356-46de-9c76-d1264d7b3799 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:05.510383 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-19832793-2356-46de-9c76-d1264d7b3799 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:05.513346 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-19832793-2356-46de-9c76-d1264d7b3799 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:05.516416 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-19832793-2356-46de-9c76-d1264d7b3799 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:05.517082 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-19832793-2356-46de-9c76-d1264d7b3799 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:05.642957 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-30eb007f-1700-4cff-96c6-f17f22253e5b tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:05.656864 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-30eb007f-1700-4cff-96c6-f17f22253e5b tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:05.661262 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-30eb007f-1700-4cff-96c6-f17f22253e5b tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5005f3b6fbd54882aa5bee88adce5ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c2368f4aa44b319a3fa644d8ed5027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:05.662713 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-30eb007f-1700-4cff-96c6-f17f22253e5b tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] 10.222.0.52 "GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e" status: 200 len: 1370 microversion: 2.47 time: 0.471188 Oct 12 13:27:05.664669 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 668/1275] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:27:05 2022] GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e => generated 1370 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:27:05.811348 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ba52cc07-cb96-4776-afe5-2368f588d277 tempest-InstanceActionsV221TestJSON-1902205249 tempest-InstanceActionsV221TestJSON-1902205249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-907917413", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "23bfac9d-1d0b-4d1e-a9ab-f2da7237c4d1"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:05.924636 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-ba52cc07-cb96-4776-afe5-2368f588d277 tempest-InstanceActionsV221TestJSON-1902205249 tempest-InstanceActionsV221TestJSON-1902205249-project] validate_networks() for [('23bfac9d-1d0b-4d1e-a9ab-f2da7237c4d1', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:27:05.933662 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-19832793-2356-46de-9c76-d1264d7b3799 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:05.947087 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-19832793-2356-46de-9c76-d1264d7b3799 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e" status: 200 len: 1314 microversion: 2.1 time: 0.492428 Oct 12 13:27:05.957674 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 608/1276] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:05 2022] GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:06.191711 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9996a616-b36d-433b-9c67-5e56d9705e82 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:06.192602 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9996a616-b36d-433b-9c67-5e56d9705e82 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: e37b5b43-6124-4cd8-bdba-1c489326db1d] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:06.202334 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9996a616-b36d-433b-9c67-5e56d9705e82 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:06.205511 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9996a616-b36d-433b-9c67-5e56d9705e82 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:06.207986 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9996a616-b36d-433b-9c67-5e56d9705e82 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:06.209170 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9996a616-b36d-433b-9c67-5e56d9705e82 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:06.209957 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9996a616-b36d-433b-9c67-5e56d9705e82 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:06.212029 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9996a616-b36d-433b-9c67-5e56d9705e82 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:06.248395 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-9996a616-b36d-433b-9c67-5e56d9705e82 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] HTTP exception thrown: Instance e37b5b43-6124-4cd8-bdba-1c489326db1d could not be found. Oct 12 13:27:06.251824 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9996a616-b36d-433b-9c67-5e56d9705e82 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Request method failure captured: Oct 12 13:27:06.251824 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d HTTP/1.1 Oct 12 13:27:06.251824 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:27:06.251824 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:27:06.251824 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:27:06.251824 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:27:06.251824 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:27:06.251824 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:27:06.251824 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:27:06.251824 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:06.251824 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr_CCC7LiW_hy7m97LgwkFPF9p6huyY-CWLyQ6oZUHSaBS0K99iV_bpm0lEjAWwlhR5ZBm_SyiP0a6LEf1zwW7PqsfI2rGUmQ5fC8cBIWNpgn3dQQDgP9Y9DZPHDnybACv0UadoqhUY-B-6kowhluEo_e2Vq2P-MSnih4jhQxgwR_Q8 Oct 12 13:27:06.251824 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:27:06.251824 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:27:06.251824 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:27:06.251824 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:27:06.251824 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:27:06.251824 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:27:06.251824 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: be50900be6b246aa9289de6ec5d366f9 Oct 12 13:27:06.251824 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:27:06.251824 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:27:06.251824 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:27:06.262701 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be50900be6b246aa9289de6ec5d366f9"}]}] Oct 12 13:27:06.262701 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:27:06.262701 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: be50900be6b246aa9289de6ec5d366f9 Oct 12 13:27:06.262701 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:27:06.262701 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServersOnMultiNodesTest-1850216957-project Oct 12 13:27:06.262701 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:27:06.262701 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:27:06.262701 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: a0fd9458bb2842829a1e13ac93fade30 Oct 12 13:27:06.262701 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServersOnMultiNodesTest-1850216957-project Oct 12 13:27:06.262701 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:27:06.262701 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance e37b5b43-6124-4cd8-bdba-1c489326db1d could not be found. Oct 12 13:27:06.262701 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'e37b5b43-6124-4cd8-bdba-1c489326db1d'} Oct 12 13:27:06.263620 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:06.263620 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:06.263620 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:27:06.263620 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:27:06.263620 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:27:06.263620 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:27:06.263620 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:27:06.263620 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:27:06.263620 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:27:06.263620 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:27:06.263620 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e37b5b43-6124-4cd8-bdba-1c489326db1d could not be found. Oct 12 13:27:06.263620 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:06.263620 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:06.263620 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:06.263620 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:06.263620 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:06.263620 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:06.263620 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:06.263620 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:06.263620 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:06.264942 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:06.264942 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:27:06.264942 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:27:06.264942 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:27:06.264942 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:27:06.264942 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:27:06.264942 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:27:06.264942 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e37b5b43-6124-4cd8-bdba-1c489326db1d could not be found. Oct 12 13:27:06.264942 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:06.264942 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:06.264942 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:06.264942 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:06.264942 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:06.264942 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:06.264942 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:06.264942 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:06.264942 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e37b5b43-6124-4cd8-bdba-1c489326db1d could not be found. Oct 12 13:27:06.264942 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:06.266186 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9996a616-b36d-433b-9c67-5e56d9705e82 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Returning 404 to user: Instance e37b5b43-6124-4cd8-bdba-1c489326db1d could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:06.266186 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9996a616-b36d-433b-9c67-5e56d9705e82 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d" status: 404 len: 111 microversion: 2.1 time: 0.070718 Oct 12 13:27:06.266186 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 609/1277] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:06 2022] GET /compute/v2.1/servers/e37b5b43-6124-4cd8-bdba-1c489326db1d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:27:06.273582 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-92d516a4-9a33-4ad0-9716-4575b570c8ba tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:06.274452 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-92d516a4-9a33-4ad0-9716-4575b570c8ba tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:06.281513 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92d516a4-9a33-4ad0-9716-4575b570c8ba tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:06.282427 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92d516a4-9a33-4ad0-9716-4575b570c8ba tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:06.283121 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92d516a4-9a33-4ad0-9716-4575b570c8ba tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:06.284094 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92d516a4-9a33-4ad0-9716-4575b570c8ba tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:06.284765 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92d516a4-9a33-4ad0-9716-4575b570c8ba tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:06.285508 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92d516a4-9a33-4ad0-9716-4575b570c8ba tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:06.331942 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-92d516a4-9a33-4ad0-9716-4575b570c8ba tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:27:06.540070 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-ba52cc07-cb96-4776-afe5-2368f588d277 tempest-InstanceActionsV221TestJSON-1902205249 tempest-InstanceActionsV221TestJSON-1902205249-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-197336fb-eaf5-4b0b-9296-78bd77f0f992) Oct 12 13:27:06.540070 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:06.540070 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:06.540070 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:06.540070 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:06.540070 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:06.540070 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:06.540070 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:06.540070 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:06.540070 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:06.540070 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:27:06.540070 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:27:06.540070 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:27:06.540070 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:27:06.540070 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:27:06.540070 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:27:06.541675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:27:06.541675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:27:06.541675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:27:06.541675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:27:06.541675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:27:06.541675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:27:06.541675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:27:06.541675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:27:06.541675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:27:06.541675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:27:06.541675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:27:06.541675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:06.541675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:06.541675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:27:06.541675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:27:06.541675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:06.541675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:06.541675 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:27:06.543932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:27:06.543932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:06.543932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:06.543932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:27:06.543932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:27:06.543932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:06.543932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:06.543932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:27:06.543932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:27:06.543932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:27:06.543932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:27:06.543932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:27:06.543932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:27:06.543932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:27:06.543932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:27:06.543932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:27:06.543932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:27:06.543932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:27:06.545794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:27:06.545794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:27:06.545794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:27:06.545794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:27:06.545794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:27:06.545794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:27:06.545794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:27:06.545794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:27:06.545794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:27:06.545794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:27:06.545794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:27:06.545794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:27:06.545794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:27:06.545794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:27:06.545794 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:27:06.547627 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-197336fb-eaf5-4b0b-9296-78bd77f0f992) Oct 12 13:27:06.547627 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:06.549916 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-ba52cc07-cb96-4776-afe5-2368f588d277 tempest-InstanceActionsV221TestJSON-1902205249 tempest-InstanceActionsV221TestJSON-1902205249-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:27:06.549916 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:27:06.555768 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ba52cc07-cb96-4776-afe5-2368f588d277 tempest-InstanceActionsV221TestJSON-1902205249 tempest-InstanceActionsV221TestJSON-1902205249-project] Request method failure captured: Oct 12 13:27:06.555768 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:27:06.555768 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:27:06.555768 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:27:06.555768 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:27:06.555768 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 212 Oct 12 13:27:06.555768 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:27:06.555768 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:27:06.555768 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:27:06.555768 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:06.555768 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsCpGkJpsdisNuK3CFr-2lcamufbKUm4tCct0gPhlvUK30g-Nw_zO7SbFRqxHCTWPd42aMoV_oba2SCR3sRYrAmzSsGMF7mqpDaDcok4AB_aI0mKgVBwQ8WtnvNvKkSgUO_QsYVyZitoluF_be3b3yvqwYmEZGXpLO5xD7ndVuSBWps Oct 12 13:27:06.555768 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:27:06.555768 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:27:06.555768 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:27:06.555768 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:27:06.555768 n-d-861076-2 devstack@n-api.service[120933]: X-Openstack-Nova-Api-Version: 2.21 Oct 12 13:27:06.555768 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:27:06.555768 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:27:06.555768 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 649bcce722ae484d90a970f360654cd3 Oct 12 13:27:06.555768 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1902205249 Oct 12 13:27:06.555768 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:27:06.555768 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:27:06.557661 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/649bcce722ae484d90a970f360654cd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_649bcce722ae484d90a970f360654cd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/649bcce722ae484d90a970f360654cd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/649bcce722ae484d90a970f360654cd3"}]}] Oct 12 13:27:06.557661 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-InstanceActionsV221TestJSON-1902205249 Oct 12 13:27:06.557661 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 649bcce722ae484d90a970f360654cd3 Oct 12 13:27:06.557661 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1902205249 Oct 12 13:27:06.557661 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-InstanceActionsV221TestJSON-1902205249-project Oct 12 13:27:06.557661 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:27:06.557661 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:27:06.557661 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: c843ba35080145219a56af0c01486088 Oct 12 13:27:06.557661 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-InstanceActionsV221TestJSON-1902205249-project Oct 12 13:27:06.557661 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:27:06.557661 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-907917413", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "23bfac9d-1d0b-4d1e-a9ab-f2da7237c4d1"}]}} Oct 12 13:27:06.558774 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:27:06.558774 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:27:06.558774 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:27:06.558774 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-InstanceActionsV221TestJSON-server-907917413', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '23bfac9d-1d0b-4d1e-a9ab-f2da7237c4d1'}]}}} Oct 12 13:27:06.558774 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:06.558774 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:06.558774 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:06.558774 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:06.558774 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:06.558774 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:06.558774 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:06.558774 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:06.558774 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:06.558774 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:06.558774 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:27:06.558774 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:27:06.558774 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:27:06.558774 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:27:06.558774 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:27:06.561123 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:27:06.561123 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:27:06.561123 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:27:06.561123 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:27:06.561123 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:27:06.561123 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:27:06.561123 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:27:06.561123 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:27:06.561123 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:27:06.561123 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:27:06.561123 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:27:06.561123 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:27:06.561123 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:06.561123 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:06.561123 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:27:06.561123 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:27:06.561123 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:06.561123 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:06.562643 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:27:06.562643 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:27:06.562643 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:06.562643 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:06.562643 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:27:06.562643 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:27:06.562643 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:06.562643 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:06.562643 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:27:06.562643 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:27:06.562643 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:27:06.562643 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:27:06.562643 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:27:06.562643 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:27:06.562643 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:27:06.562643 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:27:06.562643 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:27:06.562643 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:27:06.569673 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:27:06.569673 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:27:06.569673 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:27:06.569673 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:27:06.569673 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:27:06.569673 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:27:06.569673 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:27:06.569673 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:27:06.569673 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:27:06.569673 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:27:06.569673 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:27:06.569673 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:27:06.569673 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:27:06.569673 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:27:06.569673 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:27:06.569673 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:27:06.571344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-197336fb-eaf5-4b0b-9296-78bd77f0f992) Oct 12 13:27:06.571344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:06.571344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:06.571344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:06.571344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:06.571344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:06.571344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:06.571344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:06.571344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:06.571344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:27:06.571344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:27:06.571344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:27:06.571344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:06.571344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:06.571344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:06.571344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:06.571344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:06.571344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:06.571344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:06.573702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:06.573702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:06.573702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:27:06.573702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:06.573702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:06.574938 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ba52cc07-cb96-4776-afe5-2368f588d277 tempest-InstanceActionsV221TestJSON-1902205249 tempest-InstanceActionsV221TestJSON-1902205249-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:27:06.574938 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:06.578509 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ba52cc07-cb96-4776-afe5-2368f588d277 tempest-InstanceActionsV221TestJSON-1902205249 tempest-InstanceActionsV221TestJSON-1902205249-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.21 time: 0.892894 Oct 12 13:27:06.578509 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 669/1278] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 12 13:27:05 2022] POST /compute/v2.1/servers => generated 214 bytes in 894 msecs (HTTP/1.1 500) 9 headers in 393 bytes (2 switches on core 0) Oct 12 13:27:06.600203 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-149c59a2-2f5d-40e8-800b-05409c19082f tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:06.600945 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-149c59a2-2f5d-40e8-800b-05409c19082f tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 14676667-3743-4d37-8ff9-f8d161a483d4] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:06.622561 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-149c59a2-2f5d-40e8-800b-05409c19082f tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:06.623732 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-149c59a2-2f5d-40e8-800b-05409c19082f tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:06.624479 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-149c59a2-2f5d-40e8-800b-05409c19082f tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:06.632646 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-149c59a2-2f5d-40e8-800b-05409c19082f tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:06.632646 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-149c59a2-2f5d-40e8-800b-05409c19082f tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:06.632646 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-149c59a2-2f5d-40e8-800b-05409c19082f tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:06.634166 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=95,nova_api:UPDATE=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:27:06.739044 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-92d516a4-9a33-4ad0-9716-4575b570c8ba tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "DELETE /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 204 len: 0 microversion: 2.1 time: 0.461090 Oct 12 13:27:06.739044 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 610/1279] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:27:06 2022] DELETE /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:27:06.739044 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c5428094-dc16-4617-a069-820af9ca40d1 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:06.739044 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c5428094-dc16-4617-a069-820af9ca40d1 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] [instance: adef3d1f-fbf2-4093-8151-af1bfe7c667e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:06.766874 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-149c59a2-2f5d-40e8-800b-05409c19082f tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:06.767760 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c5428094-dc16-4617-a069-820af9ca40d1 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:06.768282 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c5428094-dc16-4617-a069-820af9ca40d1 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:06.768953 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c5428094-dc16-4617-a069-820af9ca40d1 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:06.775960 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c5428094-dc16-4617-a069-820af9ca40d1 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:06.776765 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c5428094-dc16-4617-a069-820af9ca40d1 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:06.777434 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c5428094-dc16-4617-a069-820af9ca40d1 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:06.784645 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-149c59a2-2f5d-40e8-800b-05409c19082f tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4" status: 200 len: 1430 microversion: 2.1 time: 0.200820 Oct 12 13:27:06.786518 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 670/1280] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:06 2022] GET /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4 => generated 1430 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:06.795469 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-835c603a-57de-45f9-bc18-39993184c193 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:06.805084 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-835c603a-57de-45f9-bc18-39993184c193 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:06.812182 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-835c603a-57de-45f9-bc18-39993184c193 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:06.814572 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-835c603a-57de-45f9-bc18-39993184c193 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:06.814572 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-835c603a-57de-45f9-bc18-39993184c193 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:06.815462 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-835c603a-57de-45f9-bc18-39993184c193 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:06.817487 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-835c603a-57de-45f9-bc18-39993184c193 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:06.818218 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-835c603a-57de-45f9-bc18-39993184c193 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:06.836866 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-c5428094-dc16-4617-a069-820af9ca40d1 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] HTTP exception thrown: Instance adef3d1f-fbf2-4093-8151-af1bfe7c667e could not be found. Oct 12 13:27:06.838591 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c5428094-dc16-4617-a069-820af9ca40d1 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Request method failure captured: Oct 12 13:27:06.838591 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e HTTP/1.1 Oct 12 13:27:06.838591 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:27:06.838591 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:27:06.838591 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:27:06.838591 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:27:06.838591 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:27:06.838591 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:27:06.838591 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:27:06.838591 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:06.838591 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsCRJfX7NCuQx4HJQ7US5VaDwuKgaXjry1CxelzcWhtElpJNBaG5WVEXvxPz5zumTAGJkpcehvCT6U2SOeiMkOdb7_WBgv6otiEdpRCkE8gTrhCmSaDVR598xA_3-PLqxSAy0u0BwvsjsbN7foeEnpA_wMWug7ZbguPuSPjV0WVxnLU Oct 12 13:27:06.838591 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:27:06.838591 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:27:06.838591 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:27:06.838591 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:27:06.838591 n-d-861076-2 devstack@n-api.service[120932]: X-Openstack-Nova-Api-Version: 2.47 Oct 12 13:27:06.838591 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:27:06.838591 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:27:06.838591 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 94c2368f4aa44b319a3fa644d8ed5027 Oct 12 13:27:06.838591 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServersAaction247Test-1677696200 Oct 12 13:27:06.838591 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:27:06.838591 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:27:06.840137 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/94c2368f4aa44b319a3fa644d8ed5027"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_94c2368f4aa44b319a3fa644d8ed5027"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94c2368f4aa44b319a3fa644d8ed5027"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94c2368f4aa44b319a3fa644d8ed5027"}]}] Oct 12 13:27:06.840137 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServersAaction247Test-1677696200 Oct 12 13:27:06.840137 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 94c2368f4aa44b319a3fa644d8ed5027 Oct 12 13:27:06.840137 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServersAaction247Test-1677696200 Oct 12 13:27:06.840137 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServersAaction247Test-1677696200-project Oct 12 13:27:06.840137 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:27:06.840137 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:27:06.840137 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 5005f3b6fbd54882aa5bee88adce5ca5 Oct 12 13:27:06.840137 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServersAaction247Test-1677696200-project Oct 12 13:27:06.840137 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:27:06.840137 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance adef3d1f-fbf2-4093-8151-af1bfe7c667e could not be found. Oct 12 13:27:06.840137 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'adef3d1f-fbf2-4093-8151-af1bfe7c667e'} Oct 12 13:27:06.841044 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:06.841044 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:06.841044 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:27:06.841044 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:27:06.841044 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:27:06.841044 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:27:06.841044 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:27:06.841044 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:27:06.841044 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:27:06.841044 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:27:06.841044 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adef3d1f-fbf2-4093-8151-af1bfe7c667e could not be found. Oct 12 13:27:06.841044 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:06.841044 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:06.841044 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:06.841044 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:06.841044 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:06.841044 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:06.841044 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:06.841044 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:06.841044 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:06.842377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:06.842377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:27:06.842377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:27:06.842377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:27:06.842377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:27:06.842377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:27:06.842377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:27:06.842377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adef3d1f-fbf2-4093-8151-af1bfe7c667e could not be found. Oct 12 13:27:06.842377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:06.842377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:06.842377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:06.842377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:06.842377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:06.842377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:06.842377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:06.842377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:06.842377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adef3d1f-fbf2-4093-8151-af1bfe7c667e could not be found. Oct 12 13:27:06.842377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:06.843603 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c5428094-dc16-4617-a069-820af9ca40d1 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] Returning 404 to user: Instance adef3d1f-fbf2-4093-8151-af1bfe7c667e could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:06.843603 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c5428094-dc16-4617-a069-820af9ca40d1 tempest-ServersAaction247Test-1677696200 tempest-ServersAaction247Test-1677696200-project] 10.222.0.52 "GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e" status: 404 len: 111 microversion: 2.47 time: 0.107443 Oct 12 13:27:06.843603 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 611/1281] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:27:06 2022] GET /compute/v2.1/servers/adef3d1f-fbf2-4093-8151-af1bfe7c667e => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:27:06.862154 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-910ec479-8f06-4ff6-b53e-9b3940651dc6 req-9154b645-a896-4576-8f8e-5ba54d70180d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14676667-3743-4d37-8ff9-f8d161a483d4", "name": "network-vif-deleted", "tag": "5170297d-0d3f-4e69-aa8a-6c0e40750532"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:06.900231 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-910ec479-8f06-4ff6-b53e-9b3940651dc6 req-9154b645-a896-4576-8f8e-5ba54d70180d service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:06.903148 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-910ec479-8f06-4ff6-b53e-9b3940651dc6 req-9154b645-a896-4576-8f8e-5ba54d70180d service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:06.905369 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-910ec479-8f06-4ff6-b53e-9b3940651dc6 req-9154b645-a896-4576-8f8e-5ba54d70180d service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:06.931050 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-910ec479-8f06-4ff6-b53e-9b3940651dc6 req-9154b645-a896-4576-8f8e-5ba54d70180d service nova] Creating event network-vif-deleted:5170297d-0d3f-4e69-aa8a-6c0e40750532 for instance 14676667-3743-4d37-8ff9-f8d161a483d4 on n-h2-861076-2 Oct 12 13:27:06.938717 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-910ec479-8f06-4ff6-b53e-9b3940651dc6 req-9154b645-a896-4576-8f8e-5ba54d70180d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087773 Oct 12 13:27:06.941699 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 612/1282] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:06.978885 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ce9501a5-f037-4a3c-bda8-711bf855133a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:07.003147 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ce9501a5-f037-4a3c-bda8-711bf855133a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2d3ddb28-5b74-43dc-9579-d48a61b6d24e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:07.019784 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ce9501a5-f037-4a3c-bda8-711bf855133a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:07.020286 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ce9501a5-f037-4a3c-bda8-711bf855133a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:07.020730 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ce9501a5-f037-4a3c-bda8-711bf855133a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:07.026343 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ce9501a5-f037-4a3c-bda8-711bf855133a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:07.026620 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ce9501a5-f037-4a3c-bda8-711bf855133a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:07.031095 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ce9501a5-f037-4a3c-bda8-711bf855133a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:07.108314 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-835c603a-57de-45f9-bc18-39993184c193 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:07.118783 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-835c603a-57de-45f9-bc18-39993184c193 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1472 microversion: 2.1 time: 0.329203 Oct 12 13:27:07.121588 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 671/1283] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:06 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1472 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:07.330129 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-ce9501a5-f037-4a3c-bda8-711bf855133a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:07.344132 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ce9501a5-f037-4a3c-bda8-711bf855133a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e" status: 200 len: 1464 microversion: 2.1 time: 0.371903 Oct 12 13:27:07.345751 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 613/1284] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:06 2022] GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e => generated 1464 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:07.726030 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0ab72697-160e-4d73-a95c-c9f7cfd9a357 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:07.732080 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-0ab72697-160e-4d73-a95c-c9f7cfd9a357 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Searching by: {'deleted': False, 'project_id': '8aafa433b11e4ede9d6c300e370e2ea1'} {{(pid=120933) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 13:27:07.748044 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0ab72697-160e-4d73-a95c-c9f7cfd9a357 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:07.749461 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0ab72697-160e-4d73-a95c-c9f7cfd9a357 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:07.753671 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0ab72697-160e-4d73-a95c-c9f7cfd9a357 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:07.754677 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0ab72697-160e-4d73-a95c-c9f7cfd9a357 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:07.755324 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0ab72697-160e-4d73-a95c-c9f7cfd9a357 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:07.755900 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0ab72697-160e-4d73-a95c-c9f7cfd9a357 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:07.812944 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-40a57638-5162-42f1-b8f8-3f05cf24c6bc tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:07.830603 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-40a57638-5162-42f1-b8f8-3f05cf24c6bc tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 14676667-3743-4d37-8ff9-f8d161a483d4] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:07.835603 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-40a57638-5162-42f1-b8f8-3f05cf24c6bc tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:07.840173 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-40a57638-5162-42f1-b8f8-3f05cf24c6bc tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:07.840780 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-40a57638-5162-42f1-b8f8-3f05cf24c6bc tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:07.843135 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-40a57638-5162-42f1-b8f8-3f05cf24c6bc tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:07.843613 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-40a57638-5162-42f1-b8f8-3f05cf24c6bc tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:07.844047 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-40a57638-5162-42f1-b8f8-3f05cf24c6bc tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:07.969524 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-40a57638-5162-42f1-b8f8-3f05cf24c6bc tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:07.981138 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:27:07.988249 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-40a57638-5162-42f1-b8f8-3f05cf24c6bc tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4" status: 200 len: 1430 microversion: 2.1 time: 0.183107 Oct 12 13:27:07.991801 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 614/1285] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:07 2022] GET /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4 => generated 1430 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:08.040121 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0ab72697-160e-4d73-a95c-c9f7cfd9a357 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.664511 Oct 12 13:27:08.043027 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 672/1286] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:27:07 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:27:08.066192 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e5362dc9-0240-473c-9e87-9612976052f8 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:08.072398 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e5362dc9-0240-473c-9e87-9612976052f8 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Searching by: {'deleted': False} {{(pid=120932) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 13:27:08.090186 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e5362dc9-0240-473c-9e87-9612976052f8 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:08.090674 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e5362dc9-0240-473c-9e87-9612976052f8 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:08.091117 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e5362dc9-0240-473c-9e87-9612976052f8 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:08.091853 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e5362dc9-0240-473c-9e87-9612976052f8 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:08.092298 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e5362dc9-0240-473c-9e87-9612976052f8 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:08.092727 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e5362dc9-0240-473c-9e87-9612976052f8 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:08.149562 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d18cf140-5f71-4949-914b-5e21759f2358 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:08.150505 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-d18cf140-5f71-4949-914b-5e21759f2358 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:08.160644 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d18cf140-5f71-4949-914b-5e21759f2358 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:08.162265 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d18cf140-5f71-4949-914b-5e21759f2358 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:08.170981 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d18cf140-5f71-4949-914b-5e21759f2358 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:08.170981 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d18cf140-5f71-4949-914b-5e21759f2358 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:08.170981 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d18cf140-5f71-4949-914b-5e21759f2358 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:08.170981 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d18cf140-5f71-4949-914b-5e21759f2358 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:08.319214 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.multi_cell_list [None req-e5362dc9-0240-473c-9e87-9612976052f8 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=120932) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 13:27:08.492689 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e5362dc9-0240-473c-9e87-9612976052f8 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:08.492689 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e5362dc9-0240-473c-9e87-9612976052f8 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:08.495751 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e5362dc9-0240-473c-9e87-9612976052f8 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:08.909143 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d18cf140-5f71-4949-914b-5e21759f2358 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:08.924723 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d18cf140-5f71-4949-914b-5e21759f2358 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1472 microversion: 2.1 time: 0.780725 Oct 12 13:27:08.928069 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 673/1287] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:08 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1472 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:27:09.011675 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b184ec7a-ecd8-419b-9704-23264be8c2c8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:09.013092 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-b184ec7a-ecd8-419b-9704-23264be8c2c8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 14676667-3743-4d37-8ff9-f8d161a483d4] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:09.023418 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b184ec7a-ecd8-419b-9704-23264be8c2c8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:09.024688 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b184ec7a-ecd8-419b-9704-23264be8c2c8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:09.027413 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b184ec7a-ecd8-419b-9704-23264be8c2c8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:09.033647 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b184ec7a-ecd8-419b-9704-23264be8c2c8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:09.033647 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b184ec7a-ecd8-419b-9704-23264be8c2c8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:09.033647 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b184ec7a-ecd8-419b-9704-23264be8c2c8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:09.113538 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b184ec7a-ecd8-419b-9704-23264be8c2c8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:09.114641 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b184ec7a-ecd8-419b-9704-23264be8c2c8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:09.115098 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b184ec7a-ecd8-419b-9704-23264be8c2c8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:09.115568 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-b184ec7a-ecd8-419b-9704-23264be8c2c8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lazy-loading 'fault' on Instance uuid 14676667-3743-4d37-8ff9-f8d161a483d4 {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:27:09.384771 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b184ec7a-ecd8-419b-9704-23264be8c2c8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72b6dea3b64b4418b9bf590c4519cda3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85881fdc9e214dae8009054e5cd0bad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:09.396525 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b184ec7a-ecd8-419b-9704-23264be8c2c8 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4" status: 200 len: 1307 microversion: 2.1 time: 0.389247 Oct 12 13:27:09.401381 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 674/1288] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:09 2022] GET /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4 => generated 1307 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:09.903440 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e5362dc9-0240-473c-9e87-9612976052f8 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 15923 microversion: 2.1 time: 1.840874 Oct 12 13:27:09.907131 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 615/1289] 10.222.0.52 () {58 vars in 1171 bytes} [Wed Oct 12 13:27:08 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 15923 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:27:09.954221 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-25269830-f260-40e6-883e-e38b4e5ac23a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:09.955646 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-25269830-f260-40e6-883e-e38b4e5ac23a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:09.963487 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0f9b92bc-5206-45ad-8569-b95c6e07f759 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:09.970093 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0f9b92bc-5206-45ad-8569-b95c6e07f759 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Searching by: {'deleted': False, 'project_id': '8aafa433b11e4ede9d6c300e370e2ea1'} {{(pid=120932) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 13:27:09.976476 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-25269830-f260-40e6-883e-e38b4e5ac23a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:09.978053 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0f9b92bc-5206-45ad-8569-b95c6e07f759 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:09.978563 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0f9b92bc-5206-45ad-8569-b95c6e07f759 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:09.980384 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0f9b92bc-5206-45ad-8569-b95c6e07f759 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:09.981115 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-25269830-f260-40e6-883e-e38b4e5ac23a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:09.982265 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0f9b92bc-5206-45ad-8569-b95c6e07f759 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:09.982776 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-25269830-f260-40e6-883e-e38b4e5ac23a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:09.983580 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-25269830-f260-40e6-883e-e38b4e5ac23a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:09.983952 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0f9b92bc-5206-45ad-8569-b95c6e07f759 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:09.985117 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0f9b92bc-5206-45ad-8569-b95c6e07f759 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:09.992461 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-25269830-f260-40e6-883e-e38b4e5ac23a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:09.993751 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-25269830-f260-40e6-883e-e38b4e5ac23a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:10.223497 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0f9b92bc-5206-45ad-8569-b95c6e07f759 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?tenant_id=2bb790004fd34993aeee9b0f5820b798" status: 200 len: 15 microversion: 2.1 time: 0.264956 Oct 12 13:27:10.224806 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 616/1290] 10.222.0.52 () {58 vars in 1231 bytes} [Wed Oct 12 13:27:09 2022] GET /compute/v2.1/servers/detail?tenant_id=2bb790004fd34993aeee9b0f5820b798 => generated 15 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 13:27:10.258902 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2414d6fc-4374-44f5-b1c3-cba474b7100a tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:10.268780 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2414d6fc-4374-44f5-b1c3-cba474b7100a tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Searching by: {'tenant_id': '2bb790004fd34993aeee9b0f5820b798', 'deleted': False} {{(pid=120932) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 13:27:10.276423 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2414d6fc-4374-44f5-b1c3-cba474b7100a tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:10.282075 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2414d6fc-4374-44f5-b1c3-cba474b7100a tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:10.282075 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2414d6fc-4374-44f5-b1c3-cba474b7100a tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:10.282075 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2414d6fc-4374-44f5-b1c3-cba474b7100a tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:10.282075 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2414d6fc-4374-44f5-b1c3-cba474b7100a tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:10.282532 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2414d6fc-4374-44f5-b1c3-cba474b7100a tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:10.355303 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.multi_cell_list [None req-2414d6fc-4374-44f5-b1c3-cba474b7100a tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120932) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 13:27:10.464135 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-25269830-f260-40e6-883e-e38b4e5ac23a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:10.492678 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-25269830-f260-40e6-883e-e38b4e5ac23a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1472 microversion: 2.1 time: 0.526533 Oct 12 13:27:10.492678 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 675/1291] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:09 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1472 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:10.515571 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0ab6e831-4778-4922-98e0-ea9a7af2feff tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:10.515571 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-0ab6e831-4778-4922-98e0-ea9a7af2feff tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] [instance: 14676667-3743-4d37-8ff9-f8d161a483d4] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:10.541628 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0ab6e831-4778-4922-98e0-ea9a7af2feff tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:10.542130 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0ab6e831-4778-4922-98e0-ea9a7af2feff tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:10.545124 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0ab6e831-4778-4922-98e0-ea9a7af2feff tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:10.545124 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0ab6e831-4778-4922-98e0-ea9a7af2feff tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:10.547223 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0ab6e831-4778-4922-98e0-ea9a7af2feff tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:10.547675 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0ab6e831-4778-4922-98e0-ea9a7af2feff tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:10.607975 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2414d6fc-4374-44f5-b1c3-cba474b7100a tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:10.608868 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2414d6fc-4374-44f5-b1c3-cba474b7100a tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:10.609572 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2414d6fc-4374-44f5-b1c3-cba474b7100a tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:10.626950 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-0ab6e831-4778-4922-98e0-ea9a7af2feff tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] HTTP exception thrown: Instance 14676667-3743-4d37-8ff9-f8d161a483d4 could not be found. Oct 12 13:27:10.631810 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0ab6e831-4778-4922-98e0-ea9a7af2feff tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Request method failure captured: Oct 12 13:27:10.631810 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4 HTTP/1.1 Oct 12 13:27:10.631810 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:27:10.631810 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:27:10.631810 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:27:10.631810 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:27:10.631810 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:27:10.631810 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:27:10.631810 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:27:10.631810 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:10.631810 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr_WL4vGSnYaDaz2X9ZP2oh1C8ZndYGgDgTP8FKj2tDyrW4RPOEqpQZaj1dE3yXRuRpTcBC0Ipwxn_NVmE3EXopk6ZQYOvp5y0vxe2867kR-wilWVrhFORlrGeKY0M2tTUg71QfHwCJBv8QIHJ7tJpNOtEKjhrU04AkOn6vygt0VuMo Oct 12 13:27:10.631810 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:27:10.631810 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:27:10.631810 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:27:10.631810 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:27:10.631810 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:27:10.631810 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:27:10.631810 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 85881fdc9e214dae8009054e5cd0bad8 Oct 12 13:27:10.631810 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ListImageFiltersTestJSON-1397987456 Oct 12 13:27:10.631810 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:27:10.631810 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:27:10.633749 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/85881fdc9e214dae8009054e5cd0bad8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_85881fdc9e214dae8009054e5cd0bad8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/85881fdc9e214dae8009054e5cd0bad8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/85881fdc9e214dae8009054e5cd0bad8"}]}] Oct 12 13:27:10.633749 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ListImageFiltersTestJSON-1397987456 Oct 12 13:27:10.633749 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 85881fdc9e214dae8009054e5cd0bad8 Oct 12 13:27:10.633749 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1397987456 Oct 12 13:27:10.633749 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ListImageFiltersTestJSON-1397987456-project Oct 12 13:27:10.633749 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:27:10.633749 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:27:10.633749 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 72b6dea3b64b4418b9bf590c4519cda3 Oct 12 13:27:10.633749 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ListImageFiltersTestJSON-1397987456-project Oct 12 13:27:10.633749 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:27:10.633749 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance 14676667-3743-4d37-8ff9-f8d161a483d4 could not be found. Oct 12 13:27:10.633749 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '14676667-3743-4d37-8ff9-f8d161a483d4'} Oct 12 13:27:10.634712 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:10.634712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:10.634712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:27:10.634712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:27:10.634712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:27:10.634712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:27:10.634712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:27:10.634712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:27:10.634712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:27:10.634712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:27:10.634712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14676667-3743-4d37-8ff9-f8d161a483d4 could not be found. Oct 12 13:27:10.634712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:10.634712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:10.634712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:10.634712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:10.634712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:10.634712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:10.634712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:10.634712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:10.634712 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:10.636479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:10.636479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:27:10.636479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:27:10.636479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:27:10.636479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:27:10.636479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:27:10.636479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:27:10.636479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14676667-3743-4d37-8ff9-f8d161a483d4 could not be found. Oct 12 13:27:10.636479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:10.636479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:10.636479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:10.636479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:10.636479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:10.636479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:10.636479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:10.636479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:10.636479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14676667-3743-4d37-8ff9-f8d161a483d4 could not be found. Oct 12 13:27:10.636479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:10.643510 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0ab6e831-4778-4922-98e0-ea9a7af2feff tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Returning 404 to user: Instance 14676667-3743-4d37-8ff9-f8d161a483d4 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:10.643510 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0ab6e831-4778-4922-98e0-ea9a7af2feff tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "GET /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4" status: 404 len: 111 microversion: 2.1 time: 0.142766 Oct 12 13:27:10.650898 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 676/1292] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:10 2022] GET /compute/v2.1/servers/14676667-3743-4d37-8ff9-f8d161a483d4 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:27:10.663470 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-293cddc1-ada2-4f97-bd0a-31f047436ea8 req-fe12f60c-a231-42f6-8561-19194899d584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84665e09-6290-4534-9254-53bc1a6364d2", "name": "network-vif-deleted", "tag": "beff24b0-5676-4432-96b9-99712fc212bb"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:10.734720 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-293cddc1-ada2-4f97-bd0a-31f047436ea8 req-fe12f60c-a231-42f6-8561-19194899d584 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:10.735218 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-293cddc1-ada2-4f97-bd0a-31f047436ea8 req-fe12f60c-a231-42f6-8561-19194899d584 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:10.754087 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-293cddc1-ada2-4f97-bd0a-31f047436ea8 req-fe12f60c-a231-42f6-8561-19194899d584 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:10.895061 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-293cddc1-ada2-4f97-bd0a-31f047436ea8 req-fe12f60c-a231-42f6-8561-19194899d584 service nova] Creating event network-vif-deleted:beff24b0-5676-4432-96b9-99712fc212bb for instance 84665e09-6290-4534-9254-53bc1a6364d2 on n-h2-861076-2 Oct 12 13:27:10.948158 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-293cddc1-ada2-4f97-bd0a-31f047436ea8 req-fe12f60c-a231-42f6-8561-19194899d584 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.279993 Oct 12 13:27:10.952503 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 677/1293] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:10.960684 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2414d6fc-4374-44f5-b1c3-cba474b7100a tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2bb790004fd34993aeee9b0f5820b798" status: 200 len: 4827 microversion: 2.1 time: 0.712064 Oct 12 13:27:10.961744 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 617/1294] 10.222.0.52 () {58 vars in 1257 bytes} [Wed Oct 12 13:27:10 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2bb790004fd34993aeee9b0f5820b798 => generated 4827 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:27:11.000500 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f79f64b2-803b-4427-8989-e665b961e523 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8aa03d20d0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:11.003126 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e492bfee-7a05-4324-bc17-52cefdc389a4 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:11.018937 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e492bfee-7a05-4324-bc17-52cefdc389a4 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Searching by: {'tenant_id': '8aafa433b11e4ede9d6c300e370e2ea1', 'deleted': False} {{(pid=120932) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 13:27:11.032956 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e492bfee-7a05-4324-bc17-52cefdc389a4 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:11.033511 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e492bfee-7a05-4324-bc17-52cefdc389a4 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:11.033950 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e492bfee-7a05-4324-bc17-52cefdc389a4 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:11.037349 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e492bfee-7a05-4324-bc17-52cefdc389a4 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:11.038125 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e492bfee-7a05-4324-bc17-52cefdc389a4 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:11.038570 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e492bfee-7a05-4324-bc17-52cefdc389a4 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:11.119474 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:27:11.185494 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e492bfee-7a05-4324-bc17-52cefdc389a4 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8aafa433b11e4ede9d6c300e370e2ea1" status: 200 len: 15 microversion: 2.1 time: 0.184436 Oct 12 13:27:11.187984 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 618/1295] 10.222.0.52 () {58 vars in 1257 bytes} [Wed Oct 12 13:27:10 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8aafa433b11e4ede9d6c300e370e2ea1 => generated 15 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:27:11.227172 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4e31a915-5093-49fc-8edb-a6a42551a680 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:11.249901 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4e31a915-5093-49fc-8edb-a6a42551a680 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.023919 Oct 12 13:27:11.253710 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 619/1296] 10.222.0.52 () {58 vars in 1189 bytes} [Wed Oct 12 13:27:11 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:27:11.279480 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5b6904f4-f1eb-44ab-ab0e-d7e888ab9fa0 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:11.292384 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5b6904f4-f1eb-44ab-ab0e-d7e888ab9fa0 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:11.308024 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5b6904f4-f1eb-44ab-ab0e-d7e888ab9fa0 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:11.308519 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5b6904f4-f1eb-44ab-ab0e-d7e888ab9fa0 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:11.314266 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5b6904f4-f1eb-44ab-ab0e-d7e888ab9fa0 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:11.317300 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5b6904f4-f1eb-44ab-ab0e-d7e888ab9fa0 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:11.317817 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5b6904f4-f1eb-44ab-ab0e-d7e888ab9fa0 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:11.319242 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5b6904f4-f1eb-44ab-ab0e-d7e888ab9fa0 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:11.814205 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5b6904f4-f1eb-44ab-ab0e-d7e888ab9fa0 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80/action" status: 202 len: 0 microversion: 2.1 time: 0.538725 Oct 12 13:27:11.819574 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 620/1297] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:27:11 2022] POST /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 13:27:11.821618 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5e69cc7b-7cdb-451f-b54d-6ab49f2055a8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:11.822288 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5e69cc7b-7cdb-451f-b54d-6ab49f2055a8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:11.857830 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5e69cc7b-7cdb-451f-b54d-6ab49f2055a8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:11.858394 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5e69cc7b-7cdb-451f-b54d-6ab49f2055a8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:11.883200 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5e69cc7b-7cdb-451f-b54d-6ab49f2055a8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:11.885592 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5e69cc7b-7cdb-451f-b54d-6ab49f2055a8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:11.886273 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5e69cc7b-7cdb-451f-b54d-6ab49f2055a8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:11.889918 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5e69cc7b-7cdb-451f-b54d-6ab49f2055a8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:11.977024 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5e69cc7b-7cdb-451f-b54d-6ab49f2055a8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:11.978383 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5e69cc7b-7cdb-451f-b54d-6ab49f2055a8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:11.978977 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5e69cc7b-7cdb-451f-b54d-6ab49f2055a8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:11.979587 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-5e69cc7b-7cdb-451f-b54d-6ab49f2055a8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lazy-loading 'fault' on Instance uuid 84665e09-6290-4534-9254-53bc1a6364d2 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:27:12.135782 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-5e69cc7b-7cdb-451f-b54d-6ab49f2055a8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:12.145419 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5e69cc7b-7cdb-451f-b54d-6ab49f2055a8 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 200 len: 1306 microversion: 2.1 time: 0.328447 Oct 12 13:27:12.146010 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 621/1298] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:11 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 1306 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:12.184661 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-27f1eaff-b08b-4fa7-88ff-99f31305fb24 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:12.196746 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-27f1eaff-b08b-4fa7-88ff-99f31305fb24 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:12.201549 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-27f1eaff-b08b-4fa7-88ff-99f31305fb24 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '2bb790004fd34993aeee9b0f5820b798'} {{(pid=120932) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 13:27:12.213235 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-27f1eaff-b08b-4fa7-88ff-99f31305fb24 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:12.217412 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-27f1eaff-b08b-4fa7-88ff-99f31305fb24 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:12.218099 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-27f1eaff-b08b-4fa7-88ff-99f31305fb24 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:12.219055 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-27f1eaff-b08b-4fa7-88ff-99f31305fb24 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:12.219855 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-27f1eaff-b08b-4fa7-88ff-99f31305fb24 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:12.222648 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-27f1eaff-b08b-4fa7-88ff-99f31305fb24 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:12.417180 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.multi_cell_list [None req-27f1eaff-b08b-4fa7-88ff-99f31305fb24 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120932) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 13:27:12.443784 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f79f64b2-803b-4427-8989-e665b961e523 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "DELETE /compute/v2.1/images/1f48c97b-eeb6-4c70-ba53-cbeab77f18d7" status: 204 len: 0 microversion: 2.1 time: 1.488347 Oct 12 13:27:12.444355 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 678/1299] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:10 2022] DELETE /compute/v2.1/images/1f48c97b-eeb6-4c70-ba53-cbeab77f18d7 => generated 0 bytes in 1491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:27:12.455819 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-91621a02-3c12-4bcc-b602-5f0fbf720976 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bd388b0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:12.551202 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-27f1eaff-b08b-4fa7-88ff-99f31305fb24 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.380590 Oct 12 13:27:12.561927 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 622/1300] 10.222.0.52 () {58 vars in 1150 bytes} [Wed Oct 12 13:27:12 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:12.574178 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ddeba215-71db-4bde-b31b-8a9794469440 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:12.577306 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ddeba215-71db-4bde-b31b-8a9794469440 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:12.589964 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ddeba215-71db-4bde-b31b-8a9794469440 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:12.592593 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ddeba215-71db-4bde-b31b-8a9794469440 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:12.593329 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ddeba215-71db-4bde-b31b-8a9794469440 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:12.596690 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ddeba215-71db-4bde-b31b-8a9794469440 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:12.600709 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ddeba215-71db-4bde-b31b-8a9794469440 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:12.601434 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ddeba215-71db-4bde-b31b-8a9794469440 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:12.992811 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ddeba215-71db-4bde-b31b-8a9794469440 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80/action" status: 202 len: 0 microversion: 2.1 time: 0.422350 Oct 12 13:27:13.002261 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 623/1301] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:27:12 2022] POST /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 13:27:13.008805 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f987edd5-486e-450c-8e2b-f592939d7129 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:13.010285 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f987edd5-486e-450c-8e2b-f592939d7129 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:13.032986 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f987edd5-486e-450c-8e2b-f592939d7129 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:13.033489 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f987edd5-486e-450c-8e2b-f592939d7129 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:13.033931 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f987edd5-486e-450c-8e2b-f592939d7129 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:13.035277 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f987edd5-486e-450c-8e2b-f592939d7129 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:13.035749 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f987edd5-486e-450c-8e2b-f592939d7129 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:13.036181 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f987edd5-486e-450c-8e2b-f592939d7129 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:13.239921 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-91621a02-3c12-4bcc-b602-5f0fbf720976 tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "DELETE /compute/v2.1/images/f6fd2fb8-d410-4738-bc3c-050f993fb3b6" status: 204 len: 0 microversion: 2.1 time: 0.790110 Oct 12 13:27:13.245072 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 679/1302] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:12 2022] DELETE /compute/v2.1/images/f6fd2fb8-d410-4738-bc3c-050f993fb3b6 => generated 0 bytes in 793 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:27:13.250489 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e0b67962-dcae-4a25-969a-7563c19e81cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:13.251511 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-e0b67962-dcae-4a25-969a-7563c19e81cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 84665e09-6290-4534-9254-53bc1a6364d2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:13.268484 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e0b67962-dcae-4a25-969a-7563c19e81cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:13.270212 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e0b67962-dcae-4a25-969a-7563c19e81cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:13.271830 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e0b67962-dcae-4a25-969a-7563c19e81cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:13.276793 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e0b67962-dcae-4a25-969a-7563c19e81cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:13.276793 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e0b67962-dcae-4a25-969a-7563c19e81cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:13.276793 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e0b67962-dcae-4a25-969a-7563c19e81cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:13.322152 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-e0b67962-dcae-4a25-969a-7563c19e81cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] HTTP exception thrown: Instance 84665e09-6290-4534-9254-53bc1a6364d2 could not be found. Oct 12 13:27:13.343324 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e0b67962-dcae-4a25-969a-7563c19e81cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Request method failure captured: Oct 12 13:27:13.343324 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 HTTP/1.1 Oct 12 13:27:13.343324 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:27:13.343324 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:27:13.343324 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:27:13.343324 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:27:13.343324 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:27:13.343324 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:27:13.343324 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:27:13.343324 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:13.343324 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr_CCC7LiW_hy7m97LgwkFPF9p6huyY-CWLyQ6oZUHSaBS0K99iV_bpm0lEjAWwlhR5ZBm_SyiP0a6LEf1zwW7PqsfI2rGUmQ5fC8cBIWNpgn3dQQDgP9Y9DZPHDnybACv0UadoqhUY-B-6kowhluEo_e2Vq2P-MSnih4jhQxgwR_Q8 Oct 12 13:27:13.343324 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:27:13.343324 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:27:13.343324 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:27:13.343324 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:27:13.343324 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:27:13.343324 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:27:13.343324 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: be50900be6b246aa9289de6ec5d366f9 Oct 12 13:27:13.343324 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:27:13.343324 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:27:13.343324 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:27:13.345261 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be50900be6b246aa9289de6ec5d366f9"}]}] Oct 12 13:27:13.345261 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:27:13.345261 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: be50900be6b246aa9289de6ec5d366f9 Oct 12 13:27:13.345261 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:27:13.345261 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServersOnMultiNodesTest-1850216957-project Oct 12 13:27:13.345261 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:27:13.345261 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:27:13.345261 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: a0fd9458bb2842829a1e13ac93fade30 Oct 12 13:27:13.345261 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServersOnMultiNodesTest-1850216957-project Oct 12 13:27:13.345261 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:27:13.345261 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance 84665e09-6290-4534-9254-53bc1a6364d2 could not be found. Oct 12 13:27:13.345261 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '84665e09-6290-4534-9254-53bc1a6364d2'} Oct 12 13:27:13.346461 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:13.346461 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:13.346461 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:27:13.346461 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:27:13.346461 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:27:13.346461 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:27:13.346461 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:27:13.346461 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:27:13.346461 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:27:13.346461 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:27:13.346461 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84665e09-6290-4534-9254-53bc1a6364d2 could not be found. Oct 12 13:27:13.346461 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:13.346461 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:13.346461 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:13.346461 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:13.346461 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:13.346461 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:13.346461 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:13.346461 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:13.346461 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:13.348728 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:13.348728 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:27:13.348728 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:27:13.348728 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:27:13.348728 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:27:13.348728 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:27:13.348728 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:27:13.348728 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84665e09-6290-4534-9254-53bc1a6364d2 could not be found. Oct 12 13:27:13.348728 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:13.348728 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:13.348728 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:13.348728 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:13.348728 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:13.348728 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:13.348728 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:13.348728 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:13.348728 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84665e09-6290-4534-9254-53bc1a6364d2 could not be found. Oct 12 13:27:13.348728 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:13.358063 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e0b67962-dcae-4a25-969a-7563c19e81cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Returning 404 to user: Instance 84665e09-6290-4534-9254-53bc1a6364d2 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:13.367800 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e0b67962-dcae-4a25-969a-7563c19e81cd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2" status: 404 len: 111 microversion: 2.1 time: 0.113049 Oct 12 13:27:13.371583 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 680/1303] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:13 2022] GET /compute/v2.1/servers/84665e09-6290-4534-9254-53bc1a6364d2 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:27:13.389704 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8e4deeb7-885c-4a7a-81e6-ab6bae4442ca tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] Calling method '.version_select at 0x7f8a9bd01a60>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:13.715396 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f987edd5-486e-450c-8e2b-f592939d7129 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1614 microversion: 2.1 time: 0.711179 Oct 12 13:27:13.739375 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 624/1304] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:13 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1614 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:13.745975 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a73bdd0b-8c22-4220-a0e3-6aecfc9ffd8f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:13.748294 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a73bdd0b-8c22-4220-a0e3-6aecfc9ffd8f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: d9e25817-4f35-4244-afa0-543c63840ad2] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:13.772843 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a73bdd0b-8c22-4220-a0e3-6aecfc9ffd8f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:13.775084 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a73bdd0b-8c22-4220-a0e3-6aecfc9ffd8f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:13.780598 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a73bdd0b-8c22-4220-a0e3-6aecfc9ffd8f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:13.781802 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a73bdd0b-8c22-4220-a0e3-6aecfc9ffd8f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:13.782555 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a73bdd0b-8c22-4220-a0e3-6aecfc9ffd8f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:13.783235 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a73bdd0b-8c22-4220-a0e3-6aecfc9ffd8f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:13.818858 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a73bdd0b-8c22-4220-a0e3-6aecfc9ffd8f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: d9e25817-4f35-4244-afa0-543c63840ad2] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:27:14.195635 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-8e4deeb7-885c-4a7a-81e6-ab6bae4442ca tempest-ListImageFiltersTestJSON-1397987456 tempest-ListImageFiltersTestJSON-1397987456-project] 10.222.0.52 "DELETE /compute/v2.1/images/cc6f4315-2e6b-4487-a0a7-0da1bcd0e1a3" status: 204 len: 0 microversion: 2.1 time: 0.822680 Oct 12 13:27:14.196656 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 681/1305] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:13 2022] DELETE /compute/v2.1/images/cc6f4315-2e6b-4487-a0a7-0da1bcd0e1a3 => generated 0 bytes in 824 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:27:14.205322 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-59478624-a1a2-4958-ba36-33eae4350b43 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:14.206402 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-59478624-a1a2-4958-ba36-33eae4350b43 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:14.222385 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-59478624-a1a2-4958-ba36-33eae4350b43 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:14.222385 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-59478624-a1a2-4958-ba36-33eae4350b43 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:14.222385 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-59478624-a1a2-4958-ba36-33eae4350b43 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:14.222385 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-59478624-a1a2-4958-ba36-33eae4350b43 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:14.222944 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-59478624-a1a2-4958-ba36-33eae4350b43 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:14.222944 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-59478624-a1a2-4958-ba36-33eae4350b43 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:14.353918 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a73bdd0b-8c22-4220-a0e3-6aecfc9ffd8f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d9e25817-4f35-4244-afa0-543c63840ad2" status: 204 len: 0 microversion: 2.1 time: 0.612897 Oct 12 13:27:14.355155 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 625/1306] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:27:13 2022] DELETE /compute/v2.1/servers/d9e25817-4f35-4244-afa0-543c63840ad2 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:27:14.584461 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-59478624-a1a2-4958-ba36-33eae4350b43 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1614 microversion: 2.1 time: 0.386514 Oct 12 13:27:14.587363 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 682/1307] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:14 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1614 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:14.600949 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7bdbad56-633c-425e-95df-985272a74c79 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:14.601474 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7bdbad56-633c-425e-95df-985272a74c79 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fdd5df96-d739-4e05-a503-2cfcab635cc8] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:14.608059 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-83c99714-7631-4d94-abb5-1f7b0bcd2022 tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] Action: 'create', calling method: .version_select at 0x7f8a9b6381f0>, body: {"pool": null} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:14.614015 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7bdbad56-633c-425e-95df-985272a74c79 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:14.616195 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7bdbad56-633c-425e-95df-985272a74c79 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:14.617813 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7bdbad56-633c-425e-95df-985272a74c79 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:14.618581 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7bdbad56-633c-425e-95df-985272a74c79 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:14.619105 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7bdbad56-633c-425e-95df-985272a74c79 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:14.619712 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7bdbad56-633c-425e-95df-985272a74c79 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:14.686181 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7bdbad56-633c-425e-95df-985272a74c79 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fdd5df96-d739-4e05-a503-2cfcab635cc8] Going to try to terminate instance {{(pid=120933) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:27:15.057346 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-7bdbad56-633c-425e-95df-985272a74c79 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8" status: 204 len: 0 microversion: 2.1 time: 0.466997 Oct 12 13:27:15.058328 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 683/1308] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:27:14 2022] DELETE /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:27:15.069235 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b383baa7-cd3a-4a80-b5b1-6d7bc2e0d0ce tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:15.111714 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-b383baa7-cd3a-4a80-b5b1-6d7bc2e0d0ce tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Searching by: {'host': 'n-h1-861076-2', 'deleted': False} {{(pid=120933) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 13:27:15.119043 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:27:15.143922 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b383baa7-cd3a-4a80-b5b1-6d7bc2e0d0ce tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:15.144421 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b383baa7-cd3a-4a80-b5b1-6d7bc2e0d0ce tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:15.148112 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b383baa7-cd3a-4a80-b5b1-6d7bc2e0d0ce tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:15.150534 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b383baa7-cd3a-4a80-b5b1-6d7bc2e0d0ce tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:15.151040 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b383baa7-cd3a-4a80-b5b1-6d7bc2e0d0ce tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:15.151470 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b383baa7-cd3a-4a80-b5b1-6d7bc2e0d0ce tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:15.443699 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.multi_cell_list [None req-b383baa7-cd3a-4a80-b5b1-6d7bc2e0d0ce tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=120933) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 13:27:15.610994 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b383baa7-cd3a-4a80-b5b1-6d7bc2e0d0ce tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] 10.222.0.52 "GET /compute/v2.1/servers?host=n-h1-861076-2&all_tenants=1" status: 200 len: 2304 microversion: 2.1 time: 0.550996 Oct 12 13:27:15.611709 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 684/1309] 10.222.0.52 () {58 vars in 1190 bytes} [Wed Oct 12 13:27:15 2022] GET /compute/v2.1/servers?host=n-h1-861076-2&all_tenants=1 => generated 2304 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:15.624852 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-07f1a860-2d2e-44ab-a3e4-6c88502e0004 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:15.625831 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-07f1a860-2d2e-44ab-a3e4-6c88502e0004 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: d9e25817-4f35-4244-afa0-543c63840ad2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:15.640543 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-07f1a860-2d2e-44ab-a3e4-6c88502e0004 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:15.641080 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-07f1a860-2d2e-44ab-a3e4-6c88502e0004 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:15.641520 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-07f1a860-2d2e-44ab-a3e4-6c88502e0004 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:15.647674 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-07f1a860-2d2e-44ab-a3e4-6c88502e0004 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:15.648431 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-07f1a860-2d2e-44ab-a3e4-6c88502e0004 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:15.649121 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-07f1a860-2d2e-44ab-a3e4-6c88502e0004 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:16.776831 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-07f1a860-2d2e-44ab-a3e4-6c88502e0004 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:16.789664 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-07f1a860-2d2e-44ab-a3e4-6c88502e0004 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e25817-4f35-4244-afa0-543c63840ad2" status: 200 len: 1473 microversion: 2.1 time: 1.176341 Oct 12 13:27:16.807431 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 685/1310] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:15 2022] GET /compute/v2.1/servers/d9e25817-4f35-4244-afa0-543c63840ad2 => generated 1473 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:17.176972 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cd334634-b39f-4570-bfbb-120edffd2eb1 tempest-ServersTestBootFromVolume-1563245049 tempest-ServersTestBootFromVolume-1563245049-project] Action: 'create', calling method: .version_select at 0x7f8a9bd389d0>, body: {"keypair": {"name": "tempest-keypair-1358335938", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPERff5nPI9ounl/Cmid2We9XfeFKNS9K9HppltEpSKjDh0psJY0uSTqTYLEmUZMf4/oJ9Gbejm5VOWETq2dISE1NyMdLrqnaQap9XpqQlurB4pDFtRb9Eye4BPcJTgKw=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:17.220669 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-cd334634-b39f-4570-bfbb-120edffd2eb1 tempest-ServersTestBootFromVolume-1563245049 tempest-ServersTestBootFromVolume-1563245049-project] Getting quotas for project 0d7e1254703d46e1ac62f2c5a2ca2635. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:27:17.227574 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-cd334634-b39f-4570-bfbb-120edffd2eb1 tempest-ServersTestBootFromVolume-1563245049 tempest-ServersTestBootFromVolume-1563245049-project] Getting quotas for user 8a9191f571644557ac00dd990752ff4f and project 0d7e1254703d46e1ac62f2c5a2ca2635. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:27:17.373868 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-cd334634-b39f-4570-bfbb-120edffd2eb1 tempest-ServersTestBootFromVolume-1563245049 tempest-ServersTestBootFromVolume-1563245049-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.564215 Oct 12 13:27:17.375564 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 686/1311] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:27:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:17.432043 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4f8676c1-3326-4cd9-9723-d2f269a6b33e tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:17.451007 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-4f8676c1-3326-4cd9-9723-d2f269a6b33e tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120933) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 13:27:17.462925 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4f8676c1-3326-4cd9-9723-d2f269a6b33e tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:17.464691 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4f8676c1-3326-4cd9-9723-d2f269a6b33e tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:17.465430 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4f8676c1-3326-4cd9-9723-d2f269a6b33e tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:17.466660 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4f8676c1-3326-4cd9-9723-d2f269a6b33e tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:17.467620 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4f8676c1-3326-4cd9-9723-d2f269a6b33e tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:17.468441 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4f8676c1-3326-4cd9-9723-d2f269a6b33e tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:17.533974 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4f8676c1-3326-4cd9-9723-d2f269a6b33e tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] 10.222.0.52 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.156320 Oct 12 13:27:17.545759 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 687/1312] 10.222.0.52 () {58 vars in 1196 bytes} [Wed Oct 12 13:27:17 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:27:17.561328 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d3741705-1b2e-4180-81d8-dafb1d2cc4af tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:17.570692 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-d3741705-1b2e-4180-81d8-dafb1d2cc4af tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:17.603821 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3741705-1b2e-4180-81d8-dafb1d2cc4af tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:17.604581 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3741705-1b2e-4180-81d8-dafb1d2cc4af tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:17.605451 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3741705-1b2e-4180-81d8-dafb1d2cc4af tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:17.608745 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3741705-1b2e-4180-81d8-dafb1d2cc4af tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:17.610793 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3741705-1b2e-4180-81d8-dafb1d2cc4af tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:17.614502 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d3741705-1b2e-4180-81d8-dafb1d2cc4af tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:18.092767 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d3741705-1b2e-4180-81d8-dafb1d2cc4af tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80/action" status: 202 len: 0 microversion: 2.1 time: 0.544091 Oct 12 13:27:18.097408 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 688/1313] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:27:17 2022] POST /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:27:18.100222 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-47418947-df2a-4bb5-92fc-6e9393572582 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:18.102160 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-47418947-df2a-4bb5-92fc-6e9393572582 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: d9e25817-4f35-4244-afa0-543c63840ad2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:18.112179 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-47418947-df2a-4bb5-92fc-6e9393572582 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:18.114197 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-47418947-df2a-4bb5-92fc-6e9393572582 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:18.114845 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-47418947-df2a-4bb5-92fc-6e9393572582 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:18.116463 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-47418947-df2a-4bb5-92fc-6e9393572582 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:18.116959 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-47418947-df2a-4bb5-92fc-6e9393572582 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:18.119104 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-47418947-df2a-4bb5-92fc-6e9393572582 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:19.126590 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-47418947-df2a-4bb5-92fc-6e9393572582 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:19.141371 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-47418947-df2a-4bb5-92fc-6e9393572582 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e25817-4f35-4244-afa0-543c63840ad2" status: 200 len: 1473 microversion: 2.1 time: 1.040047 Oct 12 13:27:19.142473 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 689/1314] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:18 2022] GET /compute/v2.1/servers/d9e25817-4f35-4244-afa0-543c63840ad2 => generated 1473 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:19.157165 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8c7a625b-7dca-45a0-a2d3-dac9f82d0320 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:19.160447 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-8c7a625b-7dca-45a0-a2d3-dac9f82d0320 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:19.184530 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8c7a625b-7dca-45a0-a2d3-dac9f82d0320 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:19.189650 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8c7a625b-7dca-45a0-a2d3-dac9f82d0320 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:19.194129 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8c7a625b-7dca-45a0-a2d3-dac9f82d0320 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:19.199378 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8c7a625b-7dca-45a0-a2d3-dac9f82d0320 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:19.199801 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8c7a625b-7dca-45a0-a2d3-dac9f82d0320 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:19.213150 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8c7a625b-7dca-45a0-a2d3-dac9f82d0320 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:19.433859 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-8c7a625b-7dca-45a0-a2d3-dac9f82d0320 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:27:19.448103 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-8c7a625b-7dca-45a0-a2d3-dac9f82d0320 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:27:19.448598 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-8c7a625b-7dca-45a0-a2d3-dac9f82d0320 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:27:19.450677 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-8c7a625b-7dca-45a0-a2d3-dac9f82d0320 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:27:19.451099 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-8c7a625b-7dca-45a0-a2d3-dac9f82d0320 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:27:19.650966 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:27:20.039340 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-8c7a625b-7dca-45a0-a2d3-dac9f82d0320 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:20.051272 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8c7a625b-7dca-45a0-a2d3-dac9f82d0320 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:20.054984 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8c7a625b-7dca-45a0-a2d3-dac9f82d0320 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:20.057253 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8c7a625b-7dca-45a0-a2d3-dac9f82d0320 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:20.060689 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8c7a625b-7dca-45a0-a2d3-dac9f82d0320 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:20.064040 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8c7a625b-7dca-45a0-a2d3-dac9f82d0320 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:20.064960 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8c7a625b-7dca-45a0-a2d3-dac9f82d0320 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:20.148040 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-8c7a625b-7dca-45a0-a2d3-dac9f82d0320 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "POST /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80/action" status: 202 len: 1067 microversion: 2.1 time: 1.004079 Oct 12 13:27:20.164886 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 690/1315] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:27:19 2022] POST /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80/action => generated 1067 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 12 13:27:20.192594 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f4865a98-26f4-4d14-9c94-e10220adfbd3 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:20.192594 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f4865a98-26f4-4d14-9c94-e10220adfbd3 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: d9e25817-4f35-4244-afa0-543c63840ad2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:20.192594 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4865a98-26f4-4d14-9c94-e10220adfbd3 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:20.192594 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4865a98-26f4-4d14-9c94-e10220adfbd3 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:20.193657 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4865a98-26f4-4d14-9c94-e10220adfbd3 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:20.193657 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4865a98-26f4-4d14-9c94-e10220adfbd3 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:20.193657 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4865a98-26f4-4d14-9c94-e10220adfbd3 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:20.193657 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f4865a98-26f4-4d14-9c94-e10220adfbd3 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:20.444447 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f4865a98-26f4-4d14-9c94-e10220adfbd3 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:20.458016 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f4865a98-26f4-4d14-9c94-e10220adfbd3 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e25817-4f35-4244-afa0-543c63840ad2" status: 200 len: 1431 microversion: 2.1 time: 0.292094 Oct 12 13:27:20.462085 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 691/1316] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:20 2022] GET /compute/v2.1/servers/d9e25817-4f35-4244-afa0-543c63840ad2 => generated 1431 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:20.474407 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-bf353a2e-8d78-44df-957e-55aebb88d8ab tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:20.475139 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-bf353a2e-8d78-44df-957e-55aebb88d8ab tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:20.505699 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bf353a2e-8d78-44df-957e-55aebb88d8ab tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:20.506495 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bf353a2e-8d78-44df-957e-55aebb88d8ab tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:20.507122 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bf353a2e-8d78-44df-957e-55aebb88d8ab tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:20.508582 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bf353a2e-8d78-44df-957e-55aebb88d8ab tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:20.509396 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bf353a2e-8d78-44df-957e-55aebb88d8ab tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:20.512576 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bf353a2e-8d78-44df-957e-55aebb88d8ab tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:20.595811 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:27:21.256584 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-bf353a2e-8d78-44df-957e-55aebb88d8ab tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:21.278706 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-bf353a2e-8d78-44df-957e-55aebb88d8ab tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1471 microversion: 2.1 time: 0.803550 Oct 12 13:27:21.282684 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 692/1317] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:20 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1471 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:21.294548 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-fb970367-65dd-47c5-8d30-5241e70116bd req-6b500250-03a6-4d02-9acc-b557c73004a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e25817-4f35-4244-afa0-543c63840ad2", "name": "network-vif-deleted", "tag": "bbe46d58-c87c-45e3-b076-716e17b57f55"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:21.350226 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-fb970367-65dd-47c5-8d30-5241e70116bd req-6b500250-03a6-4d02-9acc-b557c73004a0 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:21.350662 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-fb970367-65dd-47c5-8d30-5241e70116bd req-6b500250-03a6-4d02-9acc-b557c73004a0 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:21.351100 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-fb970367-65dd-47c5-8d30-5241e70116bd req-6b500250-03a6-4d02-9acc-b557c73004a0 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:21.402837 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-fb970367-65dd-47c5-8d30-5241e70116bd req-6b500250-03a6-4d02-9acc-b557c73004a0 service nova] Creating event network-vif-deleted:bbe46d58-c87c-45e3-b076-716e17b57f55 for instance d9e25817-4f35-4244-afa0-543c63840ad2 on n-h2-861076-2 Oct 12 13:27:21.427010 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-fb970367-65dd-47c5-8d30-5241e70116bd req-6b500250-03a6-4d02-9acc-b557c73004a0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138650 Oct 12 13:27:21.436530 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 693/1318] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:21.491931 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ca73530a-542b-49bb-ab6b-6bc3fd2d9975 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:21.497156 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-ca73530a-542b-49bb-ab6b-6bc3fd2d9975 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: d9e25817-4f35-4244-afa0-543c63840ad2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:21.510795 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ca73530a-542b-49bb-ab6b-6bc3fd2d9975 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:21.511585 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ca73530a-542b-49bb-ab6b-6bc3fd2d9975 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:21.514710 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ca73530a-542b-49bb-ab6b-6bc3fd2d9975 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:21.515756 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ca73530a-542b-49bb-ab6b-6bc3fd2d9975 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:21.516452 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ca73530a-542b-49bb-ab6b-6bc3fd2d9975 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:21.517080 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ca73530a-542b-49bb-ab6b-6bc3fd2d9975 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:21.596219 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ca73530a-542b-49bb-ab6b-6bc3fd2d9975 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:21.596219 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ca73530a-542b-49bb-ab6b-6bc3fd2d9975 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:21.596219 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ca73530a-542b-49bb-ab6b-6bc3fd2d9975 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:21.596219 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-ca73530a-542b-49bb-ab6b-6bc3fd2d9975 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lazy-loading 'fault' on Instance uuid d9e25817-4f35-4244-afa0-543c63840ad2 {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:27:21.720456 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-ca73530a-542b-49bb-ab6b-6bc3fd2d9975 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:21.772873 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ca73530a-542b-49bb-ab6b-6bc3fd2d9975 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e25817-4f35-4244-afa0-543c63840ad2" status: 200 len: 1308 microversion: 2.1 time: 0.283231 Oct 12 13:27:21.798495 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 694/1319] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:21 2022] GET /compute/v2.1/servers/d9e25817-4f35-4244-afa0-543c63840ad2 => generated 1308 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:22.257501 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=10 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:27:22.308407 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e5bf4761-37a4-485e-ac65-d8690db104e7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:22.309045 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-e5bf4761-37a4-485e-ac65-d8690db104e7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:22.323327 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e5bf4761-37a4-485e-ac65-d8690db104e7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:22.325467 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e5bf4761-37a4-485e-ac65-d8690db104e7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:22.326245 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e5bf4761-37a4-485e-ac65-d8690db104e7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:22.331051 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e5bf4761-37a4-485e-ac65-d8690db104e7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:22.332089 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e5bf4761-37a4-485e-ac65-d8690db104e7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:22.332681 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e5bf4761-37a4-485e-ac65-d8690db104e7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:22.789718 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-83c99714-7631-4d94-abb5-1f7b0bcd2022 tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.432398 Oct 12 13:27:22.791140 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 626/1320] 10.222.0.52 () {60 vars in 1170 bytes} [Wed Oct 12 13:27:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:22.807450 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-faddf35f-626b-4472-9449-831bf9dbfd62 tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] Calling method '.version_select at 0x7f8a9b68e3a0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:22.989015 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e5bf4761-37a4-485e-ac65-d8690db104e7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:22.998160 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e5bf4761-37a4-485e-ac65-d8690db104e7 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1471 microversion: 2.1 time: 0.694317 Oct 12 13:27:22.998974 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 695/1321] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:22 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1471 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:23.010581 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-58853f6d-97d7-4532-b729-3003e40e64b9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:23.011525 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-58853f6d-97d7-4532-b729-3003e40e64b9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: d9e25817-4f35-4244-afa0-543c63840ad2] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:23.027574 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-58853f6d-97d7-4532-b729-3003e40e64b9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:23.028078 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-58853f6d-97d7-4532-b729-3003e40e64b9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:23.028519 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-58853f6d-97d7-4532-b729-3003e40e64b9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:23.029263 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-58853f6d-97d7-4532-b729-3003e40e64b9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:23.030026 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-58853f6d-97d7-4532-b729-3003e40e64b9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:23.031175 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-58853f6d-97d7-4532-b729-3003e40e64b9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:23.063055 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-58853f6d-97d7-4532-b729-3003e40e64b9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] HTTP exception thrown: Instance d9e25817-4f35-4244-afa0-543c63840ad2 could not be found. Oct 12 13:27:23.065199 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-58853f6d-97d7-4532-b729-3003e40e64b9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Request method failure captured: Oct 12 13:27:23.065199 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/servers/d9e25817-4f35-4244-afa0-543c63840ad2 HTTP/1.1 Oct 12 13:27:23.065199 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:27:23.065199 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:27:23.065199 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:27:23.065199 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:27:23.065199 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:27:23.065199 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:27:23.065199 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:27:23.065199 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:23.065199 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr_CCC7LiW_hy7m97LgwkFPF9p6huyY-CWLyQ6oZUHSaBS0K99iV_bpm0lEjAWwlhR5ZBm_SyiP0a6LEf1zwW7PqsfI2rGUmQ5fC8cBIWNpgn3dQQDgP9Y9DZPHDnybACv0UadoqhUY-B-6kowhluEo_e2Vq2P-MSnih4jhQxgwR_Q8 Oct 12 13:27:23.065199 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:27:23.065199 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:27:23.065199 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:27:23.065199 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:27:23.065199 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:27:23.065199 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:27:23.065199 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: be50900be6b246aa9289de6ec5d366f9 Oct 12 13:27:23.065199 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:27:23.065199 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:27:23.065199 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:27:23.067026 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be50900be6b246aa9289de6ec5d366f9"}]}] Oct 12 13:27:23.067026 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:27:23.067026 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: be50900be6b246aa9289de6ec5d366f9 Oct 12 13:27:23.067026 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:27:23.067026 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServersOnMultiNodesTest-1850216957-project Oct 12 13:27:23.067026 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:27:23.067026 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:27:23.067026 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: a0fd9458bb2842829a1e13ac93fade30 Oct 12 13:27:23.067026 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServersOnMultiNodesTest-1850216957-project Oct 12 13:27:23.067026 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:27:23.067026 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance d9e25817-4f35-4244-afa0-543c63840ad2 could not be found. Oct 12 13:27:23.067026 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'd9e25817-4f35-4244-afa0-543c63840ad2'} Oct 12 13:27:23.067907 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:23.067907 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:23.067907 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:27:23.067907 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:27:23.067907 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:27:23.067907 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:27:23.067907 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:27:23.067907 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:27:23.067907 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:27:23.067907 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:27:23.067907 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e25817-4f35-4244-afa0-543c63840ad2 could not be found. Oct 12 13:27:23.067907 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:23.067907 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:23.067907 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:23.067907 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:23.067907 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:23.067907 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:23.067907 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:23.067907 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:23.067907 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:23.069613 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:23.069613 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:27:23.069613 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:27:23.069613 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:27:23.069613 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:27:23.069613 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:27:23.069613 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:27:23.069613 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e25817-4f35-4244-afa0-543c63840ad2 could not be found. Oct 12 13:27:23.069613 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:23.069613 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:23.069613 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:23.069613 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:23.069613 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:23.069613 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:23.069613 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:23.069613 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:23.069613 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e25817-4f35-4244-afa0-543c63840ad2 could not be found. Oct 12 13:27:23.069613 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:23.074650 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-58853f6d-97d7-4532-b729-3003e40e64b9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Returning 404 to user: Instance d9e25817-4f35-4244-afa0-543c63840ad2 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:23.077772 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-58853f6d-97d7-4532-b729-3003e40e64b9 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e25817-4f35-4244-afa0-543c63840ad2" status: 404 len: 111 microversion: 2.1 time: 0.073380 Oct 12 13:27:23.077772 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 696/1322] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:23 2022] GET /compute/v2.1/servers/d9e25817-4f35-4244-afa0-543c63840ad2 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:27:23.087192 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3dff40d1-2082-448c-83d2-8a64f4a1302e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:23.089434 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-3dff40d1-2082-448c-83d2-8a64f4a1302e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fdd5df96-d739-4e05-a503-2cfcab635cc8] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:23.100800 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3dff40d1-2082-448c-83d2-8a64f4a1302e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:23.104444 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3dff40d1-2082-448c-83d2-8a64f4a1302e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:23.105080 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3dff40d1-2082-448c-83d2-8a64f4a1302e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:23.107880 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3dff40d1-2082-448c-83d2-8a64f4a1302e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:23.108856 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3dff40d1-2082-448c-83d2-8a64f4a1302e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:23.110621 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3dff40d1-2082-448c-83d2-8a64f4a1302e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:23.146787 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-3dff40d1-2082-448c-83d2-8a64f4a1302e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] HTTP exception thrown: Instance fdd5df96-d739-4e05-a503-2cfcab635cc8 could not be found. Oct 12 13:27:23.148301 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3dff40d1-2082-448c-83d2-8a64f4a1302e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Request method failure captured: Oct 12 13:27:23.148301 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8 HTTP/1.1 Oct 12 13:27:23.148301 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:27:23.148301 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:27:23.148301 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:27:23.148301 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:27:23.148301 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:27:23.148301 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:27:23.148301 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:27:23.148301 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:23.148301 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRr_CCC7LiW_hy7m97LgwkFPF9p6huyY-CWLyQ6oZUHSaBS0K99iV_bpm0lEjAWwlhR5ZBm_SyiP0a6LEf1zwW7PqsfI2rGUmQ5fC8cBIWNpgn3dQQDgP9Y9DZPHDnybACv0UadoqhUY-B-6kowhluEo_e2Vq2P-MSnih4jhQxgwR_Q8 Oct 12 13:27:23.148301 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:27:23.148301 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:27:23.148301 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:27:23.148301 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:27:23.148301 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:27:23.148301 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:27:23.148301 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: be50900be6b246aa9289de6ec5d366f9 Oct 12 13:27:23.148301 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:27:23.148301 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:27:23.148301 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:27:23.150497 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be50900be6b246aa9289de6ec5d366f9"}]}] Oct 12 13:27:23.150497 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:27:23.150497 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: be50900be6b246aa9289de6ec5d366f9 Oct 12 13:27:23.150497 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:27:23.150497 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServersOnMultiNodesTest-1850216957-project Oct 12 13:27:23.150497 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:27:23.150497 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:27:23.150497 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: a0fd9458bb2842829a1e13ac93fade30 Oct 12 13:27:23.150497 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServersOnMultiNodesTest-1850216957-project Oct 12 13:27:23.150497 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:27:23.150497 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance fdd5df96-d739-4e05-a503-2cfcab635cc8 could not be found. Oct 12 13:27:23.150497 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'fdd5df96-d739-4e05-a503-2cfcab635cc8'} Oct 12 13:27:23.151479 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:23.151479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:23.151479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:27:23.151479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:27:23.151479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:27:23.151479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:27:23.151479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:27:23.151479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:27:23.151479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:27:23.151479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:27:23.151479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdd5df96-d739-4e05-a503-2cfcab635cc8 could not be found. Oct 12 13:27:23.151479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:23.151479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:23.151479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:23.151479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:23.151479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:23.151479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:23.151479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:23.151479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:23.151479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:23.153036 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:23.153036 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:27:23.153036 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:27:23.153036 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:27:23.153036 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:27:23.153036 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:27:23.153036 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:27:23.153036 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdd5df96-d739-4e05-a503-2cfcab635cc8 could not be found. Oct 12 13:27:23.153036 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:23.153036 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:23.153036 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:23.153036 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:23.153036 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:23.153036 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:23.153036 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:23.153036 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:23.153036 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdd5df96-d739-4e05-a503-2cfcab635cc8 could not be found. Oct 12 13:27:23.153036 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:23.160038 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3dff40d1-2082-448c-83d2-8a64f4a1302e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Returning 404 to user: Instance fdd5df96-d739-4e05-a503-2cfcab635cc8 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:23.161340 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3dff40d1-2082-448c-83d2-8a64f4a1302e tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8" status: 404 len: 111 microversion: 2.1 time: 0.077975 Oct 12 13:27:23.162907 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 697/1323] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:23 2022] GET /compute/v2.1/servers/fdd5df96-d739-4e05-a503-2cfcab635cc8 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:27:23.179910 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f27fe1ec-d936-49a5-a800-cf1a1d1a49fa tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:23.330509 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-faddf35f-626b-4472-9449-831bf9dbfd62 tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/1f1cbc5a-cc90-4848-b9b0-846f1e1969b2" status: 200 len: 142 microversion: 2.1 time: 0.529243 Oct 12 13:27:23.332947 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 627/1324] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 12 13:27:22 2022] GET /compute/v2.1/os-floating-ips/1f1cbc5a-cc90-4848-b9b0-846f1e1969b2 => generated 142 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:27:23.352687 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f27fe1ec-d936-49a5-a800-cf1a1d1a49fa tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/cd2995b2-cabe-4f7a-96e7-30ec9ebc56fd" status: 204 len: 0 microversion: 2.1 time: 0.180189 Oct 12 13:27:23.354856 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 698/1325] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 12 13:27:23 2022] DELETE /compute/v2.1/os-server-groups/cd2995b2-cabe-4f7a-96e7-30ec9ebc56fd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:27:23.360739 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c36a265a-c0bb-4e0b-ad7c-c481ce15150f tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] Calling method '.version_select at 0x7f8a9b5f1280>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:23.380824 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8739cf10-7893-42ee-a5a8-5c79061d507f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:23.383613 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-8739cf10-7893-42ee-a5a8-5c79061d507f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fc77e94c-e9f8-4717-aecf-f5f222647117] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:23.399000 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8739cf10-7893-42ee-a5a8-5c79061d507f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:23.400621 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8739cf10-7893-42ee-a5a8-5c79061d507f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:23.401315 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8739cf10-7893-42ee-a5a8-5c79061d507f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:23.405643 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8739cf10-7893-42ee-a5a8-5c79061d507f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:23.414185 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8739cf10-7893-42ee-a5a8-5c79061d507f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:23.414185 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8739cf10-7893-42ee-a5a8-5c79061d507f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:23.466560 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-8739cf10-7893-42ee-a5a8-5c79061d507f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fc77e94c-e9f8-4717-aecf-f5f222647117] Going to try to terminate instance {{(pid=120933) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:27:23.934328 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-8739cf10-7893-42ee-a5a8-5c79061d507f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fc77e94c-e9f8-4717-aecf-f5f222647117" status: 204 len: 0 microversion: 2.1 time: 0.566995 Oct 12 13:27:23.936517 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 699/1326] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:27:23 2022] DELETE /compute/v2.1/servers/fc77e94c-e9f8-4717-aecf-f5f222647117 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:27:23.952509 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-882aea71-a7e8-4814-ac19-4a5301a9a148 req-24f3939c-7736-41bd-9cbf-d4f02cf6bab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd5df96-d739-4e05-a503-2cfcab635cc8", "name": "network-vif-deleted", "tag": "2bb7ff4c-4357-40c1-b7ad-e5260fdb5014"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:23.955892 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c36a265a-c0bb-4e0b-ad7c-c481ce15150f tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.613988 Oct 12 13:27:23.956678 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 628/1327] 10.222.0.52 () {58 vars in 1149 bytes} [Wed Oct 12 13:27:23 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:23.961092 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7a472683-e476-4df7-aae9-9050151b8a36 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:23.962206 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7a472683-e476-4df7-aae9-9050151b8a36 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:23.973132 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-882aea71-a7e8-4814-ac19-4a5301a9a148 req-24f3939c-7736-41bd-9cbf-d4f02cf6bab8 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:23.974490 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-882aea71-a7e8-4814-ac19-4a5301a9a148 req-24f3939c-7736-41bd-9cbf-d4f02cf6bab8 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:23.975160 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-882aea71-a7e8-4814-ac19-4a5301a9a148 req-24f3939c-7736-41bd-9cbf-d4f02cf6bab8 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:23.977523 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7a472683-e476-4df7-aae9-9050151b8a36 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:23.983928 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7a472683-e476-4df7-aae9-9050151b8a36 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:23.984420 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7a472683-e476-4df7-aae9-9050151b8a36 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:23.985205 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7a472683-e476-4df7-aae9-9050151b8a36 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:23.985672 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7a472683-e476-4df7-aae9-9050151b8a36 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:23.986098 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7a472683-e476-4df7-aae9-9050151b8a36 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:23.997519 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-882aea71-a7e8-4814-ac19-4a5301a9a148 req-24f3939c-7736-41bd-9cbf-d4f02cf6bab8 service nova] Creating event network-vif-deleted:2bb7ff4c-4357-40c1-b7ad-e5260fdb5014 for instance fdd5df96-d739-4e05-a503-2cfcab635cc8 on n-h1-861076-2 Oct 12 13:27:24.005642 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-882aea71-a7e8-4814-ac19-4a5301a9a148 req-24f3939c-7736-41bd-9cbf-d4f02cf6bab8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067286 Oct 12 13:27:24.006633 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 700/1328] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:24.017009 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3c6170ec-7193-4ab6-a7fd-94dc70e84718 tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] Calling method '.version_select at 0x7f8a9bca5790>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:24.054541 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7a472683-e476-4df7-aae9-9050151b8a36 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:27:24.592390 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7a472683-e476-4df7-aae9-9050151b8a36 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "DELETE /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17" status: 204 len: 0 microversion: 2.1 time: 0.634112 Oct 12 13:27:24.599188 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 629/1329] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:27:23 2022] DELETE /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:27:24.600468 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3291a61f-51f9-4cc4-b8dc-5c8a12e3a5f8 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:24.601587 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3291a61f-51f9-4cc4-b8dc-5c8a12e3a5f8 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:24.609584 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3291a61f-51f9-4cc4-b8dc-5c8a12e3a5f8 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:24.612996 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3291a61f-51f9-4cc4-b8dc-5c8a12e3a5f8 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:24.613691 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3291a61f-51f9-4cc4-b8dc-5c8a12e3a5f8 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:24.615836 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3291a61f-51f9-4cc4-b8dc-5c8a12e3a5f8 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:24.616824 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3291a61f-51f9-4cc4-b8dc-5c8a12e3a5f8 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:24.617632 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3291a61f-51f9-4cc4-b8dc-5c8a12e3a5f8 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:25.019371 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-3291a61f-51f9-4cc4-b8dc-5c8a12e3a5f8 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:25.027750 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3291a61f-51f9-4cc4-b8dc-5c8a12e3a5f8 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1471 microversion: 2.1 time: 0.433431 Oct 12 13:27:25.050242 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 630/1330] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:24 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1471 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:25.067692 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cc2469da-92f4-4376-8fe8-365418380107 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:25.068560 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cc2469da-92f4-4376-8fe8-365418380107 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fc77e94c-e9f8-4717-aecf-f5f222647117] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:25.093989 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc2469da-92f4-4376-8fe8-365418380107 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:25.094619 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc2469da-92f4-4376-8fe8-365418380107 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:25.095092 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc2469da-92f4-4376-8fe8-365418380107 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:25.095840 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc2469da-92f4-4376-8fe8-365418380107 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:25.096318 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc2469da-92f4-4376-8fe8-365418380107 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:25.096767 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc2469da-92f4-4376-8fe8-365418380107 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:25.541999 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-cc2469da-92f4-4376-8fe8-365418380107 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:25.556388 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cc2469da-92f4-4376-8fe8-365418380107 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fc77e94c-e9f8-4717-aecf-f5f222647117" status: 200 len: 1471 microversion: 2.1 time: 0.504680 Oct 12 13:27:25.559710 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 631/1331] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:25 2022] GET /compute/v2.1/servers/fc77e94c-e9f8-4717-aecf-f5f222647117 => generated 1471 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:26.054581 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-08828fc0-44ee-45bf-8363-aa1f6088a893 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:26.055264 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-08828fc0-44ee-45bf-8363-aa1f6088a893 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:26.064568 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-08828fc0-44ee-45bf-8363-aa1f6088a893 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:26.065148 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-08828fc0-44ee-45bf-8363-aa1f6088a893 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:26.069950 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-08828fc0-44ee-45bf-8363-aa1f6088a893 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:26.070807 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-08828fc0-44ee-45bf-8363-aa1f6088a893 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:26.071303 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-08828fc0-44ee-45bf-8363-aa1f6088a893 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:26.071744 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-08828fc0-44ee-45bf-8363-aa1f6088a893 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:26.119426 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:27:26.589770 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-08828fc0-44ee-45bf-8363-aa1f6088a893 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:26.598780 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-08828fc0-44ee-45bf-8363-aa1f6088a893 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1471 microversion: 2.1 time: 0.546504 Oct 12 13:27:26.599880 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 632/1332] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:26 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1471 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:27:26.611070 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e1767a22-657f-484e-ac70-0be30c0ed8fc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:26.612517 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e1767a22-657f-484e-ac70-0be30c0ed8fc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fc77e94c-e9f8-4717-aecf-f5f222647117] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:26.622003 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3c6170ec-7193-4ab6-a7fd-94dc70e84718 tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/1f1cbc5a-cc90-4848-b9b0-846f1e1969b2" status: 202 len: 0 microversion: 2.1 time: 2.613935 Oct 12 13:27:26.622577 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 701/1333] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 12 13:27:24 2022] DELETE /compute/v2.1/os-floating-ips/1f1cbc5a-cc90-4848-b9b0-846f1e1969b2 => generated 0 bytes in 2615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:27:26.629860 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1767a22-657f-484e-ac70-0be30c0ed8fc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:26.630367 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1767a22-657f-484e-ac70-0be30c0ed8fc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:26.630808 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1767a22-657f-484e-ac70-0be30c0ed8fc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:26.631516 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1767a22-657f-484e-ac70-0be30c0ed8fc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:26.631970 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1767a22-657f-484e-ac70-0be30c0ed8fc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:26.641412 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1767a22-657f-484e-ac70-0be30c0ed8fc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:26.641738 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5ce7fcd0-0dbd-4591-9f6a-c14476892a32 tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] Action: 'create', calling method: .version_select at 0x7f8a9bb53d30>, body: {"pool": null} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:27.242319 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:27:27.483327 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=6 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:27:27.712255 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-e1767a22-657f-484e-ac70-0be30c0ed8fc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:27.723310 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e1767a22-657f-484e-ac70-0be30c0ed8fc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fc77e94c-e9f8-4717-aecf-f5f222647117" status: 200 len: 1471 microversion: 2.1 time: 1.117098 Oct 12 13:27:27.723920 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 633/1334] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:26 2022] GET /compute/v2.1/servers/fc77e94c-e9f8-4717-aecf-f5f222647117 => generated 1471 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:27.735142 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f6f49d1d-f467-490b-951d-cb5fccd87f9b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:27.737886 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f6f49d1d-f467-490b-951d-cb5fccd87f9b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:27.754989 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f6f49d1d-f467-490b-951d-cb5fccd87f9b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:27.757262 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f6f49d1d-f467-490b-951d-cb5fccd87f9b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:27.758248 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f6f49d1d-f467-490b-951d-cb5fccd87f9b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:27.760225 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f6f49d1d-f467-490b-951d-cb5fccd87f9b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:27.763089 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f6f49d1d-f467-490b-951d-cb5fccd87f9b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:27.765230 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f6f49d1d-f467-490b-951d-cb5fccd87f9b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:28.625731 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f6f49d1d-f467-490b-951d-cb5fccd87f9b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:28.639693 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f6f49d1d-f467-490b-951d-cb5fccd87f9b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1471 microversion: 2.1 time: 0.912399 Oct 12 13:27:28.664079 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 634/1335] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:27 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1471 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:28.748938 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5d4bc194-fd7e-44ec-85e4-86fe3618d8bc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:28.749563 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5d4bc194-fd7e-44ec-85e4-86fe3618d8bc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fc77e94c-e9f8-4717-aecf-f5f222647117] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:28.766877 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d4bc194-fd7e-44ec-85e4-86fe3618d8bc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:28.767902 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d4bc194-fd7e-44ec-85e4-86fe3618d8bc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:28.768550 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d4bc194-fd7e-44ec-85e4-86fe3618d8bc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:28.769528 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d4bc194-fd7e-44ec-85e4-86fe3618d8bc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:28.774339 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d4bc194-fd7e-44ec-85e4-86fe3618d8bc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:28.775079 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d4bc194-fd7e-44ec-85e4-86fe3618d8bc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:29.881788 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-5d4bc194-fd7e-44ec-85e4-86fe3618d8bc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:29.891052 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5d4bc194-fd7e-44ec-85e4-86fe3618d8bc tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fc77e94c-e9f8-4717-aecf-f5f222647117" status: 200 len: 1471 microversion: 2.1 time: 1.145922 Oct 12 13:27:29.899834 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 635/1336] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:28 2022] GET /compute/v2.1/servers/fc77e94c-e9f8-4717-aecf-f5f222647117 => generated 1471 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:27:29.919102 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0daabeab-bd55-4aa5-9417-097347d243e4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:29.919663 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0daabeab-bd55-4aa5-9417-097347d243e4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:29.935624 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0daabeab-bd55-4aa5-9417-097347d243e4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:29.936058 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0daabeab-bd55-4aa5-9417-097347d243e4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:29.936514 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0daabeab-bd55-4aa5-9417-097347d243e4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:29.937266 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0daabeab-bd55-4aa5-9417-097347d243e4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:29.937721 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0daabeab-bd55-4aa5-9417-097347d243e4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:29.938152 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0daabeab-bd55-4aa5-9417-097347d243e4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:31.182510 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-0daabeab-bd55-4aa5-9417-097347d243e4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:31.195126 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0daabeab-bd55-4aa5-9417-097347d243e4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1471 microversion: 2.1 time: 1.294055 Oct 12 13:27:31.195728 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 636/1337] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:29 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1471 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:31.206268 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-39104e52-d748-4bfc-bca2-576b69e08200 req-5757a0e8-0687-4347-b368-8e7f15eac55f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc77e94c-e9f8-4717-aecf-f5f222647117", "name": "network-vif-deleted", "tag": "75bb8e1c-5674-4e19-963a-de9d1d18befe"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:31.239439 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-39104e52-d748-4bfc-bca2-576b69e08200 req-5757a0e8-0687-4347-b368-8e7f15eac55f service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:31.240252 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-39104e52-d748-4bfc-bca2-576b69e08200 req-5757a0e8-0687-4347-b368-8e7f15eac55f service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:31.240923 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-39104e52-d748-4bfc-bca2-576b69e08200 req-5757a0e8-0687-4347-b368-8e7f15eac55f service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:31.273155 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-39104e52-d748-4bfc-bca2-576b69e08200 req-5757a0e8-0687-4347-b368-8e7f15eac55f service nova] Creating event network-vif-deleted:75bb8e1c-5674-4e19-963a-de9d1d18befe for instance fc77e94c-e9f8-4717-aecf-f5f222647117 on n-h1-861076-2 Oct 12 13:27:31.296001 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-39104e52-d748-4bfc-bca2-576b69e08200 req-5757a0e8-0687-4347-b368-8e7f15eac55f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099016 Oct 12 13:27:31.302583 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 637/1338] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:31.329434 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-82e45c18-ea12-4a0e-81f5-056bc4f27069 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:31.329434 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-82e45c18-ea12-4a0e-81f5-056bc4f27069 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fc77e94c-e9f8-4717-aecf-f5f222647117] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:31.342771 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-82e45c18-ea12-4a0e-81f5-056bc4f27069 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:31.348674 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-82e45c18-ea12-4a0e-81f5-056bc4f27069 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:31.350609 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-82e45c18-ea12-4a0e-81f5-056bc4f27069 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:31.352371 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-82e45c18-ea12-4a0e-81f5-056bc4f27069 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:31.355584 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-82e45c18-ea12-4a0e-81f5-056bc4f27069 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:31.357471 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-82e45c18-ea12-4a0e-81f5-056bc4f27069 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:31.558163 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-82e45c18-ea12-4a0e-81f5-056bc4f27069 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:31.558728 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-82e45c18-ea12-4a0e-81f5-056bc4f27069 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:31.559272 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-82e45c18-ea12-4a0e-81f5-056bc4f27069 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:31.559902 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-82e45c18-ea12-4a0e-81f5-056bc4f27069 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lazy-loading 'fault' on Instance uuid fc77e94c-e9f8-4717-aecf-f5f222647117 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:27:31.837546 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-82e45c18-ea12-4a0e-81f5-056bc4f27069 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:31.858438 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-82e45c18-ea12-4a0e-81f5-056bc4f27069 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fc77e94c-e9f8-4717-aecf-f5f222647117" status: 200 len: 1306 microversion: 2.1 time: 0.553937 Oct 12 13:27:31.874929 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 638/1339] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:31 2022] GET /compute/v2.1/servers/fc77e94c-e9f8-4717-aecf-f5f222647117 => generated 1306 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:32.225680 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6e6470aa-82a2-4752-8c33-395e7216ff33 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Action: 'create', calling method: .version_select at 0x7f8a9b5b3820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-833038231", "description": "tempest-description-1812558078"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:33.285528 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6e6470aa-82a2-4752-8c33-395e7216ff33 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.324607 Oct 12 13:27:33.286480 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 639/1340] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:27:31 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:33.291362 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d175ce0d-0e10-4d54-b3d6-68f10e41c10b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:33.292165 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d175ce0d-0e10-4d54-b3d6-68f10e41c10b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:33.307952 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d175ce0d-0e10-4d54-b3d6-68f10e41c10b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:33.308704 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d175ce0d-0e10-4d54-b3d6-68f10e41c10b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:33.309332 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d175ce0d-0e10-4d54-b3d6-68f10e41c10b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:33.310226 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d175ce0d-0e10-4d54-b3d6-68f10e41c10b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:33.310837 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d175ce0d-0e10-4d54-b3d6-68f10e41c10b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:33.311420 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d175ce0d-0e10-4d54-b3d6-68f10e41c10b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:33.615188 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5ce7fcd0-0dbd-4591-9f6a-c14476892a32 tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.986236 Oct 12 13:27:33.615784 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 702/1341] 10.222.0.52 () {60 vars in 1170 bytes} [Wed Oct 12 13:27:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:33.623285 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cc7c5c8c-07b3-47c9-8232-13f697f76b4f tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-379938777", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "2ac46638-ae9e-42a4-bb0b-22f0e91dbfc8"}], "block_device_mapping_v2": [{"uuid": "8ec1db29-f700-4e7a-a3d9-4f4149ce8e2d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:33.820420 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d175ce0d-0e10-4d54-b3d6-68f10e41c10b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:33.824776 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d175ce0d-0e10-4d54-b3d6-68f10e41c10b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1471 microversion: 2.1 time: 0.536886 Oct 12 13:27:33.826098 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 640/1342] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:33 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1471 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:33.831414 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-28af80d7-c40a-4182-9f14-2eb8d64e14b6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:33.832315 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-28af80d7-c40a-4182-9f14-2eb8d64e14b6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: fc77e94c-e9f8-4717-aecf-f5f222647117] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:33.840702 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-28af80d7-c40a-4182-9f14-2eb8d64e14b6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:33.842213 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-28af80d7-c40a-4182-9f14-2eb8d64e14b6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:33.842591 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-28af80d7-c40a-4182-9f14-2eb8d64e14b6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:33.844052 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-28af80d7-c40a-4182-9f14-2eb8d64e14b6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:33.844684 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-28af80d7-c40a-4182-9f14-2eb8d64e14b6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:33.845346 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-28af80d7-c40a-4182-9f14-2eb8d64e14b6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:33.921614 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-cc7c5c8c-07b3-47c9-8232-13f697f76b4f tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] validate_networks() for [('2ac46638-ae9e-42a4-bb0b-22f0e91dbfc8', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:27:33.995964 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:27:34.216163 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-28af80d7-c40a-4182-9f14-2eb8d64e14b6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] HTTP exception thrown: Instance fc77e94c-e9f8-4717-aecf-f5f222647117 could not be found. Oct 12 13:27:34.218866 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-28af80d7-c40a-4182-9f14-2eb8d64e14b6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Request method failure captured: Oct 12 13:27:34.218866 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/fc77e94c-e9f8-4717-aecf-f5f222647117 HTTP/1.1 Oct 12 13:27:34.218866 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:27:34.218866 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:27:34.218866 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:27:34.218866 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:27:34.218866 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:27:34.218866 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:27:34.218866 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:27:34.218866 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:34.218866 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr_CCC7LiW_hy7m97LgwkFPF9p6huyY-CWLyQ6oZUHSaBS0K99iV_bpm0lEjAWwlhR5ZBm_SyiP0a6LEf1zwW7PqsfI2rGUmQ5fC8cBIWNpgn3dQQDgP9Y9DZPHDnybACv0UadoqhUY-B-6kowhluEo_e2Vq2P-MSnih4jhQxgwR_Q8 Oct 12 13:27:34.218866 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:27:34.218866 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:27:34.218866 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:27:34.218866 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:27:34.218866 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:27:34.218866 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:27:34.218866 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: be50900be6b246aa9289de6ec5d366f9 Oct 12 13:27:34.218866 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:27:34.218866 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:27:34.218866 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:27:34.220579 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be50900be6b246aa9289de6ec5d366f9"}]}] Oct 12 13:27:34.220579 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:27:34.220579 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: be50900be6b246aa9289de6ec5d366f9 Oct 12 13:27:34.220579 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:27:34.220579 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServersOnMultiNodesTest-1850216957-project Oct 12 13:27:34.220579 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:27:34.220579 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:27:34.220579 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: a0fd9458bb2842829a1e13ac93fade30 Oct 12 13:27:34.220579 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServersOnMultiNodesTest-1850216957-project Oct 12 13:27:34.220579 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:27:34.220579 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance fc77e94c-e9f8-4717-aecf-f5f222647117 could not be found. Oct 12 13:27:34.220579 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'fc77e94c-e9f8-4717-aecf-f5f222647117'} Oct 12 13:27:34.222121 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:34.222121 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:34.222121 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:27:34.222121 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:27:34.222121 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:27:34.222121 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:27:34.222121 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:27:34.222121 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:27:34.222121 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:27:34.222121 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:27:34.222121 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc77e94c-e9f8-4717-aecf-f5f222647117 could not be found. Oct 12 13:27:34.222121 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:34.222121 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:34.222121 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:34.222121 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:34.222121 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:34.222121 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:34.222121 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:34.222121 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:34.222121 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:34.223720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:34.223720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:27:34.223720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:27:34.223720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:27:34.223720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:27:34.223720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:27:34.223720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:27:34.223720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc77e94c-e9f8-4717-aecf-f5f222647117 could not be found. Oct 12 13:27:34.223720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:34.223720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:34.223720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:34.223720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:34.223720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:34.223720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:34.223720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:34.223720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:34.223720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc77e94c-e9f8-4717-aecf-f5f222647117 could not be found. Oct 12 13:27:34.223720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:34.230069 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-28af80d7-c40a-4182-9f14-2eb8d64e14b6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Returning 404 to user: Instance fc77e94c-e9f8-4717-aecf-f5f222647117 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:34.233150 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-28af80d7-c40a-4182-9f14-2eb8d64e14b6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/fc77e94c-e9f8-4717-aecf-f5f222647117" status: 404 len: 111 microversion: 2.1 time: 0.403478 Oct 12 13:27:34.235605 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 641/1343] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:33 2022] GET /compute/v2.1/servers/fc77e94c-e9f8-4717-aecf-f5f222647117 => generated 111 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:27:34.243191 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-76d60b7c-cc13-4dee-abd7-2c72bdf323c0 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Action: 'create', calling method: .version_select at 0x7f8a9b638e50>, body: {"security_group_rule": {"parent_group_id": "b6c7bf05-0a3a-4087-a4f9-9359e056cdab", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:34.389625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-cc7c5c8c-07b3-47c9-8232-13f697f76b4f tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c4ee9d5b-721d-42a9-b500-997f7aed6107) Oct 12 13:27:34.389625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:34.389625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:34.389625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:34.389625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:34.389625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:34.389625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:34.389625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:34.389625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:34.389625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:34.389625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:27:34.389625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:27:34.389625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:27:34.389625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:27:34.389625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:27:34.389625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:27:34.391086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:27:34.391086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:27:34.391086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:27:34.391086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:27:34.391086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:27:34.391086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:27:34.391086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:27:34.391086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:27:34.391086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:27:34.391086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:27:34.391086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:27:34.391086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:34.391086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:34.391086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:27:34.391086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:27:34.391086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:34.391086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:34.391086 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:27:34.392668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:27:34.392668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:34.392668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:34.392668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:27:34.392668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:27:34.392668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:34.392668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:34.392668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:27:34.392668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:27:34.392668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:27:34.392668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:27:34.392668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:27:34.392668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:27:34.392668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:27:34.392668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:27:34.392668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:27:34.392668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:27:34.392668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:27:34.394805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:27:34.394805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:27:34.394805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:27:34.394805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:27:34.394805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:27:34.394805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:27:34.394805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:27:34.394805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:27:34.394805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:27:34.394805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:27:34.394805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:27:34.394805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:27:34.394805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:27:34.394805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:27:34.394805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:27:34.396023 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c4ee9d5b-721d-42a9-b500-997f7aed6107) Oct 12 13:27:34.396023 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:34.397191 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-cc7c5c8c-07b3-47c9-8232-13f697f76b4f tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:27:34.397191 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:27:34.400070 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cc7c5c8c-07b3-47c9-8232-13f697f76b4f tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] Request method failure captured: Oct 12 13:27:34.400070 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:27:34.400070 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:27:34.400070 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:27:34.400070 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:27:34.400070 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 348 Oct 12 13:27:34.400070 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:27:34.400070 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:27:34.400070 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:27:34.400070 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:34.400070 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsBuKp2VByNdgfQrj0sMeYqojE_eczcPkIffWMyqj-Idx_zy7Z5xFTQjdVldszLkBK6xNruL0MKKC4-BfP9X2aVjFJRZ0zIBshu9L2xvXHvXOvhhepvh03I4jUVcyEv7s9lcsTTtJi_MtHKAFX-w0FG3xqUSK9fPnh_tb7vKMNTag30 Oct 12 13:27:34.400070 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:27:34.400070 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:27:34.400070 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:27:34.400070 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:27:34.400070 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:27:34.400070 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:27:34.400070 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: eeb7bf197c5c402fbb618ce9759228a0 Oct 12 13:27:34.400070 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-LiveMigrationTest-959108841 Oct 12 13:27:34.400070 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:27:34.400070 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:27:34.401790 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eeb7bf197c5c402fbb618ce9759228a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eeb7bf197c5c402fbb618ce9759228a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eeb7bf197c5c402fbb618ce9759228a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eeb7bf197c5c402fbb618ce9759228a0"}]}] Oct 12 13:27:34.401790 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-LiveMigrationTest-959108841 Oct 12 13:27:34.401790 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: eeb7bf197c5c402fbb618ce9759228a0 Oct 12 13:27:34.401790 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-LiveMigrationTest-959108841 Oct 12 13:27:34.401790 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-LiveMigrationTest-959108841-project Oct 12 13:27:34.401790 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:27:34.401790 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:27:34.401790 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: b01bb9e01bbd4feebbb3f965089245f4 Oct 12 13:27:34.401790 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-LiveMigrationTest-959108841-project Oct 12 13:27:34.401790 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:27:34.401790 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-LiveMigrationTest-server-379938777", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "2ac46638-ae9e-42a4-bb0b-22f0e91dbfc8"}], "block_device_mapping_v2": [{"uuid": "8ec1db29-f700-4e7a-a3d9-4f4149ce8e2d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} Oct 12 13:27:34.402571 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:27:34.402571 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:27:34.402571 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:27:34.402571 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-LiveMigrationTest-server-379938777', 'imageRef': '', 'flavorRef': '452', 'networks': [{'uuid': '2ac46638-ae9e-42a4-bb0b-22f0e91dbfc8'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': '8ec1db29-f700-4e7a-a3d9-4f4149ce8e2d'}]}}} Oct 12 13:27:34.402571 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:34.402571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:34.402571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:34.402571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:34.402571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:34.402571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:34.402571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:34.402571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:34.402571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:34.402571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:34.402571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:27:34.402571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:27:34.402571 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:27:34.403765 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:27:34.403765 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:27:34.403765 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:27:34.403765 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:27:34.403765 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:27:34.403765 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:27:34.403765 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:27:34.403765 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:27:34.403765 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:27:34.403765 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:27:34.403765 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:27:34.403765 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:27:34.403765 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:27:34.403765 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:27:34.403765 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:34.403765 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:34.403765 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:27:34.403765 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:27:34.405076 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:34.405076 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:34.405076 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:27:34.405076 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:27:34.405076 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:34.405076 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:34.405076 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:27:34.405076 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:27:34.405076 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:34.405076 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:34.405076 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:27:34.405076 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:27:34.405076 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:27:34.405076 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:27:34.405076 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:27:34.405076 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:27:34.405076 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:27:34.405076 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:27:34.406294 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:27:34.406294 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:27:34.406294 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:27:34.406294 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:27:34.406294 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:27:34.406294 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:27:34.406294 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:27:34.406294 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:27:34.406294 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:27:34.406294 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:27:34.406294 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:27:34.406294 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:27:34.406294 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:27:34.406294 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:27:34.406294 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:27:34.406294 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:27:34.407478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:27:34.407478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:27:34.407478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c4ee9d5b-721d-42a9-b500-997f7aed6107) Oct 12 13:27:34.407478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:34.407478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:34.407478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:34.407478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:34.407478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:34.407478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:34.407478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:34.407478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:34.407478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:27:34.407478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:27:34.407478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:27:34.407478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:34.407478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:34.407478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:34.407478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:34.410215 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:34.410215 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:34.410215 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:34.410215 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:34.410215 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:34.410215 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:27:34.410215 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:34.410215 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:34.417530 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cc7c5c8c-07b3-47c9-8232-13f697f76b4f tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:27:34.417530 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:34.417530 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-cc7c5c8c-07b3-47c9-8232-13f697f76b4f tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.794971 Oct 12 13:27:34.417530 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 703/1344] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:27:33 2022] POST /compute/v2.1/servers => generated 214 bytes in 797 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:27:34.433508 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-585d6444-de9f-4137-b444-8bc0abcbd914 req-6cd03be0-72cd-4b6e-ba44-e9f58e4820a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36dbc389-96b0-4e73-8fa4-c2f58e5a7b17", "name": "network-vif-deleted", "tag": "453d09e8-2e47-4808-8698-8d0d4d8de8e9"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:34.460166 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-585d6444-de9f-4137-b444-8bc0abcbd914 req-6cd03be0-72cd-4b6e-ba44-e9f58e4820a1 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:34.463328 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-585d6444-de9f-4137-b444-8bc0abcbd914 req-6cd03be0-72cd-4b6e-ba44-e9f58e4820a1 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:34.464041 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-585d6444-de9f-4137-b444-8bc0abcbd914 req-6cd03be0-72cd-4b6e-ba44-e9f58e4820a1 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:34.494319 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-585d6444-de9f-4137-b444-8bc0abcbd914 req-6cd03be0-72cd-4b6e-ba44-e9f58e4820a1 service nova] Creating event network-vif-deleted:453d09e8-2e47-4808-8698-8d0d4d8de8e9 for instance 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 on n-h1-861076-2 Oct 12 13:27:34.504576 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-585d6444-de9f-4137-b444-8bc0abcbd914 req-6cd03be0-72cd-4b6e-ba44-e9f58e4820a1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090076 Oct 12 13:27:34.505213 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 704/1345] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:34.517071 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f4f13f23-f076-4665-9ffa-f90df534f389 tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] Calling method '.version_select at 0x7f8a9baf2ca0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:35.049398 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-76d60b7c-cc13-4dee-abd7-2c72bdf323c0 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.811737 Oct 12 13:27:35.049985 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 642/1346] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 12 13:27:34 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:35.128589 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-771e6a20-d570-4b78-b511-291ae19ba5b5 tempest-ServerAddressesTestJSON-804992194 tempest-ServerAddressesTestJSON-804992194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-602706781", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "9284e917-f2f7-4ef3-9a10-e77d76ed7538"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:35.229947 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-771e6a20-d570-4b78-b511-291ae19ba5b5 tempest-ServerAddressesTestJSON-804992194 tempest-ServerAddressesTestJSON-804992194-project] validate_networks() for [('9284e917-f2f7-4ef3-9a10-e77d76ed7538', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:27:36.261498 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-771e6a20-d570-4b78-b511-291ae19ba5b5 tempest-ServerAddressesTestJSON-804992194 tempest-ServerAddressesTestJSON-804992194-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-11296d60-3b1b-461d-8daf-956219f5d982) Oct 12 13:27:36.261498 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:36.261498 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:36.261498 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:36.261498 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:36.261498 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:36.261498 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:36.261498 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:36.261498 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:36.261498 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:36.261498 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:27:36.261498 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:27:36.261498 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:27:36.261498 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:27:36.261498 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:27:36.261498 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:27:36.263432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:27:36.263432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:27:36.263432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:27:36.263432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:27:36.263432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:27:36.263432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:27:36.263432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:27:36.263432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:27:36.263432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:27:36.263432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:27:36.263432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:27:36.263432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:36.263432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:36.263432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:27:36.263432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:27:36.263432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:36.263432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:36.263432 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:27:36.264945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:27:36.264945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:36.264945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:36.264945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:27:36.264945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:27:36.264945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:36.264945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:36.264945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:27:36.264945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:27:36.264945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:27:36.264945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:27:36.264945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:27:36.264945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:27:36.264945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:27:36.264945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:27:36.264945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:27:36.264945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:27:36.264945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:27:36.270926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:27:36.270926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:27:36.270926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:27:36.270926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:27:36.270926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:27:36.270926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:27:36.270926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:27:36.270926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:27:36.270926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:27:36.270926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:27:36.270926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:27:36.270926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:27:36.270926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:27:36.270926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:27:36.270926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-11296d60-3b1b-461d-8daf-956219f5d982) Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-771e6a20-d570-4b78-b511-291ae19ba5b5 tempest-ServerAddressesTestJSON-804992194 tempest-ServerAddressesTestJSON-804992194-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-771e6a20-d570-4b78-b511-291ae19ba5b5 tempest-ServerAddressesTestJSON-804992194 tempest-ServerAddressesTestJSON-804992194-project] Request method failure captured: Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 208 Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsDFLiAecGUCZ-CCjqgfDyggiEejT50zc852RX_fbm4ws4Elldw3cOLUfNbJPSUy6gw5ckCf7F1z71otknlNvgm5Pxuhu3mIwMM7rnis-hl8VN6NFhcKO4jfrQeczIlvNUEsrGr5IVX4hrst8YHZuYOCNfuCZbOt1E0zQTtZQTXsedE Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: e5411a608a13439c9e701d140f91235d Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServerAddressesTestJSON-804992194 Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:27:36.272406 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:27:36.277585 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e5411a608a13439c9e701d140f91235d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e5411a608a13439c9e701d140f91235d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e5411a608a13439c9e701d140f91235d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e5411a608a13439c9e701d140f91235d"}]}] Oct 12 13:27:36.277585 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServerAddressesTestJSON-804992194 Oct 12 13:27:36.277585 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: e5411a608a13439c9e701d140f91235d Oct 12 13:27:36.277585 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServerAddressesTestJSON-804992194 Oct 12 13:27:36.277585 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServerAddressesTestJSON-804992194-project Oct 12 13:27:36.277585 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:27:36.277585 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:27:36.277585 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: c38e93046baf43689bea6da0738d3728 Oct 12 13:27:36.277585 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServerAddressesTestJSON-804992194-project Oct 12 13:27:36.277585 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:27:36.277585 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-ServerAddressesTestJSON-server-602706781", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "9284e917-f2f7-4ef3-9a10-e77d76ed7538"}]}} Oct 12 13:27:36.278654 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:27:36.278654 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:27:36.278654 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:27:36.278654 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-ServerAddressesTestJSON-server-602706781', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '9284e917-f2f7-4ef3-9a10-e77d76ed7538'}]}}} Oct 12 13:27:36.278654 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:36.278654 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:36.278654 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:36.278654 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:36.278654 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:36.278654 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:36.278654 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:36.278654 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:36.278654 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:36.278654 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:36.278654 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:27:36.278654 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:27:36.278654 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:27:36.278654 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:27:36.278654 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:27:36.279991 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:27:36.279991 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:27:36.279991 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:27:36.279991 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:27:36.279991 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:27:36.279991 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:27:36.279991 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:27:36.279991 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:27:36.279991 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:27:36.279991 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:27:36.279991 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:27:36.279991 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:27:36.279991 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:36.279991 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:36.279991 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:27:36.279991 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:27:36.279991 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:36.279991 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:36.282795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:27:36.282795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:27:36.282795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:36.282795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:36.282795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:27:36.282795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:27:36.282795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:36.282795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:36.282795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:27:36.282795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:27:36.282795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:27:36.282795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:27:36.282795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:27:36.282795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:27:36.282795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:27:36.282795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:27:36.282795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:27:36.282795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:27:36.284860 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:27:36.284860 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:27:36.284860 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:27:36.284860 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:27:36.284860 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:27:36.284860 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:27:36.284860 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:27:36.284860 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:27:36.284860 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:27:36.284860 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:27:36.284860 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:27:36.284860 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:27:36.284860 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:27:36.284860 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:27:36.284860 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:27:36.284860 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:27:36.286558 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-11296d60-3b1b-461d-8daf-956219f5d982) Oct 12 13:27:36.286558 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:36.286558 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:36.286558 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:36.286558 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:36.286558 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:36.286558 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:36.286558 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:36.286558 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:36.286558 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:27:36.286558 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:27:36.286558 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:27:36.286558 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:36.286558 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:36.286558 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:36.286558 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:36.286558 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:36.286558 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:36.286558 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:36.288157 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:36.288157 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:36.288157 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:27:36.288157 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:36.288157 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:36.288157 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-771e6a20-d570-4b78-b511-291ae19ba5b5 tempest-ServerAddressesTestJSON-804992194 tempest-ServerAddressesTestJSON-804992194-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:27:36.288157 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:36.288157 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-771e6a20-d570-4b78-b511-291ae19ba5b5 tempest-ServerAddressesTestJSON-804992194 tempest-ServerAddressesTestJSON-804992194-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.214536 Oct 12 13:27:36.288157 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 643/1347] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:27:35 2022] POST /compute/v2.1/servers => generated 214 bytes in 1216 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:27:36.288157 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-20723710-1769-422e-8594-3daf16971d15 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:36.289042 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-20723710-1769-422e-8594-3daf16971d15 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:36.293372 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-20723710-1769-422e-8594-3daf16971d15 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:36.293871 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-20723710-1769-422e-8594-3daf16971d15 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:36.294305 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-20723710-1769-422e-8594-3daf16971d15 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:36.295012 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-20723710-1769-422e-8594-3daf16971d15 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:36.295465 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-20723710-1769-422e-8594-3daf16971d15 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:36.295880 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-20723710-1769-422e-8594-3daf16971d15 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:36.341345 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-20723710-1769-422e-8594-3daf16971d15 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] HTTP exception thrown: Instance 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 could not be found. Oct 12 13:27:36.362878 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-20723710-1769-422e-8594-3daf16971d15 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Request method failure captured: Oct 12 13:27:36.362878 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 HTTP/1.1 Oct 12 13:27:36.362878 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:27:36.362878 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:27:36.362878 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:27:36.362878 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:27:36.362878 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:27:36.362878 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:27:36.362878 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:27:36.362878 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:36.362878 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr_CCC7LiW_hy7m97LgwkFPF9p6huyY-CWLyQ6oZUHSaBS0K99iV_bpm0lEjAWwlhR5ZBm_SyiP0a6LEf1zwW7PqsfI2rGUmQ5fC8cBIWNpgn3dQQDgP9Y9DZPHDnybACv0UadoqhUY-B-6kowhluEo_e2Vq2P-MSnih4jhQxgwR_Q8 Oct 12 13:27:36.362878 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:27:36.362878 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:27:36.362878 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:27:36.362878 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:27:36.362878 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:27:36.362878 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:27:36.362878 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: be50900be6b246aa9289de6ec5d366f9 Oct 12 13:27:36.362878 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:27:36.362878 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:27:36.362878 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:27:36.364633 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be50900be6b246aa9289de6ec5d366f9"}]}] Oct 12 13:27:36.364633 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:27:36.364633 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: be50900be6b246aa9289de6ec5d366f9 Oct 12 13:27:36.364633 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:27:36.364633 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServersOnMultiNodesTest-1850216957-project Oct 12 13:27:36.364633 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:27:36.364633 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:27:36.364633 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: a0fd9458bb2842829a1e13ac93fade30 Oct 12 13:27:36.364633 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServersOnMultiNodesTest-1850216957-project Oct 12 13:27:36.364633 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:27:36.364633 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 could not be found. Oct 12 13:27:36.364633 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '36dbc389-96b0-4e73-8fa4-c2f58e5a7b17'} Oct 12 13:27:36.365581 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:36.365581 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:36.365581 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:27:36.365581 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:27:36.365581 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:27:36.365581 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:27:36.365581 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:27:36.365581 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:27:36.365581 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:27:36.365581 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:27:36.365581 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 could not be found. Oct 12 13:27:36.365581 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:36.365581 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:36.365581 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:36.365581 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:36.365581 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:36.365581 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:36.365581 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:36.365581 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:36.365581 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:36.367379 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:36.367379 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:27:36.367379 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:27:36.367379 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:27:36.367379 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:27:36.367379 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:27:36.367379 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:27:36.367379 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 could not be found. Oct 12 13:27:36.367379 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:36.367379 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:36.367379 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:36.367379 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:36.367379 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:36.367379 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:36.367379 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:36.367379 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:36.367379 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 could not be found. Oct 12 13:27:36.367379 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:36.372489 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-20723710-1769-422e-8594-3daf16971d15 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Returning 404 to user: Instance 36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:36.374576 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-20723710-1769-422e-8594-3daf16971d15 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17" status: 404 len: 111 microversion: 2.1 time: 0.106946 Oct 12 13:27:36.376452 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 644/1348] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:36 2022] GET /compute/v2.1/servers/36dbc389-96b0-4e73-8fa4-c2f58e5a7b17 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:27:36.387026 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e0d94178-68cf-4016-b4a6-375292392df4 tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] Calling method '.version_select at 0x7f8a9b5b3160>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:36.611512 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e0d94178-68cf-4016-b4a6-375292392df4 tempest-LiveMigrationTest-959108841 tempest-LiveMigrationTest-959108841-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2057394471" status: 202 len: 0 microversion: 2.1 time: 0.232124 Oct 12 13:27:36.615242 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 645/1349] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 12 13:27:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2057394471 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:27:36.626102 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6cd51e2b-a272-42aa-bd36-5f7350940150 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:36.628187 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6cd51e2b-a272-42aa-bd36-5f7350940150 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:36.654565 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6cd51e2b-a272-42aa-bd36-5f7350940150 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:36.657127 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6cd51e2b-a272-42aa-bd36-5f7350940150 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:36.658558 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6cd51e2b-a272-42aa-bd36-5f7350940150 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:36.664528 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6cd51e2b-a272-42aa-bd36-5f7350940150 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:36.665382 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6cd51e2b-a272-42aa-bd36-5f7350940150 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:36.666442 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6cd51e2b-a272-42aa-bd36-5f7350940150 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:37.487825 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f4f13f23-f076-4665-9ffa-f90df534f389 tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/3d9047c2-fed1-4fad-a44e-05755e3e30c0" status: 202 len: 0 microversion: 2.1 time: 2.981130 Oct 12 13:27:37.488972 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 705/1350] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 12 13:27:34 2022] DELETE /compute/v2.1/os-floating-ips/3d9047c2-fed1-4fad-a44e-05755e3e30c0 => generated 0 bytes in 2983 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:27:37.495599 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ed175ea1-e5c2-4cb9-84fb-af972c925425 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Action: 'create', calling method: .version_select at 0x7f8a9bd38ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1482385449", "description": "tempest-description-341923673"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:37.503617 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-6cd51e2b-a272-42aa-bd36-5f7350940150 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:37.513019 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6cd51e2b-a272-42aa-bd36-5f7350940150 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1471 microversion: 2.1 time: 0.896773 Oct 12 13:27:37.523024 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 646/1351] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:36 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1471 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:37.532888 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-634cefa5-ff45-4942-9cdf-8e8614299fb6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:37.647144 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-634cefa5-ff45-4942-9cdf-8e8614299fb6 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/b7df70df-24c1-41ad-9d28-be4f73ece55a" status: 204 len: 0 microversion: 2.1 time: 0.122735 Oct 12 13:27:37.647736 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 647/1352] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 12 13:27:37 2022] DELETE /compute/v2.1/os-server-groups/b7df70df-24c1-41ad-9d28-be4f73ece55a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:27:37.652707 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-795b2439-1e9f-43bb-a01a-6e95c3e4d668 tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] Calling method '.version_select at 0x7f8a9b638d30>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:37.844532 n-d-861076-2 devstack@n-api.service[120932]: DEBUG neutronclient.v2_0.client [None req-795b2439-1e9f-43bb-a01a-6e95c3e4d668 tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3d9047c2-fed1-4fad-a44e-05755e3e30c0 could not be found", "detail": ""}} {{(pid=120932) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 13:27:37.845334 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-795b2439-1e9f-43bb-a01a-6e95c3e4d668 tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] HTTP exception thrown: Floating IP not found for ID 3d9047c2-fed1-4fad-a44e-05755e3e30c0 Oct 12 13:27:37.855217 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-795b2439-1e9f-43bb-a01a-6e95c3e4d668 tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] Request method failure captured: Oct 12 13:27:37.855217 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/os-floating-ips/3d9047c2-fed1-4fad-a44e-05755e3e30c0 HTTP/1.1 Oct 12 13:27:37.855217 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:27:37.855217 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:27:37.855217 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:27:37.855217 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:27:37.855217 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:27:37.855217 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:27:37.855217 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:27:37.855217 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:37.855217 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsCxcZoqoBw7WHAO4Mx_CNDdWvCIDxZTOqFeMT6DPWET5p5Lxdbx-rfOBDW4bqjfvCuf2Hly8_Bec1BbrLIRyOEv-P1rmK3-UIeQAUkOfSxXMewMzLNgiVXictgLsrSTDk6CrZfZvTERiNfdQuwA-OedGU7C0rrCZNwg0_JlO1CJ3n8 Oct 12 13:27:37.855217 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:27:37.855217 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:27:37.855217 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:27:37.855217 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:27:37.855217 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:27:37.855217 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:27:37.855217 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 43ae53ece6bc47e78b00ee4dcc3c5b97 Oct 12 13:27:37.855217 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-FloatingIPsTestJSON-599370525 Oct 12 13:27:37.855217 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:27:37.855217 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:27:37.859699 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/43ae53ece6bc47e78b00ee4dcc3c5b97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_43ae53ece6bc47e78b00ee4dcc3c5b97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/43ae53ece6bc47e78b00ee4dcc3c5b97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/43ae53ece6bc47e78b00ee4dcc3c5b97"}]}] Oct 12 13:27:37.859699 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-FloatingIPsTestJSON-599370525 Oct 12 13:27:37.859699 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 43ae53ece6bc47e78b00ee4dcc3c5b97 Oct 12 13:27:37.859699 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-FloatingIPsTestJSON-599370525 Oct 12 13:27:37.859699 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-FloatingIPsTestJSON-599370525-project Oct 12 13:27:37.859699 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:27:37.859699 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:27:37.859699 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 5e228f00eeef43bda17fdbb162cf4981 Oct 12 13:27:37.859699 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-FloatingIPsTestJSON-599370525-project Oct 12 13:27:37.859699 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:27:37.859699 n-d-861076-2 devstack@n-api.service[120932]: exception: Floating IP not found for ID 3d9047c2-fed1-4fad-a44e-05755e3e30c0 Oct 12 13:27:37.859699 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '3d9047c2-fed1-4fad-a44e-05755e3e30c0'} Oct 12 13:27:37.859699 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:37.860939 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:37.860939 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 12 13:27:37.860939 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 12 13:27:37.860939 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:37.860939 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:37.860939 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 12 13:27:37.860939 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 12 13:27:37.860939 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:37.860939 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:37.860939 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:27:37.860939 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:27:37.860939 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:37.860939 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:37.860939 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:27:37.860939 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:27:37.860939 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:37.860939 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:37.860939 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 13:27:37.860939 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 13:27:37.862686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:37.862686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:37.862686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 13:27:37.862686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 13:27:37.862686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 13:27:37.862686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 13:27:37.862686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3d9047c2-fed1-4fad-a44e-05755e3e30c0 could not be found Oct 12 13:27:37.862686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b08e0053-43e5-439a-b735-1776b3167de1'] Oct 12 13:27:37.862686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:37.862686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:37.862686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:37.862686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:37.862686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 12 13:27:37.862686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 12 13:27:37.862686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 12 13:27:37.862686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 12 13:27:37.862686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3d9047c2-fed1-4fad-a44e-05755e3e30c0. Oct 12 13:27:37.862686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:37.862686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:37.862686 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:37.864216 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:37.864216 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:37.864216 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:37.864216 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:37.864216 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:37.864216 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:27:37.864216 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:27:37.864216 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:37.864216 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:37.864216 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 12 13:27:37.864216 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 13:27:37.864216 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3d9047c2-fed1-4fad-a44e-05755e3e30c0 Oct 12 13:27:37.864216 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:37.864216 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:37.864216 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:37.864216 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:37.864216 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:37.864216 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:37.864216 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:37.864216 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:37.865626 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3d9047c2-fed1-4fad-a44e-05755e3e30c0 Oct 12 13:27:37.865626 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:37.865626 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-795b2439-1e9f-43bb-a01a-6e95c3e4d668 tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] Returning 404 to user: Floating IP not found for ID 3d9047c2-fed1-4fad-a44e-05755e3e30c0 {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:37.865626 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-795b2439-1e9f-43bb-a01a-6e95c3e4d668 tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/3d9047c2-fed1-4fad-a44e-05755e3e30c0" status: 404 len: 111 microversion: 2.1 time: 0.207939 Oct 12 13:27:37.865626 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 648/1353] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 12 13:27:37 2022] GET /compute/v2.1/os-floating-ips/3d9047c2-fed1-4fad-a44e-05755e3e30c0 => generated 111 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:27:37.866824 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-604c6e13-3aae-49a2-8043-fb063f13231a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:37.868581 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-604c6e13-3aae-49a2-8043-fb063f13231a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:37.886392 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-604c6e13-3aae-49a2-8043-fb063f13231a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:37.887004 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-604c6e13-3aae-49a2-8043-fb063f13231a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:37.888252 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-604c6e13-3aae-49a2-8043-fb063f13231a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:37.889150 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-604c6e13-3aae-49a2-8043-fb063f13231a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:37.890080 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-604c6e13-3aae-49a2-8043-fb063f13231a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:37.890613 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-604c6e13-3aae-49a2-8043-fb063f13231a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:37.954541 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-604c6e13-3aae-49a2-8043-fb063f13231a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:27:38.342885 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:27:38.455940 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-604c6e13-3aae-49a2-8043-fb063f13231a tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 204 len: 0 microversion: 2.1 time: 0.592127 Oct 12 13:27:38.456544 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 649/1354] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:27:37 2022] DELETE /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:27:38.462542 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-df011f39-7138-4a93-8a3f-aa30bcd3af95 tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] Calling method '.version_select at 0x7f8a9b6350d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:38.544196 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ed175ea1-e5c2-4cb9-84fb-af972c925425 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.053919 Oct 12 13:27:38.553329 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 706/1355] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:27:37 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:38.557171 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4eb4e4c1-a5e0-49a5-9113-78a5441ffe13 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:38.557923 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-4eb4e4c1-a5e0-49a5-9113-78a5441ffe13 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:38.570742 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4eb4e4c1-a5e0-49a5-9113-78a5441ffe13 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:38.571270 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4eb4e4c1-a5e0-49a5-9113-78a5441ffe13 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:38.571729 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4eb4e4c1-a5e0-49a5-9113-78a5441ffe13 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:38.572944 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4eb4e4c1-a5e0-49a5-9113-78a5441ffe13 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:38.573746 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4eb4e4c1-a5e0-49a5-9113-78a5441ffe13 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:38.574257 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4eb4e4c1-a5e0-49a5-9113-78a5441ffe13 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:38.660307 n-d-861076-2 devstack@n-api.service[120932]: DEBUG neutronclient.v2_0.client [None req-df011f39-7138-4a93-8a3f-aa30bcd3af95 tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3d9047c2-fed1-4fad-a44e-05755e3e30c0 could not be found", "detail": ""}} {{(pid=120932) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 13:27:38.661682 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-df011f39-7138-4a93-8a3f-aa30bcd3af95 tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] HTTP exception thrown: Floating IP not found for ID 3d9047c2-fed1-4fad-a44e-05755e3e30c0 Oct 12 13:27:38.665069 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-df011f39-7138-4a93-8a3f-aa30bcd3af95 tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] Request method failure captured: Oct 12 13:27:38.665069 n-d-861076-2 devstack@n-api.service[120932]: request: DELETE /compute/v2.1/os-floating-ips/3d9047c2-fed1-4fad-a44e-05755e3e30c0 HTTP/1.1 Oct 12 13:27:38.665069 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:27:38.665069 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:27:38.665069 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:27:38.665069 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:27:38.665069 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:27:38.665069 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:27:38.665069 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:27:38.665069 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:38.665069 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsCxcZoqoBw7WHAO4Mx_CNDdWvCIDxZTOqFeMT6DPWET5p5Lxdbx-rfOBDW4bqjfvCuf2Hly8_Bec1BbrLIRyOEv-P1rmK3-UIeQAUkOfSxXMewMzLNgiVXictgLsrSTDk6CrZfZvTERiNfdQuwA-OedGU7C0rrCZNwg0_JlO1CJ3n8 Oct 12 13:27:38.665069 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:27:38.665069 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:27:38.665069 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:27:38.665069 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:27:38.665069 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:27:38.665069 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:27:38.665069 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 43ae53ece6bc47e78b00ee4dcc3c5b97 Oct 12 13:27:38.665069 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-FloatingIPsTestJSON-599370525 Oct 12 13:27:38.665069 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:27:38.665069 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:27:38.666871 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/43ae53ece6bc47e78b00ee4dcc3c5b97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_43ae53ece6bc47e78b00ee4dcc3c5b97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/43ae53ece6bc47e78b00ee4dcc3c5b97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/43ae53ece6bc47e78b00ee4dcc3c5b97"}]}] Oct 12 13:27:38.666871 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-FloatingIPsTestJSON-599370525 Oct 12 13:27:38.666871 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 43ae53ece6bc47e78b00ee4dcc3c5b97 Oct 12 13:27:38.666871 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-FloatingIPsTestJSON-599370525 Oct 12 13:27:38.666871 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-FloatingIPsTestJSON-599370525-project Oct 12 13:27:38.666871 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:27:38.666871 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:27:38.666871 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 5e228f00eeef43bda17fdbb162cf4981 Oct 12 13:27:38.666871 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-FloatingIPsTestJSON-599370525-project Oct 12 13:27:38.666871 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:27:38.666871 n-d-861076-2 devstack@n-api.service[120932]: exception: Floating IP not found for ID 3d9047c2-fed1-4fad-a44e-05755e3e30c0 Oct 12 13:27:38.666871 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '3d9047c2-fed1-4fad-a44e-05755e3e30c0'} Oct 12 13:27:38.666871 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:38.667926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:38.667926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 12 13:27:38.667926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 12 13:27:38.667926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:38.667926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:38.667926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 12 13:27:38.667926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 12 13:27:38.667926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:38.667926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:38.667926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:27:38.667926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:27:38.667926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:38.667926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:38.667926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:27:38.667926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:27:38.667926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:38.667926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:38.667926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 13:27:38.667926 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 13:27:38.677199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:38.677199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:38.677199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 13:27:38.677199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 13:27:38.677199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 13:27:38.677199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 13:27:38.677199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3d9047c2-fed1-4fad-a44e-05755e3e30c0 could not be found Oct 12 13:27:38.677199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-55e18535-ec61-4785-a6d3-72c50642d670'] Oct 12 13:27:38.677199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:38.677199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:38.677199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:38.677199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:38.677199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 12 13:27:38.677199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 12 13:27:38.677199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 12 13:27:38.677199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 12 13:27:38.677199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3d9047c2-fed1-4fad-a44e-05755e3e30c0. Oct 12 13:27:38.677199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:38.677199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:38.677199 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:38.678811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:38.678811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:38.678811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:38.678811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:38.678811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:38.678811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:27:38.678811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:27:38.678811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:38.678811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:38.678811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 12 13:27:38.678811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 13:27:38.678811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3d9047c2-fed1-4fad-a44e-05755e3e30c0 Oct 12 13:27:38.678811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:38.678811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:38.678811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:38.678811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:38.678811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:38.678811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:38.678811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:38.678811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:38.680394 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3d9047c2-fed1-4fad-a44e-05755e3e30c0 Oct 12 13:27:38.680394 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:38.680394 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-df011f39-7138-4a93-8a3f-aa30bcd3af95 tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] Returning 404 to user: Floating IP not found for ID 3d9047c2-fed1-4fad-a44e-05755e3e30c0 {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:38.680394 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-df011f39-7138-4a93-8a3f-aa30bcd3af95 tempest-FloatingIPsTestJSON-599370525 tempest-FloatingIPsTestJSON-599370525-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/3d9047c2-fed1-4fad-a44e-05755e3e30c0" status: 404 len: 111 microversion: 2.1 time: 0.212889 Oct 12 13:27:38.680394 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 650/1356] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 12 13:27:38 2022] DELETE /compute/v2.1/os-floating-ips/3d9047c2-fed1-4fad-a44e-05755e3e30c0 => generated 111 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:27:38.691764 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4769f7d9-59c6-451e-a0b0-abed928b24cc tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:38.693688 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-4769f7d9-59c6-451e-a0b0-abed928b24cc tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:38.705906 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4769f7d9-59c6-451e-a0b0-abed928b24cc tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:38.706420 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4769f7d9-59c6-451e-a0b0-abed928b24cc tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:38.706929 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4769f7d9-59c6-451e-a0b0-abed928b24cc tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:38.707660 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4769f7d9-59c6-451e-a0b0-abed928b24cc tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:38.708128 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4769f7d9-59c6-451e-a0b0-abed928b24cc tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:38.708692 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4769f7d9-59c6-451e-a0b0-abed928b24cc tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:39.405386 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-4eb4e4c1-a5e0-49a5-9113-78a5441ffe13 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:39.421524 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4eb4e4c1-a5e0-49a5-9113-78a5441ffe13 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1472 microversion: 2.1 time: 0.874616 Oct 12 13:27:39.423332 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 707/1357] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:38 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1472 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:39.427392 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-4769f7d9-59c6-451e-a0b0-abed928b24cc tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:39.430056 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-493771cc-225f-411b-a3b3-88aa8509cf51 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Action: 'create', calling method: .version_select at 0x7f8a9bae1ca0>, body: {"security_group_rule": {"parent_group_id": "a37c9e03-b22d-4986-9f7c-fc60b25e3b23", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:39.441498 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4769f7d9-59c6-451e-a0b0-abed928b24cc tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1477 microversion: 2.1 time: 0.768891 Oct 12 13:27:39.442779 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 651/1358] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:38 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1477 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:40.217879 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b850d550-dbdf-4a31-99c7-809ac9478deb tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Action: 'create', calling method: .version_select at 0x7f8a9b5b3dc0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-956947529", "policies": ["affinity"]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:40.264464 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-b850d550-dbdf-4a31-99c7-809ac9478deb tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Getting quotas for project afa1043155484749898bcf5166a35c07. Resources: {'server_groups'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:27:40.280414 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-b850d550-dbdf-4a31-99c7-809ac9478deb tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Getting quotas for user fd65d424f3f849a6b5ba76424180cbe0 and project afa1043155484749898bcf5166a35c07. Resources: {'server_groups'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:27:40.447263 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-b850d550-dbdf-4a31-99c7-809ac9478deb tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Getting quotas for project afa1043155484749898bcf5166a35c07. Resources: {'server_groups'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:27:40.459296 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-b850d550-dbdf-4a31-99c7-809ac9478deb tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Getting quotas for user fd65d424f3f849a6b5ba76424180cbe0 and project afa1043155484749898bcf5166a35c07. Resources: {'server_groups'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:27:40.499911 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b850d550-dbdf-4a31-99c7-809ac9478deb tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.361393 Oct 12 13:27:40.501866 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 652/1359] 10.222.0.52 () {60 vars in 1174 bytes} [Wed Oct 12 13:27:40 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:40.507531 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a83b8e1d-080a-437f-83df-e94918462afd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:40.508580 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a83b8e1d-080a-437f-83df-e94918462afd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:40.517144 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a83b8e1d-080a-437f-83df-e94918462afd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:40.517989 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a83b8e1d-080a-437f-83df-e94918462afd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:40.518672 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a83b8e1d-080a-437f-83df-e94918462afd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:40.522253 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a83b8e1d-080a-437f-83df-e94918462afd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:40.522253 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a83b8e1d-080a-437f-83df-e94918462afd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:40.522253 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a83b8e1d-080a-437f-83df-e94918462afd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:41.307008 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-493771cc-225f-411b-a3b3-88aa8509cf51 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.880682 Oct 12 13:27:41.318337 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 708/1360] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 12 13:27:39 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:41.325383 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-db989f65-e028-4cbd-86e8-378eb46e6176 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:41.328575 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-db989f65-e028-4cbd-86e8-378eb46e6176 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:41.343298 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-db989f65-e028-4cbd-86e8-378eb46e6176 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:41.344610 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-db989f65-e028-4cbd-86e8-378eb46e6176 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:41.356569 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-db989f65-e028-4cbd-86e8-378eb46e6176 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:41.356569 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-db989f65-e028-4cbd-86e8-378eb46e6176 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:41.356569 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-db989f65-e028-4cbd-86e8-378eb46e6176 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:41.356833 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-db989f65-e028-4cbd-86e8-378eb46e6176 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:41.616281 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-a83b8e1d-080a-437f-83df-e94918462afd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:41.635506 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a83b8e1d-080a-437f-83df-e94918462afd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1472 microversion: 2.1 time: 1.132293 Oct 12 13:27:41.636300 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 653/1361] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:40 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1472 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:41.641294 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7dceb00a-2ef9-4be8-8af0-571565ca7e15 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Action: 'create', calling method: .version_select at 0x7f8a9b635820>, body: {"server_group": {"name": "tempest-server-group-364275307", "policies": ["affinity"]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:41.684032 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-7dceb00a-2ef9-4be8-8af0-571565ca7e15 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Getting quotas for project afa1043155484749898bcf5166a35c07. Resources: {'server_groups'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:27:41.700051 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-7dceb00a-2ef9-4be8-8af0-571565ca7e15 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Getting quotas for user fd65d424f3f849a6b5ba76424180cbe0 and project afa1043155484749898bcf5166a35c07. Resources: {'server_groups'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:27:41.862511 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-7dceb00a-2ef9-4be8-8af0-571565ca7e15 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Getting quotas for project afa1043155484749898bcf5166a35c07. Resources: {'server_groups'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:27:41.873710 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-7dceb00a-2ef9-4be8-8af0-571565ca7e15 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Getting quotas for user fd65d424f3f849a6b5ba76424180cbe0 and project afa1043155484749898bcf5166a35c07. Resources: {'server_groups'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:27:41.910710 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7dceb00a-2ef9-4be8-8af0-571565ca7e15 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.267588 Oct 12 13:27:41.911893 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 654/1362] 10.222.0.52 () {60 vars in 1173 bytes} [Wed Oct 12 13:27:41 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:41.922365 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e2ac1140-6b35-42ab-9095-bd93a97aa432 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Action: 'create', calling method: .version_select at 0x7f8a9b878a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1475337315", "description": "tempest-description-1701195504"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:42.398349 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-db989f65-e028-4cbd-86e8-378eb46e6176 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:42.424036 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-db989f65-e028-4cbd-86e8-378eb46e6176 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1477 microversion: 2.1 time: 1.104254 Oct 12 13:27:42.424860 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 709/1363] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:41 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1477 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:42.434140 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3697944c-487f-4243-bde4-d901c5530ecc tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Action: 'create', calling method: .version_select at 0x7f8a9bb23b80>, body: {"server_group": {"name": "tempest-server-group-364275307", "policies": ["affinity"]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:42.492988 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-3697944c-487f-4243-bde4-d901c5530ecc tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Getting quotas for project afa1043155484749898bcf5166a35c07. Resources: {'server_groups'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:27:42.506241 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-3697944c-487f-4243-bde4-d901c5530ecc tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Getting quotas for user fd65d424f3f849a6b5ba76424180cbe0 and project afa1043155484749898bcf5166a35c07. Resources: {'server_groups'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:27:42.677361 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-3697944c-487f-4243-bde4-d901c5530ecc tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Getting quotas for project afa1043155484749898bcf5166a35c07. Resources: {'server_groups'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:27:42.698608 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-3697944c-487f-4243-bde4-d901c5530ecc tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Getting quotas for user fd65d424f3f849a6b5ba76424180cbe0 and project afa1043155484749898bcf5166a35c07. Resources: {'server_groups'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:27:42.754660 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3697944c-487f-4243-bde4-d901c5530ecc tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.328149 Oct 12 13:27:42.765023 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 710/1364] 10.222.0.52 () {60 vars in 1173 bytes} [Wed Oct 12 13:27:42 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:42.772763 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d0fd5d01-672f-4a56-bc2d-cfed47f31cbd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:42.778503 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-d0fd5d01-672f-4a56-bc2d-cfed47f31cbd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:42.782274 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d0fd5d01-672f-4a56-bc2d-cfed47f31cbd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:42.783093 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d0fd5d01-672f-4a56-bc2d-cfed47f31cbd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:42.783930 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d0fd5d01-672f-4a56-bc2d-cfed47f31cbd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:42.788373 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d0fd5d01-672f-4a56-bc2d-cfed47f31cbd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:42.788924 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d0fd5d01-672f-4a56-bc2d-cfed47f31cbd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:42.789420 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d0fd5d01-672f-4a56-bc2d-cfed47f31cbd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:43.104568 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d0fd5d01-672f-4a56-bc2d-cfed47f31cbd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:43.120520 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d0fd5d01-672f-4a56-bc2d-cfed47f31cbd tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1430 microversion: 2.1 time: 0.353347 Oct 12 13:27:43.134340 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 711/1365] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:42 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1430 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:43.140248 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-33b88c03-4009-4968-a535-311bda2e5f43 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:43.157668 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:27:43.317629 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-33b88c03-4009-4968-a535-311bda2e5f43 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/0eb797be-c993-4ccb-9276-f32f590f9879" status: 204 len: 0 microversion: 2.1 time: 0.191649 Oct 12 13:27:43.319524 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 712/1366] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 12 13:27:43 2022] DELETE /compute/v2.1/os-server-groups/0eb797be-c993-4ccb-9276-f32f590f9879 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:27:43.328739 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-b21cd794-74b1-4a09-9034-082a756345cf req-4db6ecd1-28e9-4629-9620-d47611fa3669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9443e943-93c1-4a5f-aad4-da32545368fa", "name": "network-vif-deleted", "tag": "f9aac7ee-1cd4-40d6-ac7b-0a00f2c6da9b"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:43.341775 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e2ac1140-6b35-42ab-9095-bd93a97aa432 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.427870 Oct 12 13:27:43.342918 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 655/1367] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:27:41 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:43.349494 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a61b9e03-602c-4774-9621-f7a1a1d3f1e1 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:43.424691 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-b21cd794-74b1-4a09-9034-082a756345cf req-4db6ecd1-28e9-4629-9620-d47611fa3669 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:43.426748 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-b21cd794-74b1-4a09-9034-082a756345cf req-4db6ecd1-28e9-4629-9620-d47611fa3669 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:43.427697 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-b21cd794-74b1-4a09-9034-082a756345cf req-4db6ecd1-28e9-4629-9620-d47611fa3669 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:43.447248 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a61b9e03-602c-4774-9621-f7a1a1d3f1e1 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.099001 Oct 12 13:27:43.457302 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 656/1368] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:27:43 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:43.478054 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-b21cd794-74b1-4a09-9034-082a756345cf req-4db6ecd1-28e9-4629-9620-d47611fa3669 service nova] Creating event network-vif-deleted:f9aac7ee-1cd4-40d6-ac7b-0a00f2c6da9b for instance 9443e943-93c1-4a5f-aad4-da32545368fa on n-h1-861076-2 Oct 12 13:27:43.479985 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-aec714cd-b51c-4a56-9121-6f0c4e9f5510 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Action: 'create', calling method: .version_select at 0x7f8a9b808dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1475386915", "description": "tempest-description-655329513"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:43.505797 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-b21cd794-74b1-4a09-9034-082a756345cf req-4db6ecd1-28e9-4629-9620-d47611fa3669 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174539 Oct 12 13:27:43.505797 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 713/1369] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:43.514736 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7aba2a2b-5c70-41fb-ab24-50ac252fead0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:43.528162 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7aba2a2b-5c70-41fb-ab24-50ac252fead0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:43.555373 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7aba2a2b-5c70-41fb-ab24-50ac252fead0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:43.555887 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7aba2a2b-5c70-41fb-ab24-50ac252fead0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:43.561310 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7aba2a2b-5c70-41fb-ab24-50ac252fead0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:43.563342 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7aba2a2b-5c70-41fb-ab24-50ac252fead0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:43.563892 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7aba2a2b-5c70-41fb-ab24-50ac252fead0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:43.568814 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7aba2a2b-5c70-41fb-ab24-50ac252fead0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:44.339055 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-7aba2a2b-5c70-41fb-ab24-50ac252fead0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:44.348240 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-7aba2a2b-5c70-41fb-ab24-50ac252fead0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1477 microversion: 2.1 time: 0.844069 Oct 12 13:27:44.348838 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 714/1370] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:43 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1477 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:44.362739 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e3692f60-4481-45b7-a3a7-c3421d50a9c0 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:44.507435 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e3692f60-4481-45b7-a3a7-c3421d50a9c0 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/f73db27f-cb6a-4581-9f21-84224309e759" status: 204 len: 0 microversion: 2.1 time: 0.153231 Oct 12 13:27:44.513889 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 715/1371] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 12 13:27:44 2022] DELETE /compute/v2.1/os-server-groups/f73db27f-cb6a-4581-9f21-84224309e759 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:27:44.521857 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-03ab4ff1-a18b-475c-a302-3e15924f6434 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:44.523399 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-03ab4ff1-a18b-475c-a302-3e15924f6434 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:44.549491 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03ab4ff1-a18b-475c-a302-3e15924f6434 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:44.551952 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03ab4ff1-a18b-475c-a302-3e15924f6434 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:44.553567 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03ab4ff1-a18b-475c-a302-3e15924f6434 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:44.557767 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03ab4ff1-a18b-475c-a302-3e15924f6434 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:44.560256 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03ab4ff1-a18b-475c-a302-3e15924f6434 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:44.561298 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03ab4ff1-a18b-475c-a302-3e15924f6434 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:44.654268 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03ab4ff1-a18b-475c-a302-3e15924f6434 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:44.654865 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03ab4ff1-a18b-475c-a302-3e15924f6434 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:44.655515 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03ab4ff1-a18b-475c-a302-3e15924f6434 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:44.656157 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-03ab4ff1-a18b-475c-a302-3e15924f6434 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lazy-loading 'fault' on Instance uuid 9443e943-93c1-4a5f-aad4-da32545368fa {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:27:44.762136 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-03ab4ff1-a18b-475c-a302-3e15924f6434 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fd9458bb2842829a1e13ac93fade30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be50900be6b246aa9289de6ec5d366f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:44.775769 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-03ab4ff1-a18b-475c-a302-3e15924f6434 tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 200 len: 1306 microversion: 2.1 time: 0.260217 Oct 12 13:27:44.776382 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 716/1372] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:44 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 1306 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:44.793599 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a2612bd9-ac77-4b91-9ad9-d055e51239f0 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:44.842690 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a2612bd9-ac77-4b91-9ad9-d055e51239f0 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.065064 Oct 12 13:27:44.846354 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-aec714cd-b51c-4a56-9121-6f0c4e9f5510 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.387863 Oct 12 13:27:44.848078 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 657/1373] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:27:43 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:44.857582 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 717/1374] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:27:44 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:44.866021 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e257ca45-7411-4c14-973d-d9a425128f01 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Action: 'create', calling method: .version_select at 0x7f8a9bae1a60>, body: {"security_group_rule": {"parent_group_id": "69aa7067-6cc6-4b37-82f7-a35411a271e8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "b02e1795-52bc-40e5-be09-a1e3d400f0cd"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:44.964489 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-ced6f187-a627-4ad3-bce6-d115193f4546 req-68456928-b341-4d57-8ca5-1707ff85a63f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fbda837-cf92-4aa6-8551-96cd4a3f1b80", "name": "network-vif-plugged", "status": "completed", "tag": "cf85a1bd-8e0c-48d6-9580-9faf6388ba80"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:44.984359 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ced6f187-a627-4ad3-bce6-d115193f4546 req-68456928-b341-4d57-8ca5-1707ff85a63f service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:44.985199 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ced6f187-a627-4ad3-bce6-d115193f4546 req-68456928-b341-4d57-8ca5-1707ff85a63f service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:45.002908 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ced6f187-a627-4ad3-bce6-d115193f4546 req-68456928-b341-4d57-8ca5-1707ff85a63f service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:45.030107 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-ced6f187-a627-4ad3-bce6-d115193f4546 req-68456928-b341-4d57-8ca5-1707ff85a63f service nova] Creating event network-vif-plugged:cf85a1bd-8e0c-48d6-9580-9faf6388ba80 for instance 3fbda837-cf92-4aa6-8551-96cd4a3f1b80 on n-h1-861076-2 Oct 12 13:27:45.046973 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-ced6f187-a627-4ad3-bce6-d115193f4546 req-68456928-b341-4d57-8ca5-1707ff85a63f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196979 Oct 12 13:27:45.048017 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 658/1375] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:45.076783 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ddc1e515-754a-4389-b332-2ecf913357c1 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Action: 'create', calling method: .version_select at 0x7f8a9b635ee0>, body: {"server_group": {"name": "tempest-server-group-50957306", "policies": ["affinity"]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:45.145669 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-ddc1e515-754a-4389-b332-2ecf913357c1 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Getting quotas for project afa1043155484749898bcf5166a35c07. Resources: {'server_groups'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:27:45.190594 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-ddc1e515-754a-4389-b332-2ecf913357c1 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Getting quotas for user fd65d424f3f849a6b5ba76424180cbe0 and project afa1043155484749898bcf5166a35c07. Resources: {'server_groups'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:27:45.447856 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-ddc1e515-754a-4389-b332-2ecf913357c1 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Getting quotas for project afa1043155484749898bcf5166a35c07. Resources: {'server_groups'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:27:45.459249 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-ddc1e515-754a-4389-b332-2ecf913357c1 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Getting quotas for user fd65d424f3f849a6b5ba76424180cbe0 and project afa1043155484749898bcf5166a35c07. Resources: {'server_groups'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:27:45.479680 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ddc1e515-754a-4389-b332-2ecf913357c1 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.429555 Oct 12 13:27:45.495957 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 659/1376] 10.222.0.52 () {60 vars in 1173 bytes} [Wed Oct 12 13:27:45 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:45.505477 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f7b05422-1ec1-4e52-8937-42e77140e9a2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:45.508875 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f7b05422-1ec1-4e52-8937-42e77140e9a2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:45.521151 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f7b05422-1ec1-4e52-8937-42e77140e9a2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:45.521659 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f7b05422-1ec1-4e52-8937-42e77140e9a2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:45.522107 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f7b05422-1ec1-4e52-8937-42e77140e9a2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:45.522933 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f7b05422-1ec1-4e52-8937-42e77140e9a2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:45.527135 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f7b05422-1ec1-4e52-8937-42e77140e9a2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:45.529836 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f7b05422-1ec1-4e52-8937-42e77140e9a2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:46.655459 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f7b05422-1ec1-4e52-8937-42e77140e9a2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:46.680057 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f7b05422-1ec1-4e52-8937-42e77140e9a2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1477 microversion: 2.1 time: 1.182786 Oct 12 13:27:46.680675 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 660/1377] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:45 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1477 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:46.695328 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-01a3684c-2ea7-4f2b-9b2d-f13e464a9e03 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:46.729358 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:27:46.827269 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-01a3684c-2ea7-4f2b-9b2d-f13e464a9e03 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/496b7fe2-c92e-446a-9dec-88ea2e340dd4" status: 204 len: 0 microversion: 2.1 time: 0.141740 Oct 12 13:27:46.832108 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 661/1378] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 12 13:27:46 2022] DELETE /compute/v2.1/os-server-groups/496b7fe2-c92e-446a-9dec-88ea2e340dd4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:27:46.849364 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e03e2419-ebd6-40bc-a5cc-758508627b4f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:46.853159 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e03e2419-ebd6-40bc-a5cc-758508627b4f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] [instance: 9443e943-93c1-4a5f-aad4-da32545368fa] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:46.872121 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e03e2419-ebd6-40bc-a5cc-758508627b4f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:46.872121 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e03e2419-ebd6-40bc-a5cc-758508627b4f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:46.872121 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e03e2419-ebd6-40bc-a5cc-758508627b4f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:46.872121 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e03e2419-ebd6-40bc-a5cc-758508627b4f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:46.873356 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e03e2419-ebd6-40bc-a5cc-758508627b4f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:46.874050 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e03e2419-ebd6-40bc-a5cc-758508627b4f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:46.917346 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-e03e2419-ebd6-40bc-a5cc-758508627b4f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] HTTP exception thrown: Instance 9443e943-93c1-4a5f-aad4-da32545368fa could not be found. Oct 12 13:27:46.924157 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e03e2419-ebd6-40bc-a5cc-758508627b4f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Request method failure captured: Oct 12 13:27:46.924157 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa HTTP/1.1 Oct 12 13:27:46.924157 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:27:46.924157 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:27:46.924157 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:27:46.924157 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:27:46.924157 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:27:46.924157 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:27:46.924157 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:27:46.924157 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:46.924157 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRr_CCC7LiW_hy7m97LgwkFPF9p6huyY-CWLyQ6oZUHSaBS0K99iV_bpm0lEjAWwlhR5ZBm_SyiP0a6LEf1zwW7PqsfI2rGUmQ5fC8cBIWNpgn3dQQDgP9Y9DZPHDnybACv0UadoqhUY-B-6kowhluEo_e2Vq2P-MSnih4jhQxgwR_Q8 Oct 12 13:27:46.924157 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:27:46.924157 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:27:46.924157 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:27:46.924157 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:27:46.924157 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:27:46.924157 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:27:46.924157 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: be50900be6b246aa9289de6ec5d366f9 Oct 12 13:27:46.924157 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:27:46.924157 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:27:46.924157 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:27:46.925940 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be50900be6b246aa9289de6ec5d366f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be50900be6b246aa9289de6ec5d366f9"}]}] Oct 12 13:27:46.925940 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:27:46.925940 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: be50900be6b246aa9289de6ec5d366f9 Oct 12 13:27:46.925940 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1850216957 Oct 12 13:27:46.925940 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServersOnMultiNodesTest-1850216957-project Oct 12 13:27:46.925940 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:27:46.925940 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:27:46.925940 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: a0fd9458bb2842829a1e13ac93fade30 Oct 12 13:27:46.925940 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServersOnMultiNodesTest-1850216957-project Oct 12 13:27:46.925940 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:27:46.925940 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance 9443e943-93c1-4a5f-aad4-da32545368fa could not be found. Oct 12 13:27:46.925940 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '9443e943-93c1-4a5f-aad4-da32545368fa'} Oct 12 13:27:46.926857 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:46.926857 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:46.926857 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:27:46.926857 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:27:46.926857 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:27:46.926857 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:27:46.926857 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:27:46.926857 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:27:46.926857 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:27:46.926857 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:27:46.926857 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9443e943-93c1-4a5f-aad4-da32545368fa could not be found. Oct 12 13:27:46.926857 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:46.926857 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:46.926857 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:46.926857 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:46.926857 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:46.926857 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:46.926857 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:46.926857 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:46.926857 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:46.928345 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:46.928345 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:27:46.928345 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:27:46.928345 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:27:46.928345 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:27:46.928345 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:27:46.928345 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:27:46.928345 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9443e943-93c1-4a5f-aad4-da32545368fa could not be found. Oct 12 13:27:46.928345 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:46.928345 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:46.928345 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:46.928345 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:46.928345 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:46.928345 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:46.928345 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:46.928345 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:46.928345 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9443e943-93c1-4a5f-aad4-da32545368fa could not be found. Oct 12 13:27:46.928345 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:46.929710 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e03e2419-ebd6-40bc-a5cc-758508627b4f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] Returning 404 to user: Instance 9443e943-93c1-4a5f-aad4-da32545368fa could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:46.933787 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e03e2419-ebd6-40bc-a5cc-758508627b4f tempest-ServersOnMultiNodesTest-1850216957 tempest-ServersOnMultiNodesTest-1850216957-project] 10.222.0.52 "GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa" status: 404 len: 111 microversion: 2.1 time: 0.098993 Oct 12 13:27:46.938361 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 662/1379] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:46 2022] GET /compute/v2.1/servers/9443e943-93c1-4a5f-aad4-da32545368fa => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:27:46.945597 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b1f81a33-7dea-4177-93ab-09dbcf7a7146 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:46.967323 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e257ca45-7411-4c14-973d-d9a425128f01 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 2.107714 Oct 12 13:27:46.981222 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 718/1380] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 12 13:27:44 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 2111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:46.981390 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b1f81a33-7dea-4177-93ab-09dbcf7a7146 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.033941 Oct 12 13:27:46.981390 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 663/1381] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:27:46 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:46.989526 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e0cb2be5-39d7-40f0-ab1f-1301eab6742f tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Action: 'create', calling method: .version_select at 0x7f8a9bb23550>, body: {"server_group": {"name": "tempest-server-group-1076080045", "policies": ["anti-affinity"]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:46.989803 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-35b58200-0fa3-4e7a-8078-32ea0e201466 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Action: 'create', calling method: .version_select at 0x7f8a9b92de50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1171312751", "description": "tempest-description-1518177796"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:47.061140 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-e0cb2be5-39d7-40f0-ab1f-1301eab6742f tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Getting quotas for project afa1043155484749898bcf5166a35c07. Resources: {'server_groups'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:27:47.128217 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-e0cb2be5-39d7-40f0-ab1f-1301eab6742f tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Getting quotas for user fd65d424f3f849a6b5ba76424180cbe0 and project afa1043155484749898bcf5166a35c07. Resources: {'server_groups'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:27:47.334285 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-e0cb2be5-39d7-40f0-ab1f-1301eab6742f tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Getting quotas for project afa1043155484749898bcf5166a35c07. Resources: {'server_groups'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:27:47.348583 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-e0cb2be5-39d7-40f0-ab1f-1301eab6742f tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Getting quotas for user fd65d424f3f849a6b5ba76424180cbe0 and project afa1043155484749898bcf5166a35c07. Resources: {'server_groups'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:27:47.395175 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e0cb2be5-39d7-40f0-ab1f-1301eab6742f tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.401642 Oct 12 13:27:47.395175 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 719/1382] 10.222.0.52 () {60 vars in 1173 bytes} [Wed Oct 12 13:27:46 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:47.400468 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-067a0b0d-beda-452b-98d6-e6c826c1f4c0 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:47.517871 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-067a0b0d-beda-452b-98d6-e6c826c1f4c0 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/0bfabb29-4303-4905-849b-51c421928337" status: 204 len: 0 microversion: 2.1 time: 0.121480 Oct 12 13:27:47.521405 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 720/1383] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 12 13:27:47 2022] DELETE /compute/v2.1/os-server-groups/0bfabb29-4303-4905-849b-51c421928337 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:27:47.528596 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b0d11873-c3d5-4d81-8878-34ec74a5ac00 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:47.544464 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b0d11873-c3d5-4d81-8878-34ec74a5ac00 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.020128 Oct 12 13:27:47.551201 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 721/1384] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:27:47 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:47.702766 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5b5be188-a718-4f4b-9b22-945a72f1a5c8 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:47.704020 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-5b5be188-a718-4f4b-9b22-945a72f1a5c8 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:47.717359 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5b5be188-a718-4f4b-9b22-945a72f1a5c8 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:47.721489 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5b5be188-a718-4f4b-9b22-945a72f1a5c8 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:47.722313 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5b5be188-a718-4f4b-9b22-945a72f1a5c8 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:47.728505 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5b5be188-a718-4f4b-9b22-945a72f1a5c8 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:47.729016 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5b5be188-a718-4f4b-9b22-945a72f1a5c8 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:47.729544 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5b5be188-a718-4f4b-9b22-945a72f1a5c8 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:48.145600 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-35b58200-0fa3-4e7a-8078-32ea0e201466 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.158657 Oct 12 13:27:48.146328 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 664/1385] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:27:46 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:48.152632 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3e05b889-c6fd-4778-8719-c7b769ff468b tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-430387422", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "2135124e-db59-4900-907e-0706594e0686"}]}, "os:scheduler_hints": {"group": "f138325f-2f7e-4f3d-bfdc-b8b30eeeb4f1"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:48.245598 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-5b5be188-a718-4f4b-9b22-945a72f1a5c8 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:48.257333 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5b5be188-a718-4f4b-9b22-945a72f1a5c8 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1463 microversion: 2.1 time: 0.559088 Oct 12 13:27:48.278784 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 722/1386] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:47 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1463 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:27:48.287356 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b2c536b7-693b-49b4-82b4-c609f6914aa7 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Action: 'create', calling method: .version_select at 0x7f8a9baf2040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-123219720", "description": "tempest-description-879022642"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:48.318152 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-3e05b889-c6fd-4778-8719-c7b769ff468b tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] validate_networks() for [('2135124e-db59-4900-907e-0706594e0686', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:27:49.220763 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-3e05b889-c6fd-4778-8719-c7b769ff468b tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-14ec1982-05f2-46a6-9f20-2bfec7533ead) Oct 12 13:27:49.220763 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:49.220763 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:49.220763 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:49.220763 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:49.220763 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:49.220763 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:49.220763 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:49.220763 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:49.220763 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:49.220763 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:27:49.220763 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:27:49.220763 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:27:49.220763 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:27:49.220763 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:27:49.220763 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:27:49.222817 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:27:49.222817 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:27:49.222817 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:27:49.222817 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:27:49.222817 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:27:49.222817 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:27:49.222817 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:27:49.222817 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:27:49.222817 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:27:49.222817 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:27:49.222817 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:27:49.222817 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:49.222817 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:49.222817 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:27:49.222817 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:27:49.222817 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:49.222817 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:49.222817 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:27:49.224340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:27:49.224340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:49.224340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:49.224340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:27:49.224340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:27:49.224340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:49.224340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:49.224340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:27:49.224340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:27:49.224340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:27:49.224340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:27:49.224340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:27:49.224340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:27:49.224340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:27:49.224340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:27:49.224340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:27:49.224340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:27:49.224340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:27:49.226070 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:27:49.226070 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:27:49.226070 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:27:49.226070 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:27:49.226070 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:27:49.226070 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:27:49.226070 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:27:49.226070 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:27:49.226070 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:27:49.226070 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:27:49.226070 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:27:49.226070 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:27:49.226070 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:27:49.226070 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:27:49.226070 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:27:49.227322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-14ec1982-05f2-46a6-9f20-2bfec7533ead) Oct 12 13:27:49.227322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:49.230906 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-3e05b889-c6fd-4778-8719-c7b769ff468b tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:27:49.230906 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:27:49.250114 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3e05b889-c6fd-4778-8719-c7b769ff468b tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Request method failure captured: Oct 12 13:27:49.250114 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:27:49.250114 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:27:49.250114 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:27:49.250114 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:27:49.250114 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 277 Oct 12 13:27:49.250114 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:27:49.250114 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:27:49.250114 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:27:49.250114 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:49.250114 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsDLBcMh3TFJY4i6Rw_8-KFF4BnyUsYmclVcDRm_HbwmeJLyujcq1DVSWhqIdZfFIPM6Dgt-qaS7G1ryxJZ4HBxUVZXG0_tiAZ9ys5kqgAVOC4AmixQPqP1a0PSlaAn1YcOzlyjFGBIwzEcM_DyGKGSIsT-CYQkJPRTt16niCnOooJk Oct 12 13:27:49.250114 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:27:49.250114 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:27:49.250114 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:27:49.250114 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:27:49.250114 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:27:49.250114 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:27:49.250114 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: afa1043155484749898bcf5166a35c07 Oct 12 13:27:49.250114 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServerGroupTestJSON-1595902739 Oct 12 13:27:49.250114 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:27:49.250114 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:27:49.252204 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/afa1043155484749898bcf5166a35c07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_afa1043155484749898bcf5166a35c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/afa1043155484749898bcf5166a35c07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/afa1043155484749898bcf5166a35c07"}]}] Oct 12 13:27:49.252204 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServerGroupTestJSON-1595902739 Oct 12 13:27:49.252204 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: afa1043155484749898bcf5166a35c07 Oct 12 13:27:49.252204 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServerGroupTestJSON-1595902739 Oct 12 13:27:49.252204 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServerGroupTestJSON-1595902739-project Oct 12 13:27:49.252204 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:27:49.252204 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:27:49.252204 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: fd65d424f3f849a6b5ba76424180cbe0 Oct 12 13:27:49.252204 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServerGroupTestJSON-1595902739-project Oct 12 13:27:49.252204 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:27:49.252204 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-ServerGroupTestJSON-server-430387422", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "2135124e-db59-4900-907e-0706594e0686"}]}, "os:scheduler_hints": {"group": "f138325f-2f7e-4f3d-bfdc-b8b30eeeb4f1"}} Oct 12 13:27:49.253226 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:27:49.253226 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:27:49.253226 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:27:49.253226 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-ServerGroupTestJSON-server-430387422', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '2135124e-db59-4900-907e-0706594e0686'}]}, 'os:scheduler_hints': {'group': 'f138325f-2f7e-4f3d-bfdc-b8b30eeeb4f1'}}} Oct 12 13:27:49.253226 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:49.253226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:49.253226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:49.253226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:49.253226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:49.253226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:49.253226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:49.253226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:49.253226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:49.253226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:49.253226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:27:49.253226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:27:49.253226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:27:49.253226 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:27:49.254755 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:27:49.254755 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:27:49.254755 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:27:49.254755 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:27:49.254755 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:27:49.254755 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:27:49.254755 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:27:49.254755 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:27:49.254755 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:27:49.254755 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:27:49.254755 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:27:49.254755 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:27:49.254755 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:27:49.254755 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:49.254755 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:49.254755 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:27:49.254755 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:27:49.254755 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:49.256155 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:49.256155 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:27:49.256155 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:27:49.256155 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:49.256155 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:49.256155 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:27:49.256155 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:27:49.256155 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:49.256155 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:49.256155 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:27:49.256155 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:27:49.256155 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:27:49.256155 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:27:49.256155 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:27:49.256155 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:27:49.256155 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:27:49.256155 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:27:49.256155 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:27:49.257727 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:27:49.257727 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:27:49.257727 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:27:49.257727 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:27:49.257727 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:27:49.257727 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:27:49.257727 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:27:49.257727 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:27:49.257727 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:27:49.257727 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:27:49.257727 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:27:49.257727 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:27:49.257727 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:27:49.257727 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:27:49.257727 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:27:49.257727 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:27:49.257727 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:27:49.259097 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-14ec1982-05f2-46a6-9f20-2bfec7533ead) Oct 12 13:27:49.259097 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:49.259097 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:49.259097 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:49.259097 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:49.259097 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:49.259097 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:49.259097 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:49.259097 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:49.259097 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:27:49.259097 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:27:49.259097 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:27:49.259097 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:49.259097 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:49.259097 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:49.259097 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:49.259097 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:49.259097 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:49.259097 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:49.260644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:49.260644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:49.260644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:27:49.260644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:49.260644 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:49.263311 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3e05b889-c6fd-4778-8719-c7b769ff468b tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:27:49.263311 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:49.267048 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3e05b889-c6fd-4778-8719-c7b769ff468b tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.117637 Oct 12 13:27:49.270347 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 665/1387] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:27:48 2022] POST /compute/v2.1/servers => generated 214 bytes in 1123 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:27:49.281683 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0aa74411-7d72-46bb-ac16-fdfc7f3774d1 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:49.303547 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0aa74411-7d72-46bb-ac16-fdfc7f3774d1 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:49.303547 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0aa74411-7d72-46bb-ac16-fdfc7f3774d1 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:49.303547 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0aa74411-7d72-46bb-ac16-fdfc7f3774d1 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:49.303547 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0aa74411-7d72-46bb-ac16-fdfc7f3774d1 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:49.304223 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0aa74411-7d72-46bb-ac16-fdfc7f3774d1 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:49.304223 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0aa74411-7d72-46bb-ac16-fdfc7f3774d1 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:49.304223 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0aa74411-7d72-46bb-ac16-fdfc7f3774d1 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:49.678235 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-0aa74411-7d72-46bb-ac16-fdfc7f3774d1 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:49.688008 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0aa74411-7d72-46bb-ac16-fdfc7f3774d1 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1463 microversion: 2.1 time: 0.415640 Oct 12 13:27:49.689517 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 666/1388] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:49 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1463 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:49.722718 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-faf92659-49bf-4879-96ba-00443082ced6 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:49.738986 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-faf92659-49bf-4879-96ba-00443082ced6 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.031915 Oct 12 13:27:49.740156 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 667/1389] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:27:49 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:49.745984 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8cf742fd-eb89-4783-9767-f03cb2fcf8fa tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:49.750994 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8cf742fd-eb89-4783-9767-f03cb2fcf8fa tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:49.790192 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8cf742fd-eb89-4783-9767-f03cb2fcf8fa tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:49.790737 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8cf742fd-eb89-4783-9767-f03cb2fcf8fa tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:49.794312 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8cf742fd-eb89-4783-9767-f03cb2fcf8fa tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:49.795109 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8cf742fd-eb89-4783-9767-f03cb2fcf8fa tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:49.795789 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8cf742fd-eb89-4783-9767-f03cb2fcf8fa tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:49.796410 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8cf742fd-eb89-4783-9767-f03cb2fcf8fa tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:49.844881 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:27:49.991131 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-8cf742fd-eb89-4783-9767-f03cb2fcf8fa tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:27:49.991859 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-8cf742fd-eb89-4783-9767-f03cb2fcf8fa tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:27:49.992345 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-8cf742fd-eb89-4783-9767-f03cb2fcf8fa tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:27:49.992816 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-8cf742fd-eb89-4783-9767-f03cb2fcf8fa tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:27:49.993360 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-8cf742fd-eb89-4783-9767-f03cb2fcf8fa tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:27:50.040631 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b2c536b7-693b-49b4-82b4-c609f6914aa7 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.758902 Oct 12 13:27:50.040631 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 723/1390] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:27:48 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:50.044322 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e8660b17-3431-4237-80fa-e8e883ac7d39 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:50.074776 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e8660b17-3431-4237-80fa-e8e883ac7d39 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/f138325f-2f7e-4f3d-bfdc-b8b30eeeb4f1" status: 200 len: 183 microversion: 2.1 time: 0.033633 Oct 12 13:27:50.076707 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 724/1391] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 12 13:27:50 2022] GET /compute/v2.1/os-server-groups/f138325f-2f7e-4f3d-bfdc-b8b30eeeb4f1 => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:50.093405 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c377e602-409f-4a91-853e-3f71520ea446 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Action: 'create', calling method: .version_select at 0x7f8a9bb23940>, body: {"security_group_rule": {"parent_group_id": "cc8e21ab-ae95-4243-8c7f-33c017d3bcfb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "8083a2c5-0635-4893-8ee4-cd4402c7bee3"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:50.322725 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8cf742fd-eb89-4783-9767-f03cb2fcf8fa tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:50.347987 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8cf742fd-eb89-4783-9767-f03cb2fcf8fa tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:50.348696 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8cf742fd-eb89-4783-9767-f03cb2fcf8fa tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:50.349383 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8cf742fd-eb89-4783-9767-f03cb2fcf8fa tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:50.350144 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8cf742fd-eb89-4783-9767-f03cb2fcf8fa tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:50.350732 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8cf742fd-eb89-4783-9767-f03cb2fcf8fa tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:50.352573 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8cf742fd-eb89-4783-9767-f03cb2fcf8fa tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:50.395593 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8cf742fd-eb89-4783-9767-f03cb2fcf8fa tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "POST /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80/action" status: 202 len: 1067 microversion: 2.1 time: 0.654176 Oct 12 13:27:50.397679 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 668/1392] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:27:49 2022] POST /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80/action => generated 1067 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 12 13:27:50.404253 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-459f4e37-c758-41b4-86d7-2d35ed0b459d tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:50.415826 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-459f4e37-c758-41b4-86d7-2d35ed0b459d tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] HTTP exception thrown: Instance group 0bfabb29-4303-4905-849b-51c421928337 could not be found. Oct 12 13:27:50.430526 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-459f4e37-c758-41b4-86d7-2d35ed0b459d tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Request method failure captured: Oct 12 13:27:50.430526 n-d-861076-2 devstack@n-api.service[120932]: request: DELETE /compute/v2.1/os-server-groups/0bfabb29-4303-4905-849b-51c421928337 HTTP/1.1 Oct 12 13:27:50.430526 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:27:50.430526 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:27:50.430526 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:27:50.430526 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:27:50.430526 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:27:50.430526 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:27:50.430526 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:27:50.430526 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:50.430526 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsDLBcMh3TFJY4i6Rw_8-KFF4BnyUsYmclVcDRm_HbwmeJLyujcq1DVSWhqIdZfFIPM6Dgt-qaS7G1ryxJZ4HBxUVZXG0_tiAZ9ys5kqgAVOC4AmixQPqP1a0PSlaAn1YcOzlyjFGBIwzEcM_DyGKGSIsT-CYQkJPRTt16niCnOooJk Oct 12 13:27:50.430526 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:27:50.430526 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:27:50.430526 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:27:50.430526 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:27:50.430526 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:27:50.430526 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:27:50.430526 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: afa1043155484749898bcf5166a35c07 Oct 12 13:27:50.430526 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServerGroupTestJSON-1595902739 Oct 12 13:27:50.430526 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:27:50.430526 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:27:50.432131 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/afa1043155484749898bcf5166a35c07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_afa1043155484749898bcf5166a35c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/afa1043155484749898bcf5166a35c07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/afa1043155484749898bcf5166a35c07"}]}] Oct 12 13:27:50.432131 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServerGroupTestJSON-1595902739 Oct 12 13:27:50.432131 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: afa1043155484749898bcf5166a35c07 Oct 12 13:27:50.432131 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServerGroupTestJSON-1595902739 Oct 12 13:27:50.432131 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServerGroupTestJSON-1595902739-project Oct 12 13:27:50.432131 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:27:50.432131 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:27:50.432131 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: fd65d424f3f849a6b5ba76424180cbe0 Oct 12 13:27:50.432131 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServerGroupTestJSON-1595902739-project Oct 12 13:27:50.432131 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:27:50.432131 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance group 0bfabb29-4303-4905-849b-51c421928337 could not be found. Oct 12 13:27:50.432131 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '0bfabb29-4303-4905-849b-51c421928337'} Oct 12 13:27:50.432987 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:50.432987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:50.432987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 12 13:27:50.432987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 12 13:27:50.432987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:27:50.432987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:27:50.432987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 12 13:27:50.432987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 12 13:27:50.432987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:27:50.432987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:27:50.432987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 12 13:27:50.432987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 12 13:27:50.432987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0bfabb29-4303-4905-849b-51c421928337 could not be found. Oct 12 13:27:50.432987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:50.432987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:50.432987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:50.432987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:50.432987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:50.432987 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:50.436437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:50.436437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:50.436437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:50.436437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:50.436437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 12 13:27:50.436437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:27:50.436437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0bfabb29-4303-4905-849b-51c421928337 could not be found. Oct 12 13:27:50.436437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:50.436437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:50.436437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:50.436437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:50.436437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:50.436437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:50.436437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:50.436437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:50.436437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0bfabb29-4303-4905-849b-51c421928337 could not be found. Oct 12 13:27:50.436437 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:50.468420 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-459f4e37-c758-41b4-86d7-2d35ed0b459d tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Returning 404 to user: Instance group 0bfabb29-4303-4905-849b-51c421928337 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:50.472429 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-459f4e37-c758-41b4-86d7-2d35ed0b459d tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/0bfabb29-4303-4905-849b-51c421928337" status: 404 len: 117 microversion: 2.1 time: 0.072906 Oct 12 13:27:50.473867 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 669/1393] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 12 13:27:50 2022] DELETE /compute/v2.1/os-server-groups/0bfabb29-4303-4905-849b-51c421928337 => generated 117 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:27:50.480049 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7fcef546-737f-4579-9e24-edd2c2114dca tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:50.481673 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7fcef546-737f-4579-9e24-edd2c2114dca tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:50.505217 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7fcef546-737f-4579-9e24-edd2c2114dca tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:50.506076 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7fcef546-737f-4579-9e24-edd2c2114dca tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:50.511456 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7fcef546-737f-4579-9e24-edd2c2114dca tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:50.514372 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7fcef546-737f-4579-9e24-edd2c2114dca tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:50.515347 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7fcef546-737f-4579-9e24-edd2c2114dca tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:50.516082 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7fcef546-737f-4579-9e24-edd2c2114dca tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:51.128509 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-7fcef546-737f-4579-9e24-edd2c2114dca tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:51.138555 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7fcef546-737f-4579-9e24-edd2c2114dca tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1472 microversion: 2.1 time: 0.663284 Oct 12 13:27:51.139986 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 670/1394] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:50 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1472 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:51.147018 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b380d38d-9f4e-4b53-998a-6f949349f81e tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:51.154289 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-b380d38d-9f4e-4b53-998a-6f949349f81e tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] HTTP exception thrown: Instance group 496b7fe2-c92e-446a-9dec-88ea2e340dd4 could not be found. Oct 12 13:27:51.161750 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b380d38d-9f4e-4b53-998a-6f949349f81e tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Request method failure captured: Oct 12 13:27:51.161750 n-d-861076-2 devstack@n-api.service[120932]: request: DELETE /compute/v2.1/os-server-groups/496b7fe2-c92e-446a-9dec-88ea2e340dd4 HTTP/1.1 Oct 12 13:27:51.161750 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:27:51.161750 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:27:51.161750 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:27:51.161750 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:27:51.161750 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:27:51.161750 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:27:51.161750 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:27:51.161750 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:51.161750 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsDLBcMh3TFJY4i6Rw_8-KFF4BnyUsYmclVcDRm_HbwmeJLyujcq1DVSWhqIdZfFIPM6Dgt-qaS7G1ryxJZ4HBxUVZXG0_tiAZ9ys5kqgAVOC4AmixQPqP1a0PSlaAn1YcOzlyjFGBIwzEcM_DyGKGSIsT-CYQkJPRTt16niCnOooJk Oct 12 13:27:51.161750 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:27:51.161750 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:27:51.161750 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:27:51.161750 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:27:51.161750 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:27:51.161750 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:27:51.161750 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: afa1043155484749898bcf5166a35c07 Oct 12 13:27:51.161750 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServerGroupTestJSON-1595902739 Oct 12 13:27:51.161750 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:27:51.161750 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:27:51.163229 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/afa1043155484749898bcf5166a35c07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_afa1043155484749898bcf5166a35c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/afa1043155484749898bcf5166a35c07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/afa1043155484749898bcf5166a35c07"}]}] Oct 12 13:27:51.163229 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServerGroupTestJSON-1595902739 Oct 12 13:27:51.163229 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: afa1043155484749898bcf5166a35c07 Oct 12 13:27:51.163229 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServerGroupTestJSON-1595902739 Oct 12 13:27:51.163229 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServerGroupTestJSON-1595902739-project Oct 12 13:27:51.163229 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:27:51.163229 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:27:51.163229 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: fd65d424f3f849a6b5ba76424180cbe0 Oct 12 13:27:51.163229 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServerGroupTestJSON-1595902739-project Oct 12 13:27:51.163229 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:27:51.163229 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance group 496b7fe2-c92e-446a-9dec-88ea2e340dd4 could not be found. Oct 12 13:27:51.163229 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '496b7fe2-c92e-446a-9dec-88ea2e340dd4'} Oct 12 13:27:51.164047 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:51.164047 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:51.164047 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 12 13:27:51.164047 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 12 13:27:51.164047 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:27:51.164047 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:27:51.164047 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 12 13:27:51.164047 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 12 13:27:51.164047 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:27:51.164047 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:27:51.164047 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 12 13:27:51.164047 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 12 13:27:51.164047 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 496b7fe2-c92e-446a-9dec-88ea2e340dd4 could not be found. Oct 12 13:27:51.164047 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:51.164047 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:51.164047 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:51.164047 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:51.164047 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:51.164047 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:51.167104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:51.167104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:51.167104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:51.167104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:51.167104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 12 13:27:51.167104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:27:51.167104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 496b7fe2-c92e-446a-9dec-88ea2e340dd4 could not be found. Oct 12 13:27:51.167104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:51.167104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:51.167104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:51.167104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:51.167104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:51.167104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:51.167104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:51.167104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:51.167104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 496b7fe2-c92e-446a-9dec-88ea2e340dd4 could not be found. Oct 12 13:27:51.167104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:51.169684 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c377e602-409f-4a91-853e-3f71520ea446 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.085276 Oct 12 13:27:51.169684 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 725/1395] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 12 13:27:50 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:51.173296 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b380d38d-9f4e-4b53-998a-6f949349f81e tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Returning 404 to user: Instance group 496b7fe2-c92e-446a-9dec-88ea2e340dd4 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:51.174573 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b380d38d-9f4e-4b53-998a-6f949349f81e tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/496b7fe2-c92e-446a-9dec-88ea2e340dd4" status: 404 len: 117 microversion: 2.1 time: 0.033029 Oct 12 13:27:51.175755 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 671/1396] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 12 13:27:51 2022] DELETE /compute/v2.1/os-server-groups/496b7fe2-c92e-446a-9dec-88ea2e340dd4 => generated 117 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:27:51.176437 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9b2c1103-9d41-4422-8a6c-c9eaf6d6e3bc tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Calling method '.version_select at 0x7f8a9ba99f70>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:51.188985 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5bbe0fb1-2155-45f1-b0b5-fae9eb6916fe tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:51.198832 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-5bbe0fb1-2155-45f1-b0b5-fae9eb6916fe tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] HTTP exception thrown: Instance group f73db27f-cb6a-4581-9f21-84224309e759 could not be found. Oct 12 13:27:51.201724 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5bbe0fb1-2155-45f1-b0b5-fae9eb6916fe tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Request method failure captured: Oct 12 13:27:51.201724 n-d-861076-2 devstack@n-api.service[120932]: request: DELETE /compute/v2.1/os-server-groups/f73db27f-cb6a-4581-9f21-84224309e759 HTTP/1.1 Oct 12 13:27:51.201724 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:27:51.201724 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:27:51.201724 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:27:51.201724 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:27:51.201724 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:27:51.201724 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:27:51.201724 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:27:51.201724 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:51.201724 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsDLBcMh3TFJY4i6Rw_8-KFF4BnyUsYmclVcDRm_HbwmeJLyujcq1DVSWhqIdZfFIPM6Dgt-qaS7G1ryxJZ4HBxUVZXG0_tiAZ9ys5kqgAVOC4AmixQPqP1a0PSlaAn1YcOzlyjFGBIwzEcM_DyGKGSIsT-CYQkJPRTt16niCnOooJk Oct 12 13:27:51.201724 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:27:51.201724 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:27:51.201724 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:27:51.201724 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:27:51.201724 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:27:51.201724 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:27:51.201724 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: afa1043155484749898bcf5166a35c07 Oct 12 13:27:51.201724 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServerGroupTestJSON-1595902739 Oct 12 13:27:51.201724 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:27:51.201724 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:27:51.203263 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/afa1043155484749898bcf5166a35c07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_afa1043155484749898bcf5166a35c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/afa1043155484749898bcf5166a35c07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/afa1043155484749898bcf5166a35c07"}]}] Oct 12 13:27:51.203263 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServerGroupTestJSON-1595902739 Oct 12 13:27:51.203263 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: afa1043155484749898bcf5166a35c07 Oct 12 13:27:51.203263 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServerGroupTestJSON-1595902739 Oct 12 13:27:51.203263 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServerGroupTestJSON-1595902739-project Oct 12 13:27:51.203263 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:27:51.203263 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:27:51.203263 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: fd65d424f3f849a6b5ba76424180cbe0 Oct 12 13:27:51.203263 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServerGroupTestJSON-1595902739-project Oct 12 13:27:51.203263 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:27:51.203263 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance group f73db27f-cb6a-4581-9f21-84224309e759 could not be found. Oct 12 13:27:51.203263 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'f73db27f-cb6a-4581-9f21-84224309e759'} Oct 12 13:27:51.204826 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:51.204826 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:51.204826 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 12 13:27:51.204826 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 12 13:27:51.204826 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:27:51.204826 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:27:51.204826 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 12 13:27:51.204826 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 12 13:27:51.204826 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:27:51.204826 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:27:51.204826 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 12 13:27:51.204826 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 12 13:27:51.204826 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f73db27f-cb6a-4581-9f21-84224309e759 could not be found. Oct 12 13:27:51.204826 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:51.204826 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:51.204826 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:51.204826 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:51.204826 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:51.204826 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:51.207408 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:51.207408 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:51.207408 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:51.207408 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:51.207408 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 12 13:27:51.207408 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:27:51.207408 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f73db27f-cb6a-4581-9f21-84224309e759 could not be found. Oct 12 13:27:51.207408 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:51.207408 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:51.207408 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:51.207408 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:51.207408 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:51.207408 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:51.207408 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:51.207408 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:51.207408 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f73db27f-cb6a-4581-9f21-84224309e759 could not be found. Oct 12 13:27:51.207408 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:51.218054 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5bbe0fb1-2155-45f1-b0b5-fae9eb6916fe tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Returning 404 to user: Instance group f73db27f-cb6a-4581-9f21-84224309e759 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:51.218947 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5bbe0fb1-2155-45f1-b0b5-fae9eb6916fe tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/f73db27f-cb6a-4581-9f21-84224309e759" status: 404 len: 117 microversion: 2.1 time: 0.039089 Oct 12 13:27:51.220337 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 672/1397] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 12 13:27:51 2022] DELETE /compute/v2.1/os-server-groups/f73db27f-cb6a-4581-9f21-84224309e759 => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 13:27:51.234027 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-494ea354-e60c-4500-b22a-a44e1a73e255 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:51.264160 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-494ea354-e60c-4500-b22a-a44e1a73e255 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] HTTP exception thrown: Instance group 0eb797be-c993-4ccb-9276-f32f590f9879 could not be found. Oct 12 13:27:51.266202 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-494ea354-e60c-4500-b22a-a44e1a73e255 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Request method failure captured: Oct 12 13:27:51.266202 n-d-861076-2 devstack@n-api.service[120932]: request: DELETE /compute/v2.1/os-server-groups/0eb797be-c993-4ccb-9276-f32f590f9879 HTTP/1.1 Oct 12 13:27:51.266202 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:27:51.266202 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:27:51.266202 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:27:51.266202 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:27:51.266202 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:27:51.266202 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:27:51.266202 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:27:51.266202 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:51.266202 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsDLBcMh3TFJY4i6Rw_8-KFF4BnyUsYmclVcDRm_HbwmeJLyujcq1DVSWhqIdZfFIPM6Dgt-qaS7G1ryxJZ4HBxUVZXG0_tiAZ9ys5kqgAVOC4AmixQPqP1a0PSlaAn1YcOzlyjFGBIwzEcM_DyGKGSIsT-CYQkJPRTt16niCnOooJk Oct 12 13:27:51.266202 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:27:51.266202 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:27:51.266202 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:27:51.266202 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:27:51.266202 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:27:51.266202 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:27:51.266202 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: afa1043155484749898bcf5166a35c07 Oct 12 13:27:51.266202 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServerGroupTestJSON-1595902739 Oct 12 13:27:51.266202 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:27:51.266202 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:27:51.267734 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/afa1043155484749898bcf5166a35c07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_afa1043155484749898bcf5166a35c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/afa1043155484749898bcf5166a35c07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/afa1043155484749898bcf5166a35c07"}]}] Oct 12 13:27:51.267734 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServerGroupTestJSON-1595902739 Oct 12 13:27:51.267734 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: afa1043155484749898bcf5166a35c07 Oct 12 13:27:51.267734 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServerGroupTestJSON-1595902739 Oct 12 13:27:51.267734 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServerGroupTestJSON-1595902739-project Oct 12 13:27:51.267734 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:27:51.267734 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:27:51.267734 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: fd65d424f3f849a6b5ba76424180cbe0 Oct 12 13:27:51.267734 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServerGroupTestJSON-1595902739-project Oct 12 13:27:51.267734 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:27:51.267734 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance group 0eb797be-c993-4ccb-9276-f32f590f9879 could not be found. Oct 12 13:27:51.267734 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '0eb797be-c993-4ccb-9276-f32f590f9879'} Oct 12 13:27:51.268601 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:51.268601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:51.268601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 12 13:27:51.268601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 12 13:27:51.268601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:27:51.268601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:27:51.268601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 12 13:27:51.268601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 12 13:27:51.268601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:27:51.268601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:27:51.268601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 12 13:27:51.268601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 12 13:27:51.268601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0eb797be-c993-4ccb-9276-f32f590f9879 could not be found. Oct 12 13:27:51.268601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:51.268601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:51.268601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:51.268601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:51.268601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:51.268601 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:51.269945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:51.269945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:51.269945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:51.269945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:51.269945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 12 13:27:51.269945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:27:51.269945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0eb797be-c993-4ccb-9276-f32f590f9879 could not be found. Oct 12 13:27:51.269945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:51.269945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:51.269945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:51.269945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:51.269945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:51.269945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:51.269945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:51.269945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:51.269945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0eb797be-c993-4ccb-9276-f32f590f9879 could not be found. Oct 12 13:27:51.269945 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:51.273188 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-494ea354-e60c-4500-b22a-a44e1a73e255 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Returning 404 to user: Instance group 0eb797be-c993-4ccb-9276-f32f590f9879 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:51.274391 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-494ea354-e60c-4500-b22a-a44e1a73e255 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/0eb797be-c993-4ccb-9276-f32f590f9879" status: 404 len: 117 microversion: 2.1 time: 0.048231 Oct 12 13:27:51.279928 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 673/1398] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 12 13:27:51 2022] DELETE /compute/v2.1/os-server-groups/0eb797be-c993-4ccb-9276-f32f590f9879 => generated 117 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:27:51.291163 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0d015198-ade0-40b2-b9ab-cc587b3a9721 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:51.440147 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0d015198-ade0-40b2-b9ab-cc587b3a9721 tempest-ServerGroupTestJSON-1595902739 tempest-ServerGroupTestJSON-1595902739-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/f138325f-2f7e-4f3d-bfdc-b8b30eeeb4f1" status: 204 len: 0 microversion: 2.1 time: 0.158630 Oct 12 13:27:51.445133 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 674/1399] 10.222.0.52 () {58 vars in 1266 bytes} [Wed Oct 12 13:27:51 2022] DELETE /compute/v2.1/os-server-groups/f138325f-2f7e-4f3d-bfdc-b8b30eeeb4f1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:27:52.009707 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9b2c1103-9d41-4422-8a6c-c9eaf6d6e3bc tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/8083a2c5-0635-4893-8ee4-cd4402c7bee3" status: 202 len: 0 microversion: 2.1 time: 0.837802 Oct 12 13:27:52.011065 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 726/1400] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:27:51 2022] DELETE /compute/v2.1/os-security-groups/8083a2c5-0635-4893-8ee4-cd4402c7bee3 => generated 0 bytes in 840 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:27:52.021409 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ccdabf70-bd14-4a6a-a097-44d0e64623c3 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Calling method '.version_select at 0x7f8a9b84cd30>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:52.168736 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e4644d21-b6c5-4ca0-bbeb-343ecd7ea473 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:52.169692 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-e4644d21-b6c5-4ca0-bbeb-343ecd7ea473 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:52.191638 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e4644d21-b6c5-4ca0-bbeb-343ecd7ea473 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:52.194216 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e4644d21-b6c5-4ca0-bbeb-343ecd7ea473 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:52.197012 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e4644d21-b6c5-4ca0-bbeb-343ecd7ea473 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:52.198815 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e4644d21-b6c5-4ca0-bbeb-343ecd7ea473 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:52.203257 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e4644d21-b6c5-4ca0-bbeb-343ecd7ea473 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:52.204385 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e4644d21-b6c5-4ca0-bbeb-343ecd7ea473 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:52.851866 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ccdabf70-bd14-4a6a-a097-44d0e64623c3 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/cc8e21ab-ae95-4243-8c7f-33c017d3bcfb" status: 200 len: 248 microversion: 2.1 time: 0.835975 Oct 12 13:27:52.855298 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 675/1401] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 12 13:27:52 2022] GET /compute/v2.1/os-security-groups/cc8e21ab-ae95-4243-8c7f-33c017d3bcfb => generated 248 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:52.871384 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4772c087-066c-4985-adb3-e8c76ed341b1 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Action: 'create', calling method: .version_select at 0x7f8a9b92d5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1690902688", "description": "tempest-description-976167066"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:53.329450 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e4644d21-b6c5-4ca0-bbeb-343ecd7ea473 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:53.342886 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e4644d21-b6c5-4ca0-bbeb-343ecd7ea473 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1472 microversion: 2.1 time: 1.179176 Oct 12 13:27:53.368876 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 727/1402] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:52 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1472 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:54.119141 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4772c087-066c-4985-adb3-e8c76ed341b1 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.252992 Oct 12 13:27:54.121244 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 676/1403] 10.222.0.52 () {60 vars in 1180 bytes} [Wed Oct 12 13:27:52 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:27:54.133803 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a174285b-70d4-4255-8fcd-6921b0b4d9da tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Action: 'create', calling method: .version_select at 0x7f8a9baf24c0>, body: {"security_group_rule": {"parent_group_id": "d87ac4dc-aa4c-4eff-94cc-e09047cc7c0d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:54.375490 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3b01a8e5-1242-4da2-901c-f0597d4c2cc9 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:54.376602 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3b01a8e5-1242-4da2-901c-f0597d4c2cc9 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:54.386307 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b01a8e5-1242-4da2-901c-f0597d4c2cc9 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:54.389488 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b01a8e5-1242-4da2-901c-f0597d4c2cc9 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:54.389488 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b01a8e5-1242-4da2-901c-f0597d4c2cc9 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:54.389488 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b01a8e5-1242-4da2-901c-f0597d4c2cc9 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:54.389488 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b01a8e5-1242-4da2-901c-f0597d4c2cc9 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:54.389880 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b01a8e5-1242-4da2-901c-f0597d4c2cc9 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:54.763891 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-3b01a8e5-1242-4da2-901c-f0597d4c2cc9 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:54.792079 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3b01a8e5-1242-4da2-901c-f0597d4c2cc9 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1472 microversion: 2.1 time: 0.420417 Oct 12 13:27:54.793960 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 677/1404] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:54 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1472 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:27:55.049611 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a174285b-70d4-4255-8fcd-6921b0b4d9da tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.920183 Oct 12 13:27:55.065719 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 728/1405] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 12 13:27:54 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:55.089534 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bba4f49a-7833-4182-bd72-925e705a1eab tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Action: 'create', calling method: .version_select at 0x7f8a9b918ee0>, body: {"security_group_rule": {"parent_group_id": "d87ac4dc-aa4c-4eff-94cc-e09047cc7c0d", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:55.470415 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=24 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:27:56.050771 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-707e916e-5bc7-4542-ab09-25a43b4192c4 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:56.058496 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-707e916e-5bc7-4542-ab09-25a43b4192c4 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:56.059597 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-707e916e-5bc7-4542-ab09-25a43b4192c4 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:56.060152 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-707e916e-5bc7-4542-ab09-25a43b4192c4 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:56.061961 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-707e916e-5bc7-4542-ab09-25a43b4192c4 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:56.062562 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-707e916e-5bc7-4542-ab09-25a43b4192c4 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:56.063148 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-707e916e-5bc7-4542-ab09-25a43b4192c4 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:56.165014 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-707e916e-5bc7-4542-ab09-25a43b4192c4 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.501126 Oct 12 13:27:56.173235 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 729/1406] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:27:55 2022] GET /compute/v2.1/os-services => generated 944 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:56.178426 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d48ae7d9-a5d9-4974-ab49-e9179d32cf4b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:56.179928 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-d48ae7d9-a5d9-4974-ab49-e9179d32cf4b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:56.189075 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d48ae7d9-a5d9-4974-ab49-e9179d32cf4b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:56.189893 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d48ae7d9-a5d9-4974-ab49-e9179d32cf4b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:56.190528 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d48ae7d9-a5d9-4974-ab49-e9179d32cf4b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:56.192048 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d48ae7d9-a5d9-4974-ab49-e9179d32cf4b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:56.193009 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d48ae7d9-a5d9-4974-ab49-e9179d32cf4b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:56.193638 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d48ae7d9-a5d9-4974-ab49-e9179d32cf4b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:56.562836 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d48ae7d9-a5d9-4974-ab49-e9179d32cf4b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:56.575672 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d48ae7d9-a5d9-4974-ab49-e9179d32cf4b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1472 microversion: 2.1 time: 0.401039 Oct 12 13:27:56.576268 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 730/1407] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:56 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1472 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:56.671207 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bba4f49a-7833-4182-bd72-925e705a1eab tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.608573 Oct 12 13:27:56.673345 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-eec6f57a-7b90-4abb-9c99-2fdd5e546a47 tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] Calling method '.version_select at 0x7f8a9ba99ee0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:56.677059 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 678/1408] 10.222.0.52 () {60 vars in 1195 bytes} [Wed Oct 12 13:27:55 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:56.685030 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-77d21ea5-97dd-45d3-a281-6d6a1ff5acd8 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:56.692763 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-77d21ea5-97dd-45d3-a281-6d6a1ff5acd8 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:56.694343 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-77d21ea5-97dd-45d3-a281-6d6a1ff5acd8 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:56.694798 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-77d21ea5-97dd-45d3-a281-6d6a1ff5acd8 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:56.695793 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-77d21ea5-97dd-45d3-a281-6d6a1ff5acd8 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:56.696467 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-77d21ea5-97dd-45d3-a281-6d6a1ff5acd8 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:56.697438 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-77d21ea5-97dd-45d3-a281-6d6a1ff5acd8 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:56.710603 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-eec6f57a-7b90-4abb-9c99-2fdd5e546a47 tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] HTTP exception thrown: Image not found. Oct 12 13:27:56.725145 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-77d21ea5-97dd-45d3-a281-6d6a1ff5acd8 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=n-d-861076-2" status: 200 len: 578 microversion: 2.1 time: 0.046577 Oct 12 13:27:56.725387 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-eec6f57a-7b90-4abb-9c99-2fdd5e546a47 tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] Request method failure captured: Oct 12 13:27:56.725387 n-d-861076-2 devstack@n-api.service[120933]: request: DELETE /compute/v2.1/images/ce9bb959-496e-474b-81db-5fe6ffb8db38/metadata/os_distro HTTP/1.1 Oct 12 13:27:56.725387 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:27:56.725387 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:27:56.725387 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:27:56.725387 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:27:56.725387 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:27:56.725387 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:27:56.725387 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:27:56.725387 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:56.725387 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsDbV2Og2gKCspw0ty_FI8GQQN5Z8HbvDlXXxnxxA0rfUFNBVtENHU4Y8TB2G-MbBzklOQ-BaLUX3DEoNP7O5w2JSiWhGt1mRlNTQdWuS-HRggLi0bF4vJyDvggi_0ltNLRzcgnI2WIUn00bujaAFYElYZABUUhFumK6Y-Av9duHi4k Oct 12 13:27:56.725387 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:27:56.725387 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:27:56.725387 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:27:56.725387 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:27:56.725387 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:27:56.725387 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:27:56.725387 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: d9e21ad698894f90b58274c052f8893e Oct 12 13:27:56.725387 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1512628255 Oct 12 13:27:56.725387 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:27:56.725387 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:27:56.726814 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d9e21ad698894f90b58274c052f8893e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d9e21ad698894f90b58274c052f8893e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9e21ad698894f90b58274c052f8893e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9e21ad698894f90b58274c052f8893e"}]}] Oct 12 13:27:56.726814 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1512628255 Oct 12 13:27:56.726814 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: d9e21ad698894f90b58274c052f8893e Oct 12 13:27:56.726814 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1512628255 Oct 12 13:27:56.726814 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ImagesMetadataNegativeTestJSON-1512628255-project Oct 12 13:27:56.726814 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:27:56.726814 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:27:56.726814 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 6807b635460649c98541820d20ff59da Oct 12 13:27:56.726814 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1512628255-project Oct 12 13:27:56.726814 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:27:56.726814 n-d-861076-2 devstack@n-api.service[120933]: exception: Image not found. Oct 12 13:27:56.726814 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'image_id': 'ce9bb959-496e-474b-81db-5fe6ffb8db38', 'id': 'os_distro'} Oct 12 13:27:56.726814 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:56.727772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:56.727772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 13:27:56.727772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 13:27:56.727772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 13:27:56.727772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 13:27:56.727772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 13:27:56.727772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 13:27:56.727772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 13:27:56.727772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 13:27:56.727772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 13:27:56.727772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 13:27:56.727772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 13:27:56.727772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 13:27:56.727772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 13:27:56.727772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 13:27:56.727772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 13:27:56.727772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 13:27:56.727772 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ce9bb959-496e-474b-81db-5fe6ffb8db38 Oct 12 13:27:56.729089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.729089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:56.729089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.729089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:56.729089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 13:27:56.729089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 13:27:56.729089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 13:27:56.729089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 13:27:56.729089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 13:27:56.729089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 13:27:56.729089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 13:27:56.729089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 13:27:56.729089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 13:27:56.729089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 13:27:56.729089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 13:27:56.729089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 13:27:56.729089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 13:27:56.729089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 13:27:56.729089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 13:27:56.729089 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 13:27:56.730421 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 13:27:56.730421 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 13:27:56.730421 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 13:27:56.730421 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 13:27:56.730421 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 13:27:56.730421 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 13:27:56.730421 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 13:27:56.730421 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 13:27:56.730421 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ce9bb959-496e-474b-81db-5fe6ffb8db38 could not be found. Oct 12 13:27:56.730421 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.730421 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:56.730421 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.730421 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:56.730421 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:56.730421 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:56.730421 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:56.730421 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:56.730421 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:27:56.730421 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:27:56.733983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:56.733983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:56.733983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 12 13:27:56.733983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 12 13:27:56.733983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 13:27:56.733983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 13:27:56.733983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 13:27:56.733983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.733983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:56.733983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.733983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:56.733983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:56.733983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:56.733983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:56.733983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:56.733983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 13:27:56.733983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.733983 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-eec6f57a-7b90-4abb-9c99-2fdd5e546a47 tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] Returning 404 to user: Image not found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:56.740163 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-eec6f57a-7b90-4abb-9c99-2fdd5e546a47 tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] 10.222.0.52 "DELETE /compute/v2.1/images/ce9bb959-496e-474b-81db-5fe6ffb8db38/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.149650 Oct 12 13:27:56.740163 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 731/1409] 10.222.0.52 () {58 vars in 1293 bytes} [Wed Oct 12 13:27:56 2022] DELETE /compute/v2.1/images/ce9bb959-496e-474b-81db-5fe6ffb8db38/metadata/os_distro => generated 62 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:27:56.740792 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 679/1410] 10.222.0.52 () {58 vars in 1172 bytes} [Wed Oct 12 13:27:56 2022] GET /compute/v2.1/os-services?host=n-d-861076-2 => generated 578 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:56.740990 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c35b1df6-abcc-41cd-8a5c-d917b2c781a4 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Calling method '.version_select at 0x7f8a9baf2ee0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:56.745093 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4a8e9eee-23a8-49b8-9305-66b040ba6202 tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] Calling method '.version_select at 0x7f8a9b92d0d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:56.772264 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-4a8e9eee-23a8-49b8-9305-66b040ba6202 tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] HTTP exception thrown: Image not found. Oct 12 13:27:56.774866 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4a8e9eee-23a8-49b8-9305-66b040ba6202 tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] Request method failure captured: Oct 12 13:27:56.774866 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/images/5cef8eab-a23e-4938-9ae9-5bc90c414453/metadata/os_version HTTP/1.1 Oct 12 13:27:56.774866 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:27:56.774866 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:27:56.774866 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:27:56.774866 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:27:56.774866 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:27:56.774866 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:27:56.774866 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:27:56.774866 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:56.774866 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsDbV2Og2gKCspw0ty_FI8GQQN5Z8HbvDlXXxnxxA0rfUFNBVtENHU4Y8TB2G-MbBzklOQ-BaLUX3DEoNP7O5w2JSiWhGt1mRlNTQdWuS-HRggLi0bF4vJyDvggi_0ltNLRzcgnI2WIUn00bujaAFYElYZABUUhFumK6Y-Av9duHi4k Oct 12 13:27:56.774866 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:27:56.774866 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:27:56.774866 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:27:56.774866 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:27:56.774866 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:27:56.774866 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:27:56.774866 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: d9e21ad698894f90b58274c052f8893e Oct 12 13:27:56.774866 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1512628255 Oct 12 13:27:56.774866 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:27:56.774866 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:27:56.776404 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d9e21ad698894f90b58274c052f8893e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d9e21ad698894f90b58274c052f8893e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9e21ad698894f90b58274c052f8893e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9e21ad698894f90b58274c052f8893e"}]}] Oct 12 13:27:56.776404 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1512628255 Oct 12 13:27:56.776404 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: d9e21ad698894f90b58274c052f8893e Oct 12 13:27:56.776404 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1512628255 Oct 12 13:27:56.776404 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ImagesMetadataNegativeTestJSON-1512628255-project Oct 12 13:27:56.776404 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:27:56.776404 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:27:56.776404 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 6807b635460649c98541820d20ff59da Oct 12 13:27:56.776404 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1512628255-project Oct 12 13:27:56.776404 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:27:56.776404 n-d-861076-2 devstack@n-api.service[120932]: exception: Image not found. Oct 12 13:27:56.776404 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'image_id': '5cef8eab-a23e-4938-9ae9-5bc90c414453', 'id': 'os_version'} Oct 12 13:27:56.776404 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:56.777427 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:56.777427 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 13:27:56.777427 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 13:27:56.777427 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 13:27:56.777427 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 13:27:56.777427 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 13:27:56.777427 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 13:27:56.777427 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 13:27:56.777427 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 13:27:56.777427 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 13:27:56.777427 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 13:27:56.777427 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 13:27:56.777427 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 13:27:56.777427 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 13:27:56.777427 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 13:27:56.777427 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 13:27:56.777427 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 13:27:56.777427 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5cef8eab-a23e-4938-9ae9-5bc90c414453 Oct 12 13:27:56.778932 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.778932 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:56.778932 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.778932 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:56.778932 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 13:27:56.778932 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 13:27:56.778932 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 13:27:56.778932 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 13:27:56.778932 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 13:27:56.778932 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 13:27:56.778932 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 13:27:56.778932 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 13:27:56.778932 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 13:27:56.778932 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 13:27:56.778932 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 13:27:56.778932 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 13:27:56.778932 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 13:27:56.778932 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 13:27:56.778932 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 13:27:56.778932 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 13:27:56.780793 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 13:27:56.780793 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 13:27:56.780793 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 13:27:56.780793 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 13:27:56.780793 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 13:27:56.780793 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 13:27:56.780793 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 13:27:56.780793 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 13:27:56.780793 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5cef8eab-a23e-4938-9ae9-5bc90c414453 could not be found. Oct 12 13:27:56.780793 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.780793 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:56.780793 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.780793 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:56.780793 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:56.780793 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:56.780793 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:56.780793 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:56.780793 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:27:56.780793 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:27:56.787229 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:56.787229 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:56.787229 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 12 13:27:56.787229 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 12 13:27:56.787229 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 13:27:56.787229 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 13:27:56.787229 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 13:27:56.787229 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.787229 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:56.787229 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.787229 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:56.787229 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:56.787229 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:56.787229 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:56.787229 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:56.787229 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 13:27:56.787229 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.787229 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4a8e9eee-23a8-49b8-9305-66b040ba6202 tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] Returning 404 to user: Image not found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:56.789098 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4a8e9eee-23a8-49b8-9305-66b040ba6202 tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] 10.222.0.52 "GET /compute/v2.1/images/5cef8eab-a23e-4938-9ae9-5bc90c414453/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.044257 Oct 12 13:27:56.789098 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 680/1411] 10.222.0.52 () {58 vars in 1293 bytes} [Wed Oct 12 13:27:56 2022] GET /compute/v2.1/images/5cef8eab-a23e-4938-9ae9-5bc90c414453/metadata/os_version => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:27:56.792985 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fc9d4514-09af-457b-8136-65637faebdda tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:56.797920 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc9d4514-09af-457b-8136-65637faebdda tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:56.799395 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc9d4514-09af-457b-8136-65637faebdda tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:56.800108 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc9d4514-09af-457b-8136-65637faebdda tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:56.801324 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc9d4514-09af-457b-8136-65637faebdda tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:56.802082 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc9d4514-09af-457b-8136-65637faebdda tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:56.802829 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc9d4514-09af-457b-8136-65637faebdda tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:56.833451 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fc9d4514-09af-457b-8136-65637faebdda tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.047700 Oct 12 13:27:56.834706 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 681/1412] 10.222.0.52 () {58 vars in 1176 bytes} [Wed Oct 12 13:27:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:56.839992 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-80a9bb16-c197-40a1-853f-2b90d54d39ea tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] Calling method '.version_select at 0x7f8a9b878a60>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:56.866672 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-80a9bb16-c197-40a1-853f-2b90d54d39ea tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] HTTP exception thrown: Image not found. Oct 12 13:27:56.869895 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-80a9bb16-c197-40a1-853f-2b90d54d39ea tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] Request method failure captured: Oct 12 13:27:56.869895 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/images/24315fa9-1b24-427e-9e71-814b95a59e8f/metadata HTTP/1.1 Oct 12 13:27:56.869895 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:27:56.869895 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:27:56.869895 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:27:56.869895 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:27:56.869895 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:27:56.869895 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:27:56.869895 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:27:56.869895 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:56.869895 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsDbV2Og2gKCspw0ty_FI8GQQN5Z8HbvDlXXxnxxA0rfUFNBVtENHU4Y8TB2G-MbBzklOQ-BaLUX3DEoNP7O5w2JSiWhGt1mRlNTQdWuS-HRggLi0bF4vJyDvggi_0ltNLRzcgnI2WIUn00bujaAFYElYZABUUhFumK6Y-Av9duHi4k Oct 12 13:27:56.869895 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:27:56.869895 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:27:56.869895 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:27:56.869895 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:27:56.869895 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:27:56.869895 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:27:56.869895 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: d9e21ad698894f90b58274c052f8893e Oct 12 13:27:56.869895 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1512628255 Oct 12 13:27:56.869895 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:27:56.869895 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:27:56.871808 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d9e21ad698894f90b58274c052f8893e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d9e21ad698894f90b58274c052f8893e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9e21ad698894f90b58274c052f8893e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9e21ad698894f90b58274c052f8893e"}]}] Oct 12 13:27:56.871808 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1512628255 Oct 12 13:27:56.871808 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: d9e21ad698894f90b58274c052f8893e Oct 12 13:27:56.871808 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1512628255 Oct 12 13:27:56.871808 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ImagesMetadataNegativeTestJSON-1512628255-project Oct 12 13:27:56.871808 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:27:56.871808 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:27:56.871808 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 6807b635460649c98541820d20ff59da Oct 12 13:27:56.871808 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1512628255-project Oct 12 13:27:56.871808 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:27:56.871808 n-d-861076-2 devstack@n-api.service[120932]: exception: Image not found. Oct 12 13:27:56.871808 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'image_id': '24315fa9-1b24-427e-9e71-814b95a59e8f'} Oct 12 13:27:56.871808 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:56.872706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:56.872706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 13:27:56.872706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 13:27:56.872706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 13:27:56.872706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 13:27:56.872706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 13:27:56.872706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 13:27:56.872706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 13:27:56.872706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 13:27:56.872706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 13:27:56.872706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 13:27:56.872706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 13:27:56.872706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 13:27:56.872706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 13:27:56.872706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 13:27:56.872706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 13:27:56.872706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 13:27:56.872706 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 24315fa9-1b24-427e-9e71-814b95a59e8f Oct 12 13:27:56.873955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.873955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:56.873955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.873955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:56.873955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 13:27:56.873955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 13:27:56.873955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 13:27:56.873955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 13:27:56.873955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 13:27:56.873955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 13:27:56.873955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 13:27:56.873955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 13:27:56.873955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 13:27:56.873955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 13:27:56.873955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 13:27:56.873955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 13:27:56.873955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 13:27:56.873955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 13:27:56.873955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 13:27:56.873955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 13:27:56.876033 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 13:27:56.876033 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 13:27:56.876033 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 13:27:56.876033 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 13:27:56.876033 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 13:27:56.876033 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 13:27:56.876033 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 13:27:56.876033 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 13:27:56.876033 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 24315fa9-1b24-427e-9e71-814b95a59e8f could not be found. Oct 12 13:27:56.876033 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.876033 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:56.876033 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.876033 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:56.876033 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:56.876033 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:56.876033 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:56.876033 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:56.876033 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:27:56.876033 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:27:56.886244 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:56.886244 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:56.886244 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 12 13:27:56.886244 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 12 13:27:56.886244 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 13:27:56.886244 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 13:27:56.886244 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 13:27:56.886244 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.886244 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:56.886244 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.886244 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:56.886244 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:56.886244 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:56.886244 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:56.886244 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:56.886244 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 13:27:56.886244 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.886244 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-80a9bb16-c197-40a1-853f-2b90d54d39ea tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] Returning 404 to user: Image not found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:56.887904 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-80a9bb16-c197-40a1-853f-2b90d54d39ea tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] 10.222.0.52 "GET /compute/v2.1/images/24315fa9-1b24-427e-9e71-814b95a59e8f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.044578 Oct 12 13:27:56.887904 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 682/1413] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 12 13:27:56 2022] GET /compute/v2.1/images/24315fa9-1b24-427e-9e71-814b95a59e8f/metadata => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:27:56.890771 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-257934e8-9e99-454f-94be-fb362041f199 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:56.896076 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-257934e8-9e99-454f-94be-fb362041f199 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:56.897273 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-257934e8-9e99-454f-94be-fb362041f199 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:56.898257 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-257934e8-9e99-454f-94be-fb362041f199 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:56.900181 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-257934e8-9e99-454f-94be-fb362041f199 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:56.901024 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-257934e8-9e99-454f-94be-fb362041f199 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:56.901876 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-257934e8-9e99-454f-94be-fb362041f199 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:56.934200 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-257934e8-9e99-454f-94be-fb362041f199 tempest-ServicesAdminTestJSON-1823686654 tempest-ServicesAdminTestJSON-1823686654-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.050507 Oct 12 13:27:56.935462 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 683/1414] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:27:56 2022] GET /compute/v2.1/os-services => generated 944 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:56.943471 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6d3f23f7-e331-4878-bcb6-2fd901e0768c tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] Action: 'update_all', calling method: .version_select at 0x7f8a9b84c550>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:56.975105 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-6d3f23f7-e331-4878-bcb6-2fd901e0768c tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] HTTP exception thrown: Image not found. Oct 12 13:27:56.977754 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6d3f23f7-e331-4878-bcb6-2fd901e0768c tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] Request method failure captured: Oct 12 13:27:56.977754 n-d-861076-2 devstack@n-api.service[120932]: request: PUT /compute/v2.1/images/b645d041-b4de-4655-a0b3-a2831a19f2b6/metadata HTTP/1.1 Oct 12 13:27:56.977754 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:27:56.977754 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:27:56.977754 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:27:56.977754 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 57 Oct 12 13:27:56.977754 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:27:56.977754 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:27:56.977754 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:27:56.977754 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:56.977754 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsDbV2Og2gKCspw0ty_FI8GQQN5Z8HbvDlXXxnxxA0rfUFNBVtENHU4Y8TB2G-MbBzklOQ-BaLUX3DEoNP7O5w2JSiWhGt1mRlNTQdWuS-HRggLi0bF4vJyDvggi_0ltNLRzcgnI2WIUn00bujaAFYElYZABUUhFumK6Y-Av9duHi4k Oct 12 13:27:56.977754 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:27:56.977754 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:27:56.977754 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:27:56.977754 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:27:56.977754 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:27:56.977754 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:27:56.977754 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: d9e21ad698894f90b58274c052f8893e Oct 12 13:27:56.977754 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1512628255 Oct 12 13:27:56.977754 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:27:56.977754 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:27:56.979863 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d9e21ad698894f90b58274c052f8893e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d9e21ad698894f90b58274c052f8893e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9e21ad698894f90b58274c052f8893e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9e21ad698894f90b58274c052f8893e"}]}] Oct 12 13:27:56.979863 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1512628255 Oct 12 13:27:56.979863 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: d9e21ad698894f90b58274c052f8893e Oct 12 13:27:56.979863 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1512628255 Oct 12 13:27:56.979863 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ImagesMetadataNegativeTestJSON-1512628255-project Oct 12 13:27:56.979863 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:27:56.979863 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:27:56.979863 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 6807b635460649c98541820d20ff59da Oct 12 13:27:56.979863 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1512628255-project Oct 12 13:27:56.979863 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:27:56.979863 n-d-861076-2 devstack@n-api.service[120932]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 12 13:27:56.979863 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:27:56.979863 n-d-861076-2 devstack@n-api.service[120932]: exception: Image not found. Oct 12 13:27:56.980811 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'image_id': 'b645d041-b4de-4655-a0b3-a2831a19f2b6', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 12 13:27:56.980811 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:56.980811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:56.980811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 13:27:56.980811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 13:27:56.980811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 13:27:56.980811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 13:27:56.980811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 13:27:56.980811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 13:27:56.980811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 13:27:56.980811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 13:27:56.980811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 13:27:56.980811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 13:27:56.980811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 13:27:56.980811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 13:27:56.980811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 13:27:56.980811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 13:27:56.980811 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 13:27:56.982361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 13:27:56.982361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b645d041-b4de-4655-a0b3-a2831a19f2b6 Oct 12 13:27:56.982361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.982361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:56.982361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.982361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:56.982361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 13:27:56.982361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 13:27:56.982361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 13:27:56.982361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 13:27:56.982361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 13:27:56.982361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 13:27:56.982361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 13:27:56.982361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 13:27:56.982361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 13:27:56.982361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 13:27:56.982361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 13:27:56.982361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 13:27:56.982361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 13:27:56.982361 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 13:27:56.985292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 13:27:56.985292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 13:27:56.985292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 13:27:56.985292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 13:27:56.985292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 13:27:56.985292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 13:27:56.985292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 13:27:56.985292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 13:27:56.985292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 13:27:56.985292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 13:27:56.985292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b645d041-b4de-4655-a0b3-a2831a19f2b6 could not be found. Oct 12 13:27:56.985292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.985292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:56.985292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.985292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:56.985292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:56.985292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:56.985292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:56.985292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:56.990836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:27:56.990836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:27:56.990836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:56.990836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:56.990836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:56.990836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:56.990836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 12 13:27:56.990836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 12 13:27:56.990836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 13:27:56.990836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 13:27:56.990836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 13:27:56.990836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.990836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:56.990836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.990836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:56.990836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:56.990836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:56.990836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:56.990836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:56.990836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 13:27:56.990836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:56.992593 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6d3f23f7-e331-4878-bcb6-2fd901e0768c tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] Returning 404 to user: Image not found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:56.992593 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6d3f23f7-e331-4878-bcb6-2fd901e0768c tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] 10.222.0.52 "PUT /compute/v2.1/images/b645d041-b4de-4655-a0b3-a2831a19f2b6/metadata" status: 404 len: 62 microversion: 2.1 time: 0.051470 Oct 12 13:27:56.992593 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 684/1415] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 12 13:27:56 2022] PUT /compute/v2.1/images/b645d041-b4de-4655-a0b3-a2831a19f2b6/metadata => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:27:56.998927 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f55b2619-b52d-4f32-bb50-764912133eed tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] Action: 'update', calling method: .version_select at 0x7f8a9b918af0>, body: {"meta": {"os_distro": "alt"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:57.029774 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-f55b2619-b52d-4f32-bb50-764912133eed tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] HTTP exception thrown: Image not found. Oct 12 13:27:57.029774 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f55b2619-b52d-4f32-bb50-764912133eed tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] Request method failure captured: Oct 12 13:27:57.029774 n-d-861076-2 devstack@n-api.service[120932]: request: PUT /compute/v2.1/images/bfdff148-63fb-45c4-aca4-0ab4e91fddd2/metadata/os_distro HTTP/1.1 Oct 12 13:27:57.029774 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:27:57.029774 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:27:57.029774 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:27:57.029774 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 30 Oct 12 13:27:57.029774 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:27:57.029774 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:27:57.029774 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:27:57.029774 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:57.029774 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsDbV2Og2gKCspw0ty_FI8GQQN5Z8HbvDlXXxnxxA0rfUFNBVtENHU4Y8TB2G-MbBzklOQ-BaLUX3DEoNP7O5w2JSiWhGt1mRlNTQdWuS-HRggLi0bF4vJyDvggi_0ltNLRzcgnI2WIUn00bujaAFYElYZABUUhFumK6Y-Av9duHi4k Oct 12 13:27:57.029774 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:27:57.029774 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:27:57.029774 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:27:57.029774 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:27:57.029774 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:27:57.029774 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:27:57.029774 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: d9e21ad698894f90b58274c052f8893e Oct 12 13:27:57.029774 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1512628255 Oct 12 13:27:57.029774 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:27:57.029774 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:27:57.032042 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d9e21ad698894f90b58274c052f8893e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d9e21ad698894f90b58274c052f8893e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9e21ad698894f90b58274c052f8893e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9e21ad698894f90b58274c052f8893e"}]}] Oct 12 13:27:57.032042 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1512628255 Oct 12 13:27:57.032042 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: d9e21ad698894f90b58274c052f8893e Oct 12 13:27:57.032042 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1512628255 Oct 12 13:27:57.032042 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ImagesMetadataNegativeTestJSON-1512628255-project Oct 12 13:27:57.032042 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:27:57.032042 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:27:57.032042 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 6807b635460649c98541820d20ff59da Oct 12 13:27:57.032042 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1512628255-project Oct 12 13:27:57.032042 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:27:57.032042 n-d-861076-2 devstack@n-api.service[120932]: {"meta": {"os_distro": "alt"}} Oct 12 13:27:57.032042 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:27:57.032042 n-d-861076-2 devstack@n-api.service[120932]: exception: Image not found. Oct 12 13:27:57.032042 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'image_id': 'bfdff148-63fb-45c4-aca4-0ab4e91fddd2', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 12 13:27:57.033753 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:57.033753 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:57.033753 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 13:27:57.033753 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 13:27:57.033753 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 13:27:57.033753 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 13:27:57.033753 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 13:27:57.033753 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 13:27:57.033753 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 13:27:57.033753 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 13:27:57.033753 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 13:27:57.033753 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 13:27:57.033753 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 13:27:57.033753 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 13:27:57.033753 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 13:27:57.033753 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 13:27:57.033753 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 13:27:57.033753 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 13:27:57.035958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bfdff148-63fb-45c4-aca4-0ab4e91fddd2 Oct 12 13:27:57.035958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:57.035958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:57.035958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:57.035958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:57.035958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 13:27:57.035958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 13:27:57.035958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 13:27:57.035958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 13:27:57.035958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 13:27:57.035958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 13:27:57.035958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 13:27:57.035958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 13:27:57.035958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 13:27:57.035958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 13:27:57.035958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 13:27:57.035958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 13:27:57.035958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 13:27:57.035958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 13:27:57.037998 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 13:27:57.037998 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 13:27:57.037998 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 13:27:57.037998 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 13:27:57.037998 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 13:27:57.037998 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 13:27:57.037998 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 13:27:57.037998 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 13:27:57.037998 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 13:27:57.037998 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 13:27:57.037998 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bfdff148-63fb-45c4-aca4-0ab4e91fddd2 could not be found. Oct 12 13:27:57.037998 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:57.037998 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:57.037998 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:57.037998 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:57.037998 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:57.037998 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:57.037998 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:57.037998 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:57.041847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:27:57.041847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:27:57.041847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:57.041847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:57.041847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:57.041847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:57.041847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 12 13:27:57.041847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 12 13:27:57.041847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 13:27:57.041847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 13:27:57.041847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 13:27:57.041847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:57.041847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:57.041847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:57.041847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:57.041847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:57.041847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:57.041847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:57.041847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:57.041847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 13:27:57.041847 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:57.044821 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f55b2619-b52d-4f32-bb50-764912133eed tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] Returning 404 to user: Image not found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:57.044821 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f55b2619-b52d-4f32-bb50-764912133eed tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] 10.222.0.52 "PUT /compute/v2.1/images/bfdff148-63fb-45c4-aca4-0ab4e91fddd2/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.044264 Oct 12 13:27:57.052252 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 685/1416] 10.222.0.52 () {60 vars in 1310 bytes} [Wed Oct 12 13:27:56 2022] PUT /compute/v2.1/images/bfdff148-63fb-45c4-aca4-0ab4e91fddd2/metadata/os_distro => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 12 13:27:57.066295 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a6014271-1140-4b50-b3cd-939dd9dd6ff8 tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] Action: 'create', calling method: .version_select at 0x7f8a9b84cc10>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:27:57.106098 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-a6014271-1140-4b50-b3cd-939dd9dd6ff8 tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] HTTP exception thrown: Image not found. Oct 12 13:27:57.108868 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a6014271-1140-4b50-b3cd-939dd9dd6ff8 tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] Request method failure captured: Oct 12 13:27:57.108868 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/images/0ebea294-f81b-4288-9a36-3adfb387119f/metadata HTTP/1.1 Oct 12 13:27:57.108868 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:27:57.108868 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:27:57.108868 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:27:57.108868 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 57 Oct 12 13:27:57.108868 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:27:57.108868 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:27:57.108868 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:27:57.108868 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:57.108868 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsDbV2Og2gKCspw0ty_FI8GQQN5Z8HbvDlXXxnxxA0rfUFNBVtENHU4Y8TB2G-MbBzklOQ-BaLUX3DEoNP7O5w2JSiWhGt1mRlNTQdWuS-HRggLi0bF4vJyDvggi_0ltNLRzcgnI2WIUn00bujaAFYElYZABUUhFumK6Y-Av9duHi4k Oct 12 13:27:57.108868 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:27:57.108868 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:27:57.108868 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:27:57.108868 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:27:57.108868 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:27:57.108868 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:27:57.108868 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: d9e21ad698894f90b58274c052f8893e Oct 12 13:27:57.108868 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1512628255 Oct 12 13:27:57.108868 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:27:57.108868 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:27:57.111039 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d9e21ad698894f90b58274c052f8893e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d9e21ad698894f90b58274c052f8893e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9e21ad698894f90b58274c052f8893e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9e21ad698894f90b58274c052f8893e"}]}] Oct 12 13:27:57.111039 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1512628255 Oct 12 13:27:57.111039 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: d9e21ad698894f90b58274c052f8893e Oct 12 13:27:57.111039 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1512628255 Oct 12 13:27:57.111039 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ImagesMetadataNegativeTestJSON-1512628255-project Oct 12 13:27:57.111039 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:27:57.111039 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:27:57.111039 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 6807b635460649c98541820d20ff59da Oct 12 13:27:57.111039 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1512628255-project Oct 12 13:27:57.111039 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:27:57.111039 n-d-861076-2 devstack@n-api.service[120932]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 12 13:27:57.111039 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:27:57.111039 n-d-861076-2 devstack@n-api.service[120932]: exception: Image not found. Oct 12 13:27:57.111039 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'image_id': '0ebea294-f81b-4288-9a36-3adfb387119f', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 12 13:27:57.112030 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:57.112030 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:57.112030 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 13:27:57.112030 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 13:27:57.112030 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 13:27:57.112030 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 13:27:57.112030 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 13:27:57.112030 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 13:27:57.112030 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 13:27:57.112030 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 13:27:57.112030 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 13:27:57.112030 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 13:27:57.112030 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 13:27:57.112030 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 13:27:57.112030 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 13:27:57.112030 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 13:27:57.112030 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 13:27:57.112030 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 13:27:57.113315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0ebea294-f81b-4288-9a36-3adfb387119f Oct 12 13:27:57.113315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:57.113315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:57.113315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:57.113315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:57.113315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 13:27:57.113315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 13:27:57.113315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 13:27:57.113315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 13:27:57.113315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 13:27:57.113315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 13:27:57.113315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 13:27:57.113315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 13:27:57.113315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 13:27:57.113315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 13:27:57.113315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 13:27:57.113315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 13:27:57.113315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 13:27:57.113315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 13:27:57.115469 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 13:27:57.115469 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 13:27:57.115469 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 13:27:57.115469 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 13:27:57.115469 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 13:27:57.115469 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 13:27:57.115469 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 13:27:57.115469 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 13:27:57.115469 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 13:27:57.115469 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 13:27:57.115469 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0ebea294-f81b-4288-9a36-3adfb387119f could not be found. Oct 12 13:27:57.115469 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:57.115469 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:57.115469 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:57.115469 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:57.115469 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:57.115469 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:57.115469 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:57.115469 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:57.117871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:27:57.117871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:27:57.117871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:57.117871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:57.117871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:27:57.117871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:27:57.117871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 12 13:27:57.117871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 12 13:27:57.117871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 13:27:57.117871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 13:27:57.117871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 13:27:57.117871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:57.117871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:57.117871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:57.117871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:57.117871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:57.117871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:57.117871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:57.117871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:57.117871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 13:27:57.117871 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:27:57.121641 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a6014271-1140-4b50-b3cd-939dd9dd6ff8 tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] Returning 404 to user: Image not found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:57.121641 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a6014271-1140-4b50-b3cd-939dd9dd6ff8 tempest-ImagesMetadataNegativeTestJSON-1512628255 tempest-ImagesMetadataNegativeTestJSON-1512628255-project] 10.222.0.52 "POST /compute/v2.1/images/0ebea294-f81b-4288-9a36-3adfb387119f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.057745 Oct 12 13:27:57.121641 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 686/1417] 10.222.0.52 () {60 vars in 1281 bytes} [Wed Oct 12 13:27:57 2022] POST /compute/v2.1/images/0ebea294-f81b-4288-9a36-3adfb387119f/metadata => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:27:57.367439 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=16 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:27:57.468141 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c35b1df6-abcc-41cd-8a5c-d917b2c781a4 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/d87ac4dc-aa4c-4eff-94cc-e09047cc7c0d" status: 200 len: 664 microversion: 2.1 time: 0.734330 Oct 12 13:27:57.468734 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 732/1418] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 12 13:27:56 2022] GET /compute/v2.1/os-security-groups/d87ac4dc-aa4c-4eff-94cc-e09047cc7c0d => generated 664 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:27:57.485965 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3bacc2fd-0147-4235-9e8b-340fa8694570 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Calling method '.version_select at 0x7f8a9b84c3a0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:57.604222 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-bf922b8b-a538-40cc-9279-a7f269b4771e tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:57.604737 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-bf922b8b-a538-40cc-9279-a7f269b4771e tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:57.620036 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bf922b8b-a538-40cc-9279-a7f269b4771e tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:57.620808 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bf922b8b-a538-40cc-9279-a7f269b4771e tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:57.621663 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bf922b8b-a538-40cc-9279-a7f269b4771e tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:57.622584 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bf922b8b-a538-40cc-9279-a7f269b4771e tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:57.623719 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bf922b8b-a538-40cc-9279-a7f269b4771e tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:57.624324 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bf922b8b-a538-40cc-9279-a7f269b4771e tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:58.141223 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3bacc2fd-0147-4235-9e8b-340fa8694570 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-group-rules/fa42b05d-1111-4fff-84cb-6603840153a3" status: 202 len: 0 microversion: 2.1 time: 0.649651 Oct 12 13:27:58.141223 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 687/1419] 10.222.0.52 () {58 vars in 1287 bytes} [Wed Oct 12 13:27:57 2022] DELETE /compute/v2.1/os-security-group-rules/fa42b05d-1111-4fff-84cb-6603840153a3 => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:27:58.141223 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-aa6560c5-0a39-43b4-bb94-c27f20d79edc tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Calling method '.version_select at 0x7f8a9b92df70>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:58.214643 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-bf922b8b-a538-40cc-9279-a7f269b4771e tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:58.235484 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-bf922b8b-a538-40cc-9279-a7f269b4771e tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1472 microversion: 2.1 time: 0.635736 Oct 12 13:27:58.237931 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 733/1420] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:57 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1472 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:27:58.929871 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-aa6560c5-0a39-43b4-bb94-c27f20d79edc tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/d87ac4dc-aa4c-4eff-94cc-e09047cc7c0d" status: 202 len: 0 microversion: 2.1 time: 0.789549 Oct 12 13:27:58.931660 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 688/1421] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:27:58 2022] DELETE /compute/v2.1/os-security-groups/d87ac4dc-aa4c-4eff-94cc-e09047cc7c0d => generated 0 bytes in 796 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:27:58.937181 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0d71d416-b64f-46e9-8803-c42d39b8cee0 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Calling method '.version_select at 0x7f8a9ba684c0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:59.014809 n-d-861076-2 devstack@n-api.service[120933]: DEBUG neutronclient.v2_0.client [None req-0d71d416-b64f-46e9-8803-c42d39b8cee0 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8083a2c5-0635-4893-8ee4-cd4402c7bee3 does not exist", "detail": ""}} {{(pid=120933) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 13:27:59.015410 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.security_group_api [None req-0d71d416-b64f-46e9-8803-c42d39b8cee0 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Neutron security group 8083a2c5-0635-4893-8ee4-cd4402c7bee3 not found {{(pid=120933) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 13:27:59.017030 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-0d71d416-b64f-46e9-8803-c42d39b8cee0 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] HTTP exception thrown: Security group 8083a2c5-0635-4893-8ee4-cd4402c7bee3 does not exist Oct 12 13:27:59.017030 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-3b0e6608-52aa-428c-948b-109884e07218'] Oct 12 13:27:59.019195 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0d71d416-b64f-46e9-8803-c42d39b8cee0 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Request method failure captured: Oct 12 13:27:59.019195 n-d-861076-2 devstack@n-api.service[120933]: request: DELETE /compute/v2.1/os-security-groups/8083a2c5-0635-4893-8ee4-cd4402c7bee3 HTTP/1.1 Oct 12 13:27:59.019195 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:27:59.019195 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:27:59.019195 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:27:59.019195 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:27:59.019195 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:27:59.019195 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:27:59.019195 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:27:59.019195 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:27:59.019195 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsDD4ejZC7gbz2ewNXea2GhvRFrH9qKQ3WP2o0PQo5A3bQmjtm5HH84ZOHJmLnL5d53lw-EimXOaMkzMnRN5-oXXxdKsQNWr0BgviLKkL37izvZpYoTNlvf1slAqNjKflWbljMsI_pC16Gc-ETG-XHxlbMsP9ugNt4aTFKq6SSdIcTE Oct 12 13:27:59.019195 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:27:59.019195 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:27:59.019195 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:27:59.019195 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:27:59.019195 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:27:59.019195 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:27:59.019195 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 9134f8764e56425997fe3fbce0908483 Oct 12 13:27:59.019195 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-416317785 Oct 12 13:27:59.019195 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:27:59.019195 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:27:59.020942 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9134f8764e56425997fe3fbce0908483"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9134f8764e56425997fe3fbce0908483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9134f8764e56425997fe3fbce0908483"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9134f8764e56425997fe3fbce0908483"}]}] Oct 12 13:27:59.020942 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-SecurityGroupRulesTestJSON-416317785 Oct 12 13:27:59.020942 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 9134f8764e56425997fe3fbce0908483 Oct 12 13:27:59.020942 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-416317785 Oct 12 13:27:59.020942 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-SecurityGroupRulesTestJSON-416317785-project Oct 12 13:27:59.020942 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:27:59.020942 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:27:59.020942 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: ab10c8c0e105442eb561c8dcda94eb38 Oct 12 13:27:59.020942 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-SecurityGroupRulesTestJSON-416317785-project Oct 12 13:27:59.020942 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:27:59.020942 n-d-861076-2 devstack@n-api.service[120933]: exception: Security group 8083a2c5-0635-4893-8ee4-cd4402c7bee3 does not exist Oct 12 13:27:59.020942 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-3b0e6608-52aa-428c-948b-109884e07218'] Oct 12 13:27:59.020942 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '8083a2c5-0635-4893-8ee4-cd4402c7bee3'} Oct 12 13:27:59.022094 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:27:59.022094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:59.022094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 13:27:59.022094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 13:27:59.022094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:59.022094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:59.022094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 13:27:59.022094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 13:27:59.022094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:59.022094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:59.022094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:27:59.022094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:27:59.022094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:59.022094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:59.022094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:27:59.022094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:27:59.022094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:59.022094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:59.022094 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 13:27:59.023679 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 13:27:59.023679 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:27:59.023679 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:27:59.023679 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 13:27:59.023679 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 13:27:59.023679 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 13:27:59.023679 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 13:27:59.023679 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8083a2c5-0635-4893-8ee4-cd4402c7bee3 does not exist Oct 12 13:27:59.023679 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b0e6608-52aa-428c-948b-109884e07218'] Oct 12 13:27:59.023679 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:59.023679 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:59.023679 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:59.023679 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:59.023679 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 13:27:59.023679 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 13:27:59.023679 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 13:27:59.023679 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 13:27:59.023679 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8083a2c5-0635-4893-8ee4-cd4402c7bee3 does not exist Oct 12 13:27:59.025278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b0e6608-52aa-428c-948b-109884e07218'] Oct 12 13:27:59.025278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:59.025278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:59.025278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:59.025278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:59.025278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:59.025278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:59.025278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:27:59.025278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:27:59.025278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:27:59.025278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:27:59.025278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:27:59.025278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:27:59.025278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 13:27:59.025278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 13:27:59.025278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8083a2c5-0635-4893-8ee4-cd4402c7bee3 does not exist Oct 12 13:27:59.025278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b0e6608-52aa-428c-948b-109884e07218'] Oct 12 13:27:59.025278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:59.025278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:27:59.025278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:59.025278 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:27:59.026932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:27:59.026932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:27:59.026932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:27:59.026932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:27:59.026932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8083a2c5-0635-4893-8ee4-cd4402c7bee3 does not exist Oct 12 13:27:59.026932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b0e6608-52aa-428c-948b-109884e07218'] Oct 12 13:27:59.026932 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:27:59.033950 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0d71d416-b64f-46e9-8803-c42d39b8cee0 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Returning 404 to user: Security group 8083a2c5-0635-4893-8ee4-cd4402c7bee3 does not exist Oct 12 13:27:59.033950 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-3b0e6608-52aa-428c-948b-109884e07218'] {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:27:59.033950 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0d71d416-b64f-46e9-8803-c42d39b8cee0 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/8083a2c5-0635-4893-8ee4-cd4402c7bee3" status: 404 len: 194 microversion: 2.1 time: 0.098423 Oct 12 13:27:59.034898 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 734/1422] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:27:58 2022] DELETE /compute/v2.1/os-security-groups/8083a2c5-0635-4893-8ee4-cd4402c7bee3 => generated 194 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:27:59.047697 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7a187e28-5450-4d74-899f-a72e66aa7854 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Calling method '.version_select at 0x7f8a9b9334c0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:59.267645 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f89c8776-2b3e-4566-9e10-616e18d69e4b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:27:59.268265 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f89c8776-2b3e-4566-9e10-616e18d69e4b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:27:59.283064 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f89c8776-2b3e-4566-9e10-616e18d69e4b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:59.283617 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f89c8776-2b3e-4566-9e10-616e18d69e4b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:59.284054 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f89c8776-2b3e-4566-9e10-616e18d69e4b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:59.284988 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f89c8776-2b3e-4566-9e10-616e18d69e4b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:27:59.285454 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f89c8776-2b3e-4566-9e10-616e18d69e4b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:27:59.285878 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f89c8776-2b3e-4566-9e10-616e18d69e4b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:27:59.578881 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f89c8776-2b3e-4566-9e10-616e18d69e4b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:27:59.590084 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f89c8776-2b3e-4566-9e10-616e18d69e4b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1472 microversion: 2.1 time: 0.327032 Oct 12 13:27:59.591499 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 735/1423] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:27:59 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1472 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:27:59.732619 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7a187e28-5450-4d74-899f-a72e66aa7854 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/cc8e21ab-ae95-4243-8c7f-33c017d3bcfb" status: 202 len: 0 microversion: 2.1 time: 0.697284 Oct 12 13:27:59.733291 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 689/1424] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:27:59 2022] DELETE /compute/v2.1/os-security-groups/cc8e21ab-ae95-4243-8c7f-33c017d3bcfb => generated 0 bytes in 699 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:27:59.754580 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e74dc82d-5030-4ead-ac53-d8807df25e47 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Calling method '.version_select at 0x7f8a9ba68a60>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:00.211109 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e74dc82d-5030-4ead-ac53-d8807df25e47 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/b02e1795-52bc-40e5-be09-a1e3d400f0cd" status: 202 len: 0 microversion: 2.1 time: 0.472786 Oct 12 13:28:00.214726 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 736/1425] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:27:59 2022] DELETE /compute/v2.1/os-security-groups/b02e1795-52bc-40e5-be09-a1e3d400f0cd => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:28:00.221814 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3755f2dc-c6e7-4f29-b05c-632003bbb35e tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Calling method '.version_select at 0x7f8a9b672160>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:00.614797 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4b6dac52-da6a-4ae4-bad0-43706e06abb0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:00.615418 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-4b6dac52-da6a-4ae4-bad0-43706e06abb0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:00.629921 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4b6dac52-da6a-4ae4-bad0-43706e06abb0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:00.630427 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4b6dac52-da6a-4ae4-bad0-43706e06abb0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:00.637232 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4b6dac52-da6a-4ae4-bad0-43706e06abb0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:00.639596 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4b6dac52-da6a-4ae4-bad0-43706e06abb0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:00.640197 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4b6dac52-da6a-4ae4-bad0-43706e06abb0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:00.641982 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4b6dac52-da6a-4ae4-bad0-43706e06abb0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:00.785624 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3755f2dc-c6e7-4f29-b05c-632003bbb35e tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/69aa7067-6cc6-4b37-82f7-a35411a271e8" status: 202 len: 0 microversion: 2.1 time: 0.569390 Oct 12 13:28:00.790178 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 690/1426] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:28:00 2022] DELETE /compute/v2.1/os-security-groups/69aa7067-6cc6-4b37-82f7-a35411a271e8 => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:28:00.795435 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-60ff0caa-c969-4590-b3ee-139ffe74e49a tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Calling method '.version_select at 0x7f8a9b933e50>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:01.135277 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-4b6dac52-da6a-4ae4-bad0-43706e06abb0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:01.146386 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4b6dac52-da6a-4ae4-bad0-43706e06abb0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1472 microversion: 2.1 time: 0.535354 Oct 12 13:28:01.146974 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 737/1427] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:00 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1472 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:28:01.712486 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-60ff0caa-c969-4590-b3ee-139ffe74e49a tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/a37c9e03-b22d-4986-9f7c-fc60b25e3b23" status: 202 len: 0 microversion: 2.1 time: 0.920727 Oct 12 13:28:01.713840 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 691/1428] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:28:00 2022] DELETE /compute/v2.1/os-security-groups/a37c9e03-b22d-4986-9f7c-fc60b25e3b23 => generated 0 bytes in 923 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:28:01.722239 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e459d893-4933-452b-8bf3-3661d8085498 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] Calling method '.version_select at 0x7f8a9baf25e0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:02.177764 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-72ea666f-bba2-4256-b22e-a4642bd3a617 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:02.177764 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-72ea666f-bba2-4256-b22e-a4642bd3a617 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:02.184495 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72ea666f-bba2-4256-b22e-a4642bd3a617 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:02.188091 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72ea666f-bba2-4256-b22e-a4642bd3a617 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:02.199379 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72ea666f-bba2-4256-b22e-a4642bd3a617 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:02.203911 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72ea666f-bba2-4256-b22e-a4642bd3a617 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:02.208314 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72ea666f-bba2-4256-b22e-a4642bd3a617 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:02.209303 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72ea666f-bba2-4256-b22e-a4642bd3a617 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:02.551437 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e459d893-4933-452b-8bf3-3661d8085498 tempest-SecurityGroupRulesTestJSON-416317785 tempest-SecurityGroupRulesTestJSON-416317785-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/b6c7bf05-0a3a-4087-a4f9-9359e056cdab" status: 202 len: 0 microversion: 2.1 time: 0.833159 Oct 12 13:28:02.556696 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 738/1429] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:28:01 2022] DELETE /compute/v2.1/os-security-groups/b6c7bf05-0a3a-4087-a4f9-9359e056cdab => generated 0 bytes in 839 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:28:02.634091 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-72ea666f-bba2-4256-b22e-a4642bd3a617 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:02.650779 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-72ea666f-bba2-4256-b22e-a4642bd3a617 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1472 microversion: 2.1 time: 0.484984 Oct 12 13:28:02.652348 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 692/1430] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:02 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1472 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:28:03.687564 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c284a774-9151-4cd5-a858-d05289d8cc45 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:03.689590 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c284a774-9151-4cd5-a858-d05289d8cc45 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:03.721918 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c284a774-9151-4cd5-a858-d05289d8cc45 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:03.722828 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c284a774-9151-4cd5-a858-d05289d8cc45 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:03.727262 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c284a774-9151-4cd5-a858-d05289d8cc45 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:03.729170 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c284a774-9151-4cd5-a858-d05289d8cc45 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:03.733744 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c284a774-9151-4cd5-a858-d05289d8cc45 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:03.733744 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c284a774-9151-4cd5-a858-d05289d8cc45 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:04.226666 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-c284a774-9151-4cd5-a858-d05289d8cc45 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:04.236982 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c284a774-9151-4cd5-a858-d05289d8cc45 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1472 microversion: 2.1 time: 0.560808 Oct 12 13:28:04.239648 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 739/1431] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:03 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1472 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:05.267363 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cc074069-947e-4d1e-ae03-a68151b1ff32 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:05.268686 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cc074069-947e-4d1e-ae03-a68151b1ff32 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:05.282372 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc074069-947e-4d1e-ae03-a68151b1ff32 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:05.284536 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc074069-947e-4d1e-ae03-a68151b1ff32 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:05.285395 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc074069-947e-4d1e-ae03-a68151b1ff32 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:05.286691 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc074069-947e-4d1e-ae03-a68151b1ff32 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:05.290044 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc074069-947e-4d1e-ae03-a68151b1ff32 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:05.291159 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc074069-947e-4d1e-ae03-a68151b1ff32 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:05.684030 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-cc074069-947e-4d1e-ae03-a68151b1ff32 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:05.695758 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cc074069-947e-4d1e-ae03-a68151b1ff32 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1472 microversion: 2.1 time: 0.434424 Oct 12 13:28:05.698924 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 693/1432] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:05 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1472 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:06.085423 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:28:06.357207 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-78a018db-f551-4bbf-b045-e16988fae303 tempest-ServerGroup264TestJSON-2062477345 tempest-ServerGroup264TestJSON-2062477345-project] Action: 'create', calling method: .version_select at 0x7f8a9ba99310>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:06.399392 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-78a018db-f551-4bbf-b045-e16988fae303 tempest-ServerGroup264TestJSON-2062477345 tempest-ServerGroup264TestJSON-2062477345-project] Getting quotas for project f94df4d47c134861a851176471549ac2. Resources: {'server_groups'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:28:06.409147 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-78a018db-f551-4bbf-b045-e16988fae303 tempest-ServerGroup264TestJSON-2062477345 tempest-ServerGroup264TestJSON-2062477345-project] Getting quotas for user b397b5b9925b4f25acc37d26a305b5a6 and project f94df4d47c134861a851176471549ac2. Resources: {'server_groups'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:28:06.712445 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=9,nova_api:INSERT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:28:06.723608 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-af94c15d-bf31-44e7-9bda-f71e7117858b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:06.724995 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-af94c15d-bf31-44e7-9bda-f71e7117858b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:06.733818 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-78a018db-f551-4bbf-b045-e16988fae303 tempest-ServerGroup264TestJSON-2062477345 tempest-ServerGroup264TestJSON-2062477345-project] Getting quotas for project f94df4d47c134861a851176471549ac2. Resources: {'server_groups'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:28:06.746925 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-af94c15d-bf31-44e7-9bda-f71e7117858b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:06.747676 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-af94c15d-bf31-44e7-9bda-f71e7117858b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:06.748142 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-af94c15d-bf31-44e7-9bda-f71e7117858b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:06.749416 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-af94c15d-bf31-44e7-9bda-f71e7117858b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:06.750408 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-af94c15d-bf31-44e7-9bda-f71e7117858b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:06.750839 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-af94c15d-bf31-44e7-9bda-f71e7117858b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:06.753550 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-78a018db-f551-4bbf-b045-e16988fae303 tempest-ServerGroup264TestJSON-2062477345 tempest-ServerGroup264TestJSON-2062477345-project] Getting quotas for user b397b5b9925b4f25acc37d26a305b5a6 and project f94df4d47c134861a851176471549ac2. Resources: {'server_groups'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:28:06.791516 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-78a018db-f551-4bbf-b045-e16988fae303 tempest-ServerGroup264TestJSON-2062477345 tempest-ServerGroup264TestJSON-2062477345-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.813634 Oct 12 13:28:06.802545 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 740/1433] 10.222.0.52 () {62 vars in 1214 bytes} [Wed Oct 12 13:28:05 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:28:06.820701 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b9383c40-d513-4c37-9660-9728a37abca8 tempest-ServerGroup264TestJSON-2062477345 tempest-ServerGroup264TestJSON-2062477345-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:06.855522 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b9383c40-d513-4c37-9660-9728a37abca8 tempest-ServerGroup264TestJSON-2062477345 tempest-ServerGroup264TestJSON-2062477345-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.050159 Oct 12 13:28:06.858272 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 741/1434] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Oct 12 13:28:06 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:28:06.872542 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-473437fc-f14e-4791-b846-f3e2e9e1e3c0 tempest-ServerGroup264TestJSON-2062477345 tempest-ServerGroup264TestJSON-2062477345-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:06.895399 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-473437fc-f14e-4791-b846-f3e2e9e1e3c0 tempest-ServerGroup264TestJSON-2062477345 tempest-ServerGroup264TestJSON-2062477345-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/178afe85-df60-4f45-9fa1-7cdaae75a056" status: 200 len: 235 microversion: 2.64 time: 0.031867 Oct 12 13:28:06.897224 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 742/1435] 10.222.0.52 () {60 vars in 1304 bytes} [Wed Oct 12 13:28:06 2022] GET /compute/v2.1/os-server-groups/178afe85-df60-4f45-9fa1-7cdaae75a056 => generated 235 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:28:06.912230 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-93678b23-39e8-4c38-8e50-018afe7455b6 tempest-ServerGroup264TestJSON-2062477345 tempest-ServerGroup264TestJSON-2062477345-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:06.914861 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=6 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:28:07.114809 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-93678b23-39e8-4c38-8e50-018afe7455b6 tempest-ServerGroup264TestJSON-2062477345 tempest-ServerGroup264TestJSON-2062477345-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/178afe85-df60-4f45-9fa1-7cdaae75a056" status: 204 len: 0 microversion: 2.64 time: 0.211179 Oct 12 13:28:07.115863 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 743/1436] 10.222.0.52 () {60 vars in 1307 bytes} [Wed Oct 12 13:28:06 2022] DELETE /compute/v2.1/os-server-groups/178afe85-df60-4f45-9fa1-7cdaae75a056 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 13:28:07.128265 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9a915b6a-7694-452f-ab49-bed0997a993a tempest-ServerGroup264TestJSON-2062477345 tempest-ServerGroup264TestJSON-2062477345-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:07.140685 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-9a915b6a-7694-452f-ab49-bed0997a993a tempest-ServerGroup264TestJSON-2062477345 tempest-ServerGroup264TestJSON-2062477345-project] HTTP exception thrown: Instance group 178afe85-df60-4f45-9fa1-7cdaae75a056 could not be found. Oct 12 13:28:07.142811 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9a915b6a-7694-452f-ab49-bed0997a993a tempest-ServerGroup264TestJSON-2062477345 tempest-ServerGroup264TestJSON-2062477345-project] Request method failure captured: Oct 12 13:28:07.142811 n-d-861076-2 devstack@n-api.service[120933]: request: DELETE /compute/v2.1/os-server-groups/178afe85-df60-4f45-9fa1-7cdaae75a056 HTTP/1.1 Oct 12 13:28:07.142811 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:28:07.142811 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:28:07.142811 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:28:07.142811 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:28:07.142811 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:28:07.142811 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:28:07.142811 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:28:07.142811 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:28:07.142811 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsDl7GoePiVm2MQf1bNd92h1FubYKsEmGyioE10M_ZtiautcNxAfIlqZmxRrEWGuA5nle_l_VIgWOIuTlka-zH5Jq3vZHalY_eWJgezNoNOS6rq8fj34LD0xAv_KG5VycghmXMz1SshxNtDmKAYfFZitVJHwwl_WrUXDuD2GzMau49Q Oct 12 13:28:07.142811 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:28:07.142811 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:28:07.142811 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:28:07.142811 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:28:07.142811 n-d-861076-2 devstack@n-api.service[120933]: X-Openstack-Nova-Api-Version: 2.64 Oct 12 13:28:07.142811 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:28:07.142811 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:28:07.142811 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: f94df4d47c134861a851176471549ac2 Oct 12 13:28:07.142811 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServerGroup264TestJSON-2062477345 Oct 12 13:28:07.142811 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:28:07.142811 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:28:07.144449 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f94df4d47c134861a851176471549ac2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f94df4d47c134861a851176471549ac2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f94df4d47c134861a851176471549ac2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f94df4d47c134861a851176471549ac2"}]}] Oct 12 13:28:07.144449 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServerGroup264TestJSON-2062477345 Oct 12 13:28:07.144449 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: f94df4d47c134861a851176471549ac2 Oct 12 13:28:07.144449 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServerGroup264TestJSON-2062477345 Oct 12 13:28:07.144449 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServerGroup264TestJSON-2062477345-project Oct 12 13:28:07.144449 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:28:07.144449 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:28:07.144449 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: b397b5b9925b4f25acc37d26a305b5a6 Oct 12 13:28:07.144449 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServerGroup264TestJSON-2062477345-project Oct 12 13:28:07.144449 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:28:07.144449 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance group 178afe85-df60-4f45-9fa1-7cdaae75a056 could not be found. Oct 12 13:28:07.144449 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '178afe85-df60-4f45-9fa1-7cdaae75a056'} Oct 12 13:28:07.150360 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:28:07.150360 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:07.150360 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 12 13:28:07.150360 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 12 13:28:07.150360 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:28:07.150360 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:28:07.150360 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 12 13:28:07.150360 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 12 13:28:07.150360 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:28:07.150360 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:28:07.150360 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 12 13:28:07.150360 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 12 13:28:07.150360 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 178afe85-df60-4f45-9fa1-7cdaae75a056 could not be found. Oct 12 13:28:07.150360 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:07.150360 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:28:07.150360 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:07.150360 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:07.150360 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:28:07.150360 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:28:07.151937 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:28:07.151937 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:28:07.151937 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:28:07.151937 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:28:07.151937 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 12 13:28:07.151937 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:28:07.151937 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 178afe85-df60-4f45-9fa1-7cdaae75a056 could not be found. Oct 12 13:28:07.151937 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:07.151937 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:28:07.151937 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:07.151937 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:07.151937 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:28:07.151937 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:28:07.151937 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:28:07.151937 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:28:07.151937 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 178afe85-df60-4f45-9fa1-7cdaae75a056 could not be found. Oct 12 13:28:07.151937 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:07.154245 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9a915b6a-7694-452f-ab49-bed0997a993a tempest-ServerGroup264TestJSON-2062477345 tempest-ServerGroup264TestJSON-2062477345-project] Returning 404 to user: Instance group 178afe85-df60-4f45-9fa1-7cdaae75a056 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:28:07.154245 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9a915b6a-7694-452f-ab49-bed0997a993a tempest-ServerGroup264TestJSON-2062477345 tempest-ServerGroup264TestJSON-2062477345-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/178afe85-df60-4f45-9fa1-7cdaae75a056" status: 404 len: 117 microversion: 2.64 time: 0.022113 Oct 12 13:28:07.154245 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 744/1437] 10.222.0.52 () {60 vars in 1307 bytes} [Wed Oct 12 13:28:07 2022] DELETE /compute/v2.1/os-server-groups/178afe85-df60-4f45-9fa1-7cdaae75a056 => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 12 13:28:07.357488 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-af94c15d-bf31-44e7-9bda-f71e7117858b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:07.377242 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-af94c15d-bf31-44e7-9bda-f71e7117858b tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1472 microversion: 2.1 time: 0.657979 Oct 12 13:28:07.381506 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 694/1438] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:06 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1472 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:28:08.057788 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1c1e99a2-bbcd-4faf-bcdf-9e38c8a8ed1b tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-591097705", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:08.161900 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-1c1e99a2-bbcd-4faf-bcdf-9e38c8a8ed1b tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] validate_networks() for None {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:28:08.407849 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8b7a2162-92b4-4fe3-97c7-2e9500ec7b37 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:08.408459 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8b7a2162-92b4-4fe3-97c7-2e9500ec7b37 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:08.419678 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8b7a2162-92b4-4fe3-97c7-2e9500ec7b37 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:08.420597 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8b7a2162-92b4-4fe3-97c7-2e9500ec7b37 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:08.421299 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8b7a2162-92b4-4fe3-97c7-2e9500ec7b37 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:08.422661 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8b7a2162-92b4-4fe3-97c7-2e9500ec7b37 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:08.423480 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8b7a2162-92b4-4fe3-97c7-2e9500ec7b37 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:08.424163 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8b7a2162-92b4-4fe3-97c7-2e9500ec7b37 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:08.750804 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-1c1e99a2-bbcd-4faf-bcdf-9e38c8a8ed1b tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:28:08.751436 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-1c1e99a2-bbcd-4faf-bcdf-9e38c8a8ed1b tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:28:08.760657 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-1c1e99a2-bbcd-4faf-bcdf-9e38c8a8ed1b tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:28:08.761152 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-1c1e99a2-bbcd-4faf-bcdf-9e38c8a8ed1b tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:28:08.761570 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-1c1e99a2-bbcd-4faf-bcdf-9e38c8a8ed1b tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:28:08.782143 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1c1e99a2-bbcd-4faf-bcdf-9e38c8a8ed1b tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:08.783817 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1c1e99a2-bbcd-4faf-bcdf-9e38c8a8ed1b tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:08.783817 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1c1e99a2-bbcd-4faf-bcdf-9e38c8a8ed1b tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:08.783817 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1c1e99a2-bbcd-4faf-bcdf-9e38c8a8ed1b tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:08.784218 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1c1e99a2-bbcd-4faf-bcdf-9e38c8a8ed1b tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:08.787461 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1c1e99a2-bbcd-4faf-bcdf-9e38c8a8ed1b tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:08.799760 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=81 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:28:08.825128 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-1c1e99a2-bbcd-4faf-bcdf-9e38c8a8ed1b tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Getting quotas for project 46912a6dbce642efa054f5fc83b1bbaf. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:28:08.833440 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-1c1e99a2-bbcd-4faf-bcdf-9e38c8a8ed1b tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Getting quotas for user ace4b2fa8c4c4198a7215456e7f52fe9 and project 46912a6dbce642efa054f5fc83b1bbaf. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:28:08.850810 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-1c1e99a2-bbcd-4faf-bcdf-9e38c8a8ed1b tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Going to run 1 instances... {{(pid=120933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:28:08.861000 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-1c1e99a2-bbcd-4faf-bcdf-9e38c8a8ed1b tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:28:09.018143 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1c1e99a2-bbcd-4faf-bcdf-9e38c8a8ed1b tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.174415 Oct 12 13:28:09.018879 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 745/1439] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:28:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 13:28:09.041535 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c0d8e5a8-9982-4c73-bede-3e2afc936782 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:09.042190 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c0d8e5a8-9982-4c73-bede-3e2afc936782 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:09.666820 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8b7a2162-92b4-4fe3-97c7-2e9500ec7b37 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:09.668156 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-c0d8e5a8-9982-4c73-bede-3e2afc936782 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:09.676038 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c0d8e5a8-9982-4c73-bede-3e2afc936782 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 200 len: 1218 microversion: 2.1 time: 0.647563 Oct 12 13:28:09.682182 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 746/1440] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:09 2022] GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 1218 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:09.682347 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8b7a2162-92b4-4fe3-97c7-2e9500ec7b37 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1472 microversion: 2.1 time: 1.273526 Oct 12 13:28:09.682347 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 695/1441] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:08 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1472 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:28:10.549600 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fc5e6724-b6d0-4a06-a627-e1a4eab80f50 tempest-ServersTestBootFromVolume-1563245049 tempest-ServersTestBootFromVolume-1563245049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1957550809", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "3a8528c3-e87d-4060-8a39-2ab375f8dc98"}], "security_groups": [{"name": "tempest-securitygroup--387522094"}], "key_name": "tempest-keypair-1358335938", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "10b98e01-7704-43ad-983d-0c38ad845b89", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:10.722042 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-69f4758a-e9f4-46c7-83f3-2ebd10ca42c4 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:10.722942 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-69f4758a-e9f4-46c7-83f3-2ebd10ca42c4 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:10.953535 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-69f4758a-e9f4-46c7-83f3-2ebd10ca42c4 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:10.976446 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-fc5e6724-b6d0-4a06-a627-e1a4eab80f50 tempest-ServersTestBootFromVolume-1563245049 tempest-ServersTestBootFromVolume-1563245049-project] validate_networks() for [('3a8528c3-e87d-4060-8a39-2ab375f8dc98', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:28:10.987671 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-69f4758a-e9f4-46c7-83f3-2ebd10ca42c4 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 200 len: 1218 microversion: 2.1 time: 0.287539 Oct 12 13:28:11.002442 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 696/1442] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:10 2022] GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 1218 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:11.012413 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-dd8d8184-83fc-4ca7-b4d8-66b3d9af7810 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:11.013461 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-dd8d8184-83fc-4ca7-b4d8-66b3d9af7810 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:11.039569 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dd8d8184-83fc-4ca7-b4d8-66b3d9af7810 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:11.050102 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dd8d8184-83fc-4ca7-b4d8-66b3d9af7810 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:11.052490 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dd8d8184-83fc-4ca7-b4d8-66b3d9af7810 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:11.055076 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dd8d8184-83fc-4ca7-b4d8-66b3d9af7810 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:11.055076 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dd8d8184-83fc-4ca7-b4d8-66b3d9af7810 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:11.055076 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dd8d8184-83fc-4ca7-b4d8-66b3d9af7810 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:11.521052 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-dd8d8184-83fc-4ca7-b4d8-66b3d9af7810 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:11.532403 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-dd8d8184-83fc-4ca7-b4d8-66b3d9af7810 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1472 microversion: 2.1 time: 0.528398 Oct 12 13:28:11.534752 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 697/1443] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:11 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1472 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:11.589139 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-fc5e6724-b6d0-4a06-a627-e1a4eab80f50 tempest-ServersTestBootFromVolume-1563245049 tempest-ServersTestBootFromVolume-1563245049-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4b5d6365-a84c-4b20-8e54-156d822b485b) Oct 12 13:28:11.589139 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:11.589139 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:28:11.589139 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:28:11.589139 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:11.589139 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:11.589139 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:11.589139 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:11.589139 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:11.589139 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:11.589139 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:28:11.589139 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:28:11.589139 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:28:11.589139 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:28:11.589139 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:28:11.589139 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:28:11.591061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:28:11.591061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:28:11.591061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:28:11.591061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:28:11.591061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:28:11.591061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:28:11.591061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:28:11.591061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:28:11.591061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:28:11.591061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:28:11.591061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:28:11.591061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:11.591061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:11.591061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:28:11.591061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:28:11.591061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:11.591061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:11.591061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:28:11.592807 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:28:11.592807 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:11.592807 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:11.592807 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:28:11.592807 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:28:11.592807 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:11.592807 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:11.592807 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:28:11.592807 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:28:11.592807 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:28:11.592807 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:28:11.592807 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:28:11.592807 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:28:11.592807 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:28:11.592807 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:28:11.592807 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:28:11.592807 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:28:11.592807 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:28:11.600691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:28:11.600691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:28:11.600691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:28:11.600691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:28:11.600691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:28:11.600691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:28:11.600691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:28:11.600691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:28:11.600691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:28:11.600691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:28:11.600691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:28:11.600691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:28:11.600691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:28:11.600691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:28:11.600691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4b5d6365-a84c-4b20-8e54-156d822b485b) Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-fc5e6724-b6d0-4a06-a627-e1a4eab80f50 tempest-ServersTestBootFromVolume-1563245049 tempest-ServersTestBootFromVolume-1563245049-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fc5e6724-b6d0-4a06-a627-e1a4eab80f50 tempest-ServersTestBootFromVolume-1563245049 tempest-ServersTestBootFromVolume-1563245049-project] Request method failure captured: Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 788 Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsCz7Bm6S_VVvHOhDUhIqiX4yGtEldexWMGHUNtkTTS-tJ19cvvsv_mLOY3cadH6D8jQlPRmpaebI9ZaDad6MTGupWqjbsx0n72inW3gfKRUi1Gw9Ik7JlQW5cj0GR-b-G5DI9osZmwl8oe0F7NFuVlB7UtBZ17ewLlkSMVCezcN7Pw Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 0d7e1254703d46e1ac62f2c5a2ca2635 Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServersTestBootFromVolume-1563245049 Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:28:11.603274 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:28:11.605332 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0d7e1254703d46e1ac62f2c5a2ca2635"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0d7e1254703d46e1ac62f2c5a2ca2635"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0d7e1254703d46e1ac62f2c5a2ca2635"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0d7e1254703d46e1ac62f2c5a2ca2635"}]}] Oct 12 13:28:11.605332 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServersTestBootFromVolume-1563245049 Oct 12 13:28:11.605332 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 0d7e1254703d46e1ac62f2c5a2ca2635 Oct 12 13:28:11.605332 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1563245049 Oct 12 13:28:11.605332 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServersTestBootFromVolume-1563245049-project Oct 12 13:28:11.605332 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:28:11.605332 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:28:11.605332 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 8a9191f571644557ac00dd990752ff4f Oct 12 13:28:11.605332 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServersTestBootFromVolume-1563245049-project Oct 12 13:28:11.605332 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:28:11.606167 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1957550809", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "A2+5oQ5Txym3H6N", "networks": [{"uuid": "3a8528c3-e87d-4060-8a39-2ab375f8dc98"}], "security_groups": [{"name": "tempest-securitygroup--387522094"}], "key_name": "tempest-keypair-1358335938", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "10b98e01-7704-43ad-983d-0c38ad845b89", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "AUTO"}} Oct 12 13:28:11.606167 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:28:11.606167 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:11.606167 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:28:11.606167 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-ServersTestBootFromVolume-server-1957550809', 'imageRef': '', 'flavorRef': '452', 'metadata': {'hello': 'world'}, 'adminPass': 'A2+5oQ5Txym3H6N', 'networks': [{'uuid': '3a8528c3-e87d-4060-8a39-2ab375f8dc98'}], 'security_groups': [{'name': 'tempest-securitygroup--387522094'}], 'key_name': 'tempest-keypair-1358335938', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': '10b98e01-7704-43ad-983d-0c38ad845b89'}]}}} Oct 12 13:28:11.606167 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:28:11.606167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:11.606780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:28:11.606780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:28:11.606780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:11.606780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:11.606780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:11.606780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:11.606780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:11.606780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:11.606780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:28:11.606780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:28:11.606780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:28:11.606780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:28:11.606780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:28:11.606780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:28:11.606780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:28:11.606780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:28:11.606780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:28:11.606780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:28:11.606780 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:28:11.608316 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:28:11.608316 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:28:11.608316 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:28:11.608316 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:28:11.608316 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:28:11.608316 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:28:11.608316 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:11.608316 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:11.608316 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:28:11.608316 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:28:11.608316 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:11.608316 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:11.608316 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:28:11.608316 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:28:11.608316 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:11.608316 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:11.608316 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:28:11.608316 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:28:11.625584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:11.625584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:11.625584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:28:11.625584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:28:11.625584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:28:11.625584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:28:11.625584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:28:11.625584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:28:11.625584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:28:11.625584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:28:11.625584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:28:11.625584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:28:11.625584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:28:11.625584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:28:11.625584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:28:11.625584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:28:11.625584 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:28:11.627178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:28:11.627178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:28:11.627178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:28:11.627178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:28:11.627178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:28:11.627178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:28:11.627178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:28:11.627178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:28:11.627178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:28:11.627178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:28:11.627178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:28:11.627178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4b5d6365-a84c-4b20-8e54-156d822b485b) Oct 12 13:28:11.627178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:11.627178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:28:11.627178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:11.627178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:11.627178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:28:11.628557 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:28:11.628557 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:28:11.628557 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:28:11.628557 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:28:11.628557 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:28:11.628557 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:11.628557 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:11.628557 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:11.628557 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:28:11.628557 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:11.628557 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:11.628557 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:28:11.628557 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:28:11.628557 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:28:11.628557 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:28:11.628557 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:11.628557 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:11.628557 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:11.630578 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fc5e6724-b6d0-4a06-a627-e1a4eab80f50 tempest-ServersTestBootFromVolume-1563245049 tempest-ServersTestBootFromVolume-1563245049-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:11.630578 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:28:11.630578 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fc5e6724-b6d0-4a06-a627-e1a4eab80f50 tempest-ServersTestBootFromVolume-1563245049 tempest-ServersTestBootFromVolume-1563245049-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.052107 Oct 12 13:28:11.630578 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 747/1444] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:28:10 2022] POST /compute/v2.1/servers => generated 214 bytes in 1053 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:28:11.630950 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-02f94105-e559-403e-960e-70a0ca3608c8 tempest-ServersTestBootFromVolume-1563245049 tempest-ServersTestBootFromVolume-1563245049-project] Calling method '.version_select at 0x7f8a9b933280>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:11.734382 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-02f94105-e559-403e-960e-70a0ca3608c8 tempest-ServersTestBootFromVolume-1563245049 tempest-ServersTestBootFromVolume-1563245049-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1358335938" status: 202 len: 0 microversion: 2.1 time: 0.131694 Oct 12 13:28:11.736282 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 698/1445] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 12 13:28:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1358335938 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:28:12.022072 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ba3db5d7-9fd0-42a7-97f9-5a03fd3ee39a tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:12.022705 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-ba3db5d7-9fd0-42a7-97f9-5a03fd3ee39a tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:12.035108 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ba3db5d7-9fd0-42a7-97f9-5a03fd3ee39a tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:12.040428 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ba3db5d7-9fd0-42a7-97f9-5a03fd3ee39a tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:12.040949 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ba3db5d7-9fd0-42a7-97f9-5a03fd3ee39a tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:12.054323 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ba3db5d7-9fd0-42a7-97f9-5a03fd3ee39a tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:12.054491 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ba3db5d7-9fd0-42a7-97f9-5a03fd3ee39a tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:12.054945 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ba3db5d7-9fd0-42a7-97f9-5a03fd3ee39a tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:12.316974 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-ba3db5d7-9fd0-42a7-97f9-5a03fd3ee39a tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:12.335988 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ba3db5d7-9fd0-42a7-97f9-5a03fd3ee39a tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 200 len: 1270 microversion: 2.1 time: 0.318566 Oct 12 13:28:12.336671 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 748/1446] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:12 2022] GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 1270 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:12.558310 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-14f99d3c-48ea-45c9-bd7d-bc805d681805 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:12.558940 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-14f99d3c-48ea-45c9-bd7d-bc805d681805 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:12.574287 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-14f99d3c-48ea-45c9-bd7d-bc805d681805 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:12.574503 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-14f99d3c-48ea-45c9-bd7d-bc805d681805 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:12.574955 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-14f99d3c-48ea-45c9-bd7d-bc805d681805 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:12.581407 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-14f99d3c-48ea-45c9-bd7d-bc805d681805 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:12.587300 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-14f99d3c-48ea-45c9-bd7d-bc805d681805 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:12.587936 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-14f99d3c-48ea-45c9-bd7d-bc805d681805 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:13.362660 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0f965c2f-1a3b-4abe-82d5-ea940cb5ba2c tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:13.363286 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-0f965c2f-1a3b-4abe-82d5-ea940cb5ba2c tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:13.375388 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0f965c2f-1a3b-4abe-82d5-ea940cb5ba2c tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:13.376603 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0f965c2f-1a3b-4abe-82d5-ea940cb5ba2c tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:13.377650 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0f965c2f-1a3b-4abe-82d5-ea940cb5ba2c tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:13.378846 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0f965c2f-1a3b-4abe-82d5-ea940cb5ba2c tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:13.380112 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0f965c2f-1a3b-4abe-82d5-ea940cb5ba2c tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:13.382168 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0f965c2f-1a3b-4abe-82d5-ea940cb5ba2c tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:13.553645 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-0f965c2f-1a3b-4abe-82d5-ea940cb5ba2c tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:13.564246 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0f965c2f-1a3b-4abe-82d5-ea940cb5ba2c tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 200 len: 1276 microversion: 2.1 time: 0.205896 Oct 12 13:28:13.565780 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 749/1447] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:13 2022] GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 1276 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:28:13.715821 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-14f99d3c-48ea-45c9-bd7d-bc805d681805 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:13.724939 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-14f99d3c-48ea-45c9-bd7d-bc805d681805 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1472 microversion: 2.1 time: 1.171399 Oct 12 13:28:13.741743 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 699/1448] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:12 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1472 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:14.588853 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-dcf5b6e9-5e9e-4770-b4f2-5666b80791b2 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:14.590096 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-dcf5b6e9-5e9e-4770-b4f2-5666b80791b2 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:14.605607 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dcf5b6e9-5e9e-4770-b4f2-5666b80791b2 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:14.640713 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dcf5b6e9-5e9e-4770-b4f2-5666b80791b2 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:14.642255 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dcf5b6e9-5e9e-4770-b4f2-5666b80791b2 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:14.643187 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dcf5b6e9-5e9e-4770-b4f2-5666b80791b2 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:14.645141 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dcf5b6e9-5e9e-4770-b4f2-5666b80791b2 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:14.645651 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dcf5b6e9-5e9e-4770-b4f2-5666b80791b2 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:14.756331 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ba5f1b24-fd7f-43f3-8936-b6bc9aa1d0f3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:14.757298 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ba5f1b24-fd7f-43f3-8936-b6bc9aa1d0f3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:14.793488 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba5f1b24-fd7f-43f3-8936-b6bc9aa1d0f3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:14.797420 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba5f1b24-fd7f-43f3-8936-b6bc9aa1d0f3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:14.799627 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba5f1b24-fd7f-43f3-8936-b6bc9aa1d0f3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:14.803048 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba5f1b24-fd7f-43f3-8936-b6bc9aa1d0f3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:14.804596 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba5f1b24-fd7f-43f3-8936-b6bc9aa1d0f3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:14.805331 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba5f1b24-fd7f-43f3-8936-b6bc9aa1d0f3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:14.953388 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-dcf5b6e9-5e9e-4770-b4f2-5666b80791b2 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:14.965138 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-dcf5b6e9-5e9e-4770-b4f2-5666b80791b2 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 200 len: 1276 microversion: 2.1 time: 0.379835 Oct 12 13:28:14.966096 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 750/1449] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:14 2022] GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 1276 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:16.057204 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-ba5f1b24-fd7f-43f3-8936-b6bc9aa1d0f3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:16.068316 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ba5f1b24-fd7f-43f3-8936-b6bc9aa1d0f3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1472 microversion: 2.1 time: 1.318150 Oct 12 13:28:16.068946 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 700/1450] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:14 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1472 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:16.080613 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-36dddc25-c3b3-4005-9f68-b750053c72f2 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:16.083366 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-36dddc25-c3b3-4005-9f68-b750053c72f2 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:16.097068 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-36dddc25-c3b3-4005-9f68-b750053c72f2 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:16.100402 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-36dddc25-c3b3-4005-9f68-b750053c72f2 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:16.101892 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-36dddc25-c3b3-4005-9f68-b750053c72f2 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:16.104998 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-36dddc25-c3b3-4005-9f68-b750053c72f2 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:16.106047 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-36dddc25-c3b3-4005-9f68-b750053c72f2 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:16.107405 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-36dddc25-c3b3-4005-9f68-b750053c72f2 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:16.221367 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e51d2c2c-3513-4ae5-bd59-d40fafda179a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-188334687", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": "none"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:16.323145 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-e51d2c2c-3513-4ae5-bd59-d40fafda179a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:28:16.323794 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-e51d2c2c-3513-4ae5-bd59-d40fafda179a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:28:16.324444 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-e51d2c2c-3513-4ae5-bd59-d40fafda179a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:28:16.325062 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-e51d2c2c-3513-4ae5-bd59-d40fafda179a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:28:16.325678 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-e51d2c2c-3513-4ae5-bd59-d40fafda179a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:28:16.354406 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e51d2c2c-3513-4ae5-bd59-d40fafda179a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:16.355947 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e51d2c2c-3513-4ae5-bd59-d40fafda179a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:16.356480 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e51d2c2c-3513-4ae5-bd59-d40fafda179a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:16.359043 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e51d2c2c-3513-4ae5-bd59-d40fafda179a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:16.361733 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e51d2c2c-3513-4ae5-bd59-d40fafda179a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:16.361733 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e51d2c2c-3513-4ae5-bd59-d40fafda179a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:16.381527 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-e51d2c2c-3513-4ae5-bd59-d40fafda179a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Getting quotas for project b4ba65a035db4858b8f0d5660068b8c0. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:28:16.387296 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-e51d2c2c-3513-4ae5-bd59-d40fafda179a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Getting quotas for user 7d171ca393964f568d0693923b7b37eb and project b4ba65a035db4858b8f0d5660068b8c0. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:28:16.403005 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-e51d2c2c-3513-4ae5-bd59-d40fafda179a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Going to run 1 instances... {{(pid=120933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:28:16.408415 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-e51d2c2c-3513-4ae5-bd59-d40fafda179a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:28:16.461884 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-36dddc25-c3b3-4005-9f68-b750053c72f2 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:16.486666 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-36dddc25-c3b3-4005-9f68-b750053c72f2 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 200 len: 1276 microversion: 2.1 time: 0.414300 Oct 12 13:28:16.488062 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 701/1451] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:16 2022] GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 1276 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:16.581464 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e51d2c2c-3513-4ae5-bd59-d40fafda179a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.592451 Oct 12 13:28:16.582129 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 751/1452] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 12 13:28:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 13:28:16.594694 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d7125cca-b91a-4b8a-bbef-85ba6e4ffd2d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:16.595653 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d7125cca-b91a-4b8a-bbef-85ba6e4ffd2d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:16.862378 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d7125cca-b91a-4b8a-bbef-85ba6e4ffd2d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:16.881669 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d7125cca-b91a-4b8a-bbef-85ba6e4ffd2d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:16.886854 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d7125cca-b91a-4b8a-bbef-85ba6e4ffd2d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:16.891118 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d7125cca-b91a-4b8a-bbef-85ba6e4ffd2d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1277 microversion: 2.54 time: 0.298455 Oct 12 13:28:16.896106 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 702/1453] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:16 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1277 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:17.097711 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a21b0b24-2758-44d8-8947-c04bf2444b9a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:17.098514 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a21b0b24-2758-44d8-8947-c04bf2444b9a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:17.109074 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a21b0b24-2758-44d8-8947-c04bf2444b9a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:17.109710 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a21b0b24-2758-44d8-8947-c04bf2444b9a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:17.111706 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a21b0b24-2758-44d8-8947-c04bf2444b9a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:17.112521 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a21b0b24-2758-44d8-8947-c04bf2444b9a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:17.114879 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a21b0b24-2758-44d8-8947-c04bf2444b9a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:17.115448 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a21b0b24-2758-44d8-8947-c04bf2444b9a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:17.511401 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2067d994-9b2b-45a8-8189-78b42aa35b4e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:17.512038 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2067d994-9b2b-45a8-8189-78b42aa35b4e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:17.526650 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2067d994-9b2b-45a8-8189-78b42aa35b4e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:17.530973 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2067d994-9b2b-45a8-8189-78b42aa35b4e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:17.534365 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2067d994-9b2b-45a8-8189-78b42aa35b4e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:17.535472 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2067d994-9b2b-45a8-8189-78b42aa35b4e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:17.536119 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2067d994-9b2b-45a8-8189-78b42aa35b4e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:17.536722 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2067d994-9b2b-45a8-8189-78b42aa35b4e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:18.070024 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a21b0b24-2758-44d8-8947-c04bf2444b9a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:18.079624 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a21b0b24-2758-44d8-8947-c04bf2444b9a tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1472 microversion: 2.1 time: 0.988087 Oct 12 13:28:18.080161 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 752/1454] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:17 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1472 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:18.100190 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-13248186-c42f-4c76-9010-7414a18f91fd tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:18.100736 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-13248186-c42f-4c76-9010-7414a18f91fd tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:19.053567 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-13248186-c42f-4c76-9010-7414a18f91fd tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:19.072815 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-13248186-c42f-4c76-9010-7414a18f91fd tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:19.072815 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-13248186-c42f-4c76-9010-7414a18f91fd tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:19.072815 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-13248186-c42f-4c76-9010-7414a18f91fd tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1277 microversion: 2.54 time: 0.977944 Oct 12 13:28:19.081061 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 753/1455] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:18 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1277 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:19.105553 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c0b13aca-3895-4951-9ae8-607f02d0abd4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:19.106167 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c0b13aca-3895-4951-9ae8-607f02d0abd4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:19.127333 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c0b13aca-3895-4951-9ae8-607f02d0abd4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:19.127840 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c0b13aca-3895-4951-9ae8-607f02d0abd4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:19.137142 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c0b13aca-3895-4951-9ae8-607f02d0abd4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:19.141827 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c0b13aca-3895-4951-9ae8-607f02d0abd4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:19.142381 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c0b13aca-3895-4951-9ae8-607f02d0abd4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:19.150191 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c0b13aca-3895-4951-9ae8-607f02d0abd4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:19.323381 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-2067d994-9b2b-45a8-8189-78b42aa35b4e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:19.334228 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2067d994-9b2b-45a8-8189-78b42aa35b4e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 200 len: 1318 microversion: 2.1 time: 1.827972 Oct 12 13:28:19.364004 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 703/1456] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:17 2022] GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 1318 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:20.110017 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-74a10dd9-aefa-4770-ac7b-2de1d03429a5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:20.114171 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-74a10dd9-aefa-4770-ac7b-2de1d03429a5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:20.114171 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=7 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:28:20.135934 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74a10dd9-aefa-4770-ac7b-2de1d03429a5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:20.137138 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74a10dd9-aefa-4770-ac7b-2de1d03429a5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:20.138286 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74a10dd9-aefa-4770-ac7b-2de1d03429a5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:20.159096 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74a10dd9-aefa-4770-ac7b-2de1d03429a5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:20.160235 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74a10dd9-aefa-4770-ac7b-2de1d03429a5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:20.160978 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74a10dd9-aefa-4770-ac7b-2de1d03429a5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:20.521003 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-74a10dd9-aefa-4770-ac7b-2de1d03429a5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:20.536106 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-74a10dd9-aefa-4770-ac7b-2de1d03429a5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:20.538596 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-74a10dd9-aefa-4770-ac7b-2de1d03429a5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:20.542254 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-74a10dd9-aefa-4770-ac7b-2de1d03429a5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1337 microversion: 2.54 time: 0.436346 Oct 12 13:28:20.543425 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 704/1457] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:20 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1337 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:28:20.551600 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9a902072-e53b-4353-a5f3-c67f35a2ac03 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:20.552607 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9a902072-e53b-4353-a5f3-c67f35a2ac03 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:20.562659 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9a902072-e53b-4353-a5f3-c67f35a2ac03 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:20.563623 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9a902072-e53b-4353-a5f3-c67f35a2ac03 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:20.565154 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9a902072-e53b-4353-a5f3-c67f35a2ac03 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:20.566454 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9a902072-e53b-4353-a5f3-c67f35a2ac03 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:20.568378 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9a902072-e53b-4353-a5f3-c67f35a2ac03 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:20.569163 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9a902072-e53b-4353-a5f3-c67f35a2ac03 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:20.606380 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-c0b13aca-3895-4951-9ae8-607f02d0abd4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:20.638923 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c0b13aca-3895-4951-9ae8-607f02d0abd4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1478 microversion: 2.1 time: 1.537332 Oct 12 13:28:20.639505 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 754/1458] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:19 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1478 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:28:21.255602 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-9a902072-e53b-4353-a5f3-c67f35a2ac03 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:21.264697 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9a902072-e53b-4353-a5f3-c67f35a2ac03 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 200 len: 1318 microversion: 2.1 time: 0.719919 Oct 12 13:28:21.268154 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 705/1459] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:20 2022] GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 1318 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:21.574575 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cc6e68e0-8838-45bc-8cd8-5a50b5f72409 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:21.575467 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-cc6e68e0-8838-45bc-8cd8-5a50b5f72409 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:21.591024 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cc6e68e0-8838-45bc-8cd8-5a50b5f72409 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:21.593992 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cc6e68e0-8838-45bc-8cd8-5a50b5f72409 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:21.594447 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cc6e68e0-8838-45bc-8cd8-5a50b5f72409 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:21.597879 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cc6e68e0-8838-45bc-8cd8-5a50b5f72409 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:21.601515 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cc6e68e0-8838-45bc-8cd8-5a50b5f72409 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:21.602122 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cc6e68e0-8838-45bc-8cd8-5a50b5f72409 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:21.664435 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-383290bb-af85-4c38-a92f-a49db209f3db tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:21.665098 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-383290bb-af85-4c38-a92f-a49db209f3db tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:21.679580 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-383290bb-af85-4c38-a92f-a49db209f3db tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:21.680075 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-383290bb-af85-4c38-a92f-a49db209f3db tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:21.680523 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-383290bb-af85-4c38-a92f-a49db209f3db tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:21.681286 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-383290bb-af85-4c38-a92f-a49db209f3db tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:21.681743 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-383290bb-af85-4c38-a92f-a49db209f3db tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:21.693619 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-383290bb-af85-4c38-a92f-a49db209f3db tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:21.698669 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:28:21.845801 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-cc6e68e0-8838-45bc-8cd8-5a50b5f72409 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:21.858169 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-cc6e68e0-8838-45bc-8cd8-5a50b5f72409 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:21.859754 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-cc6e68e0-8838-45bc-8cd8-5a50b5f72409 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:21.860888 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-cc6e68e0-8838-45bc-8cd8-5a50b5f72409 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1335 microversion: 2.54 time: 0.292529 Oct 12 13:28:21.893421 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 755/1460] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:21 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1335 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:22.294901 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1ffa80b2-e232-43f0-97c4-bba7ba921f44 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:22.295706 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-1ffa80b2-e232-43f0-97c4-bba7ba921f44 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:22.314801 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1ffa80b2-e232-43f0-97c4-bba7ba921f44 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:22.315309 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1ffa80b2-e232-43f0-97c4-bba7ba921f44 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:22.315969 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1ffa80b2-e232-43f0-97c4-bba7ba921f44 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:22.316700 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1ffa80b2-e232-43f0-97c4-bba7ba921f44 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:22.317737 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1ffa80b2-e232-43f0-97c4-bba7ba921f44 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:22.318185 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1ffa80b2-e232-43f0-97c4-bba7ba921f44 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:22.738305 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-383290bb-af85-4c38-a92f-a49db209f3db tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:22.747223 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-383290bb-af85-4c38-a92f-a49db209f3db tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1478 microversion: 2.1 time: 1.087287 Oct 12 13:28:22.764067 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 706/1461] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:21 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1478 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:28:22.922404 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7141893e-a226-4a99-8ce3-32a53182b603 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:22.923038 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7141893e-a226-4a99-8ce3-32a53182b603 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:22.939835 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7141893e-a226-4a99-8ce3-32a53182b603 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:22.939835 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7141893e-a226-4a99-8ce3-32a53182b603 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:22.939835 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7141893e-a226-4a99-8ce3-32a53182b603 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:22.939835 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7141893e-a226-4a99-8ce3-32a53182b603 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:22.940250 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7141893e-a226-4a99-8ce3-32a53182b603 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:22.940250 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7141893e-a226-4a99-8ce3-32a53182b603 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:23.116241 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-1ffa80b2-e232-43f0-97c4-bba7ba921f44 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:23.151473 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1ffa80b2-e232-43f0-97c4-bba7ba921f44 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 200 len: 1318 microversion: 2.1 time: 0.860210 Oct 12 13:28:23.152090 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 756/1462] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:22 2022] GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 1318 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:28:23.188111 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-7141893e-a226-4a99-8ce3-32a53182b603 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:23.211953 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-7141893e-a226-4a99-8ce3-32a53182b603 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:23.213172 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-7141893e-a226-4a99-8ce3-32a53182b603 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:23.220419 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7141893e-a226-4a99-8ce3-32a53182b603 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1335 microversion: 2.54 time: 0.323165 Oct 12 13:28:23.221317 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 707/1463] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:22 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1335 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:23.492081 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-261735db-4012-4655-b774-92cc24ab785f tempest-ServersTestFqdnHostnames-812441362 tempest-ServersTestFqdnHostnames-812441362-project] Action: 'create', calling method: .version_select at 0x7f8a9ba07ca0>, body: {"keypair": {"name": "tempest-keypair-1121561565", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxyu1PrKzGzWbsIaXOxNgRy0f+GD6xrvnsL16eCo9iyKmTa03VnD0M27krn4ECQEb2zrjUVY/q40dVlMj+S5CdTe0QGbJ6YHPClKJOghNfOcENWUEwcxzrCz2R80VGYnA=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:23.571336 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-261735db-4012-4655-b774-92cc24ab785f tempest-ServersTestFqdnHostnames-812441362 tempest-ServersTestFqdnHostnames-812441362-project] Getting quotas for project 09fadfcf2d854a5e88787f23c6bc4389. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:28:23.595981 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-261735db-4012-4655-b774-92cc24ab785f tempest-ServersTestFqdnHostnames-812441362 tempest-ServersTestFqdnHostnames-812441362-project] Getting quotas for user dace29defabb4226b305399567f646da and project 09fadfcf2d854a5e88787f23c6bc4389. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:28:23.756302 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-261735db-4012-4655-b774-92cc24ab785f tempest-ServersTestFqdnHostnames-812441362 tempest-ServersTestFqdnHostnames-812441362-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.419085 Oct 12 13:28:23.768077 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 757/1464] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:28:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:28:23.773016 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-26612d83-54e6-4d97-acde-3df8eec19415 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:23.778958 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-26612d83-54e6-4d97-acde-3df8eec19415 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:23.796291 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-26612d83-54e6-4d97-acde-3df8eec19415 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:23.796888 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-26612d83-54e6-4d97-acde-3df8eec19415 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:23.797636 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-26612d83-54e6-4d97-acde-3df8eec19415 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:23.798358 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-26612d83-54e6-4d97-acde-3df8eec19415 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:23.799025 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-26612d83-54e6-4d97-acde-3df8eec19415 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:23.799296 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-26612d83-54e6-4d97-acde-3df8eec19415 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:24.179313 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c2b9433a-a40c-4458-9ab4-e5ad478b8512 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:24.179982 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c2b9433a-a40c-4458-9ab4-e5ad478b8512 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:24.192875 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2b9433a-a40c-4458-9ab4-e5ad478b8512 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:24.193444 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2b9433a-a40c-4458-9ab4-e5ad478b8512 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:24.195428 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2b9433a-a40c-4458-9ab4-e5ad478b8512 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:24.196189 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2b9433a-a40c-4458-9ab4-e5ad478b8512 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:24.196657 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2b9433a-a40c-4458-9ab4-e5ad478b8512 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:24.197120 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c2b9433a-a40c-4458-9ab4-e5ad478b8512 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:24.642880 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-26612d83-54e6-4d97-acde-3df8eec19415 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:24.658889 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-26612d83-54e6-4d97-acde-3df8eec19415 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1478 microversion: 2.1 time: 0.890148 Oct 12 13:28:24.659480 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 708/1465] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:23 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1478 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:24.664750 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-925e37f0-e46c-4507-bfa5-40ece4b1f14a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:24.665597 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-925e37f0-e46c-4507-bfa5-40ece4b1f14a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:24.683529 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-925e37f0-e46c-4507-bfa5-40ece4b1f14a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:24.687151 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-925e37f0-e46c-4507-bfa5-40ece4b1f14a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:24.687567 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-925e37f0-e46c-4507-bfa5-40ece4b1f14a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:24.688513 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-925e37f0-e46c-4507-bfa5-40ece4b1f14a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:24.689192 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-925e37f0-e46c-4507-bfa5-40ece4b1f14a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:24.689986 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-925e37f0-e46c-4507-bfa5-40ece4b1f14a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:24.909667 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-925e37f0-e46c-4507-bfa5-40ece4b1f14a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:24.919574 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-925e37f0-e46c-4507-bfa5-40ece4b1f14a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:24.921139 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-925e37f0-e46c-4507-bfa5-40ece4b1f14a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:24.922811 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-925e37f0-e46c-4507-bfa5-40ece4b1f14a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1335 microversion: 2.54 time: 0.262170 Oct 12 13:28:24.924646 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 709/1466] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:24 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1335 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:24.940198 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-9a03a1a0-a2a2-4d91-9a67-12885ad017d1 req-7f4c7ec4-e920-4578-88b0-4bb5e0543328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed6ad20-8975-4ce5-b6b6-da604e6de75a", "tag": "d7975bf0-8638-44b5-8a0a-5ee6ef6227ef"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:24.953319 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-9a03a1a0-a2a2-4d91-9a67-12885ad017d1 req-7f4c7ec4-e920-4578-88b0-4bb5e0543328 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:24.954762 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-9a03a1a0-a2a2-4d91-9a67-12885ad017d1 req-7f4c7ec4-e920-4578-88b0-4bb5e0543328 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:24.955471 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-9a03a1a0-a2a2-4d91-9a67-12885ad017d1 req-7f4c7ec4-e920-4578-88b0-4bb5e0543328 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:24.969944 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-9a03a1a0-a2a2-4d91-9a67-12885ad017d1 req-7f4c7ec4-e920-4578-88b0-4bb5e0543328 service nova] Creating event network-changed:d7975bf0-8638-44b5-8a0a-5ee6ef6227ef for instance bed6ad20-8975-4ce5-b6b6-da604e6de75a on n-h2-861076-2 Oct 12 13:28:24.976546 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-9a03a1a0-a2a2-4d91-9a67-12885ad017d1 req-7f4c7ec4-e920-4578-88b0-4bb5e0543328 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046855 Oct 12 13:28:24.977864 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 710/1467] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:28:25.063851 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-c2b9433a-a40c-4458-9ab4-e5ad478b8512 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:25.076778 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c2b9433a-a40c-4458-9ab4-e5ad478b8512 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 200 len: 1318 microversion: 2.1 time: 0.899454 Oct 12 13:28:25.077609 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 758/1468] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:24 2022] GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 1318 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:25.689376 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2c7e67e1-2105-41e5-b0ad-77dd584e28bd tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:25.690097 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2c7e67e1-2105-41e5-b0ad-77dd584e28bd tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:25.711071 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c7e67e1-2105-41e5-b0ad-77dd584e28bd tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:25.713107 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c7e67e1-2105-41e5-b0ad-77dd584e28bd tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:25.715607 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c7e67e1-2105-41e5-b0ad-77dd584e28bd tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:25.716474 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c7e67e1-2105-41e5-b0ad-77dd584e28bd tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:25.721424 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c7e67e1-2105-41e5-b0ad-77dd584e28bd tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:25.721892 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c7e67e1-2105-41e5-b0ad-77dd584e28bd tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:25.953739 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-dde83253-1393-4aa0-bf0d-545273b5eabd tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:25.954212 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-dde83253-1393-4aa0-bf0d-545273b5eabd tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:25.963257 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dde83253-1393-4aa0-bf0d-545273b5eabd tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:25.963763 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dde83253-1393-4aa0-bf0d-545273b5eabd tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:25.964199 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dde83253-1393-4aa0-bf0d-545273b5eabd tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:25.971787 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dde83253-1393-4aa0-bf0d-545273b5eabd tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:25.972677 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dde83253-1393-4aa0-bf0d-545273b5eabd tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:25.973339 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dde83253-1393-4aa0-bf0d-545273b5eabd tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:26.343459 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-dde83253-1393-4aa0-bf0d-545273b5eabd tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:26.359074 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-dde83253-1393-4aa0-bf0d-545273b5eabd tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:26.359074 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-dde83253-1393-4aa0-bf0d-545273b5eabd tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:26.359955 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-dde83253-1393-4aa0-bf0d-545273b5eabd tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1356 microversion: 2.54 time: 0.412226 Oct 12 13:28:26.370952 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 759/1469] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:25 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1356 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:28:26.374227 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:28:26.393077 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b2487746-0f7f-4947-8c82-1c74c1598356 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:26.394289 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-b2487746-0f7f-4947-8c82-1c74c1598356 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:26.418136 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b2487746-0f7f-4947-8c82-1c74c1598356 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:26.418749 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b2487746-0f7f-4947-8c82-1c74c1598356 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:26.419465 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b2487746-0f7f-4947-8c82-1c74c1598356 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:26.420266 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b2487746-0f7f-4947-8c82-1c74c1598356 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:26.420791 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b2487746-0f7f-4947-8c82-1c74c1598356 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:26.421586 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b2487746-0f7f-4947-8c82-1c74c1598356 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:26.879653 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-2c7e67e1-2105-41e5-b0ad-77dd584e28bd tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:26.897514 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:28:26.906412 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2c7e67e1-2105-41e5-b0ad-77dd584e28bd tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1478 microversion: 2.1 time: 1.220016 Oct 12 13:28:26.907868 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 711/1470] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:25 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1478 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:26.917377 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1c59e2b8-84f4-44f2-85ed-84eaba6bf4c3 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Action: 'create', calling method: .version_select at 0x7f8a9b933040>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-117988738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClLp7oxZ0ZcFk/RXlj9pI8MyQbzeCfTX8PlZfVfdzkwqg+k9QKlBwWOecGglTUCygGM0ohXbEfNVizCl4b+CNtw5/QyEJETK/3YisuSUyfFIAK3gipOaPhTLMfCiyAeIA=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:26.963406 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-1c59e2b8-84f4-44f2-85ed-84eaba6bf4c3 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Getting quotas for project b4ba65a035db4858b8f0d5660068b8c0. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:28:26.970136 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-1c59e2b8-84f4-44f2-85ed-84eaba6bf4c3 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Getting quotas for user 7d171ca393964f568d0693923b7b37eb and project b4ba65a035db4858b8f0d5660068b8c0. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:28:27.086725 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1c59e2b8-84f4-44f2-85ed-84eaba6bf4c3 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.177161 Oct 12 13:28:27.087506 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 712/1471] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Oct 12 13:28:26 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 179 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 13:28:27.099249 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-2b8c0d71-fc1e-42a1-84fc-d884966daaef req-c40dcfb2-ebc0-49cb-b615-aa5b575436c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fbda837-cf92-4aa6-8551-96cd4a3f1b80", "name": "network-vif-plugged", "status": "completed", "tag": "cf85a1bd-8e0c-48d6-9580-9faf6388ba80"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:27.125243 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b2487746-0f7f-4947-8c82-1c74c1598356 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:27.139152 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-2b8c0d71-fc1e-42a1-84fc-d884966daaef req-c40dcfb2-ebc0-49cb-b615-aa5b575436c5 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:27.139630 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-2b8c0d71-fc1e-42a1-84fc-d884966daaef req-c40dcfb2-ebc0-49cb-b615-aa5b575436c5 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:27.140239 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b2487746-0f7f-4947-8c82-1c74c1598356 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 200 len: 1318 microversion: 2.1 time: 0.764676 Oct 12 13:28:27.141409 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 760/1472] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:26 2022] GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 1318 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:27.146385 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-2b8c0d71-fc1e-42a1-84fc-d884966daaef req-c40dcfb2-ebc0-49cb-b615-aa5b575436c5 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:27.159396 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7ba55666-3e78-46d4-9a6a-247d1ec3200c tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-117988738", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:27.169880 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7ba55666-3e78-46d4-9a6a-247d1ec3200c tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:27.179876 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-2b8c0d71-fc1e-42a1-84fc-d884966daaef req-c40dcfb2-ebc0-49cb-b615-aa5b575436c5 service nova] Creating event network-vif-plugged:cf85a1bd-8e0c-48d6-9580-9faf6388ba80 for instance 3fbda837-cf92-4aa6-8551-96cd4a3f1b80 on n-h1-861076-2 Oct 12 13:28:27.180192 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=3,nova_api:INSERT=7 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:28:27.190092 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-2b8c0d71-fc1e-42a1-84fc-d884966daaef req-c40dcfb2-ebc0-49cb-b615-aa5b575436c5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101292 Oct 12 13:28:27.192458 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 713/1473] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:28:27.192686 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7ba55666-3e78-46d4-9a6a-247d1ec3200c tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:27.193991 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7ba55666-3e78-46d4-9a6a-247d1ec3200c tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:27.203744 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7ba55666-3e78-46d4-9a6a-247d1ec3200c tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:27.204525 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7ba55666-3e78-46d4-9a6a-247d1ec3200c tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:27.214489 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7ba55666-3e78-46d4-9a6a-247d1ec3200c tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:27.215215 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7ba55666-3e78-46d4-9a6a-247d1ec3200c tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:27.415335 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-7ba55666-3e78-46d4-9a6a-247d1ec3200c tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:28:27.416170 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-7ba55666-3e78-46d4-9a6a-247d1ec3200c tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:28:27.416867 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-7ba55666-3e78-46d4-9a6a-247d1ec3200c tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:28:27.417769 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-7ba55666-3e78-46d4-9a6a-247d1ec3200c tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:28:27.418365 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-7ba55666-3e78-46d4-9a6a-247d1ec3200c tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:28:27.727797 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7ba55666-3e78-46d4-9a6a-247d1ec3200c tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:27.759352 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7ba55666-3e78-46d4-9a6a-247d1ec3200c tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:27.760124 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7ba55666-3e78-46d4-9a6a-247d1ec3200c tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:27.761456 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7ba55666-3e78-46d4-9a6a-247d1ec3200c tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:27.764706 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7ba55666-3e78-46d4-9a6a-247d1ec3200c tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:27.765597 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7ba55666-3e78-46d4-9a6a-247d1ec3200c tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:27.766693 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7ba55666-3e78-46d4-9a6a-247d1ec3200c tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:27.816099 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-7ba55666-3e78-46d4-9a6a-247d1ec3200c tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "POST /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f/action" status: 202 len: 1138 microversion: 2.54 time: 0.673202 Oct 12 13:28:27.820044 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 761/1474] 10.222.0.52 () {62 vars in 1320 bytes} [Wed Oct 12 13:28:27 2022] POST /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f/action => generated 1138 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 12 13:28:27.858543 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-361f98e5-7826-44b8-b3a6-894dc1282145 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:27.863797 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-361f98e5-7826-44b8-b3a6-894dc1282145 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:27.880484 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-361f98e5-7826-44b8-b3a6-894dc1282145 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:27.883275 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-361f98e5-7826-44b8-b3a6-894dc1282145 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:27.883926 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-361f98e5-7826-44b8-b3a6-894dc1282145 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:27.888710 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-361f98e5-7826-44b8-b3a6-894dc1282145 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:27.889520 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-361f98e5-7826-44b8-b3a6-894dc1282145 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:27.897713 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-361f98e5-7826-44b8-b3a6-894dc1282145 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:27.938457 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-00f32747-44d3-4dc6-a1db-71d3d08d6a76 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:27.939464 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-00f32747-44d3-4dc6-a1db-71d3d08d6a76 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:27.955889 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-00f32747-44d3-4dc6-a1db-71d3d08d6a76 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:27.957309 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-00f32747-44d3-4dc6-a1db-71d3d08d6a76 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:27.958108 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-00f32747-44d3-4dc6-a1db-71d3d08d6a76 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:27.960971 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-00f32747-44d3-4dc6-a1db-71d3d08d6a76 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:27.960971 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-00f32747-44d3-4dc6-a1db-71d3d08d6a76 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:27.960971 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-00f32747-44d3-4dc6-a1db-71d3d08d6a76 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:28.092460 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-361f98e5-7826-44b8-b3a6-894dc1282145 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:28.102488 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-361f98e5-7826-44b8-b3a6-894dc1282145 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:28.104754 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-361f98e5-7826-44b8-b3a6-894dc1282145 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:28.108153 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-361f98e5-7826-44b8-b3a6-894dc1282145 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1407 microversion: 2.54 time: 0.267093 Oct 12 13:28:28.110839 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 714/1475] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:27 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1407 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:28:28.168672 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6ae5ced2-066c-48c5-8b35-d76fb1077416 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:28.169269 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6ae5ced2-066c-48c5-8b35-d76fb1077416 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:28.179045 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ae5ced2-066c-48c5-8b35-d76fb1077416 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:28.179551 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ae5ced2-066c-48c5-8b35-d76fb1077416 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:28.180000 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ae5ced2-066c-48c5-8b35-d76fb1077416 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:28.180713 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ae5ced2-066c-48c5-8b35-d76fb1077416 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:28.181194 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ae5ced2-066c-48c5-8b35-d76fb1077416 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:28.181619 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ae5ced2-066c-48c5-8b35-d76fb1077416 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:28.655490 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-00f32747-44d3-4dc6-a1db-71d3d08d6a76 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:28.666055 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-00f32747-44d3-4dc6-a1db-71d3d08d6a76 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1478 microversion: 2.1 time: 0.734116 Oct 12 13:28:28.670387 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 762/1476] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:27 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1478 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:28.736464 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-6ae5ced2-066c-48c5-8b35-d76fb1077416 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:28.751347 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6ae5ced2-066c-48c5-8b35-d76fb1077416 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 200 len: 1318 microversion: 2.1 time: 0.585670 Oct 12 13:28:28.765898 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 715/1477] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:28 2022] GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 1318 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:28:29.135658 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-99e24fb4-bbc9-4ee5-af34-07fc2a4f1517 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:29.136306 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-99e24fb4-bbc9-4ee5-af34-07fc2a4f1517 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:29.154812 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-99e24fb4-bbc9-4ee5-af34-07fc2a4f1517 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:29.165113 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-99e24fb4-bbc9-4ee5-af34-07fc2a4f1517 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:29.165733 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-99e24fb4-bbc9-4ee5-af34-07fc2a4f1517 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:29.169655 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-99e24fb4-bbc9-4ee5-af34-07fc2a4f1517 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:29.173234 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-99e24fb4-bbc9-4ee5-af34-07fc2a4f1517 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:29.176810 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-99e24fb4-bbc9-4ee5-af34-07fc2a4f1517 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:29.490313 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-99e24fb4-bbc9-4ee5-af34-07fc2a4f1517 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:29.511991 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-99e24fb4-bbc9-4ee5-af34-07fc2a4f1517 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:29.511991 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-99e24fb4-bbc9-4ee5-af34-07fc2a4f1517 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:29.515739 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-99e24fb4-bbc9-4ee5-af34-07fc2a4f1517 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1407 microversion: 2.54 time: 0.380134 Oct 12 13:28:29.520846 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 763/1478] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:29 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1407 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:29.703348 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d132445c-cc85-49e7-9363-bb3109b4bb6d tempest-ServersNegativeTestJSON-753932147 tempest-ServersNegativeTestJSON-753932147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-338342953", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "681528a1-41bb-47c5-a625-bc33666a1d4b"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:29.808689 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-d132445c-cc85-49e7-9363-bb3109b4bb6d tempest-ServersNegativeTestJSON-753932147 tempest-ServersNegativeTestJSON-753932147-project] validate_networks() for [('681528a1-41bb-47c5-a625-bc33666a1d4b', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:28:29.839428 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0f0ebca7-41ef-4c06-aedb-84c116010e28 tempest-FloatingIPsAssociationNegativeTestJSON-1116577060 tempest-FloatingIPsAssociationNegativeTestJSON-1116577060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-387987167", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "94cc4b5a-f773-4c41-b84d-1ddbd7c148cb"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:29.939826 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-0f0ebca7-41ef-4c06-aedb-84c116010e28 tempest-FloatingIPsAssociationNegativeTestJSON-1116577060 tempest-FloatingIPsAssociationNegativeTestJSON-1116577060-project] validate_networks() for [('94cc4b5a-f773-4c41-b84d-1ddbd7c148cb', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:28:30.718700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-d132445c-cc85-49e7-9363-bb3109b4bb6d tempest-ServersNegativeTestJSON-753932147 tempest-ServersNegativeTestJSON-753932147-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bcc47080-a711-480e-bcf1-810711fd6233) Oct 12 13:28:30.718700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:30.718700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:28:30.718700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:28:30.718700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:30.718700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:30.718700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:30.718700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:30.718700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:30.718700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:30.718700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:28:30.718700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:28:30.718700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:28:30.718700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:28:30.718700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:28:30.718700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:28:30.721747 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:28:30.721747 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:28:30.721747 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:28:30.721747 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:28:30.721747 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:28:30.721747 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:28:30.721747 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:28:30.721747 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:28:30.721747 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:28:30.721747 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:28:30.721747 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:28:30.721747 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:30.721747 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:30.721747 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:28:30.721747 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:28:30.721747 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:30.721747 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:30.721747 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:28:30.723073 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:28:30.723073 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:30.723073 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:30.723073 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:28:30.723073 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:28:30.723073 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:30.723073 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:30.723073 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:28:30.723073 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:28:30.723073 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:28:30.723073 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:28:30.723073 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:28:30.723073 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:28:30.723073 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:28:30.723073 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:28:30.723073 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:28:30.723073 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:28:30.723073 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:28:30.724386 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:28:30.724386 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:28:30.724386 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:28:30.724386 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:28:30.724386 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:28:30.724386 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:28:30.724386 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:28:30.724386 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:28:30.724386 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:28:30.724386 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:28:30.724386 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:28:30.724386 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:28:30.724386 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:28:30.724386 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:28:30.724386 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:28:30.726603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bcc47080-a711-480e-bcf1-810711fd6233) Oct 12 13:28:30.726603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:30.726603 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-d132445c-cc85-49e7-9363-bb3109b4bb6d tempest-ServersNegativeTestJSON-753932147 tempest-ServersNegativeTestJSON-753932147-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:30.726603 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:28:30.729578 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d132445c-cc85-49e7-9363-bb3109b4bb6d tempest-ServersNegativeTestJSON-753932147 tempest-ServersNegativeTestJSON-753932147-project] Request method failure captured: Oct 12 13:28:30.729578 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:28:30.729578 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:28:30.729578 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:28:30.729578 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:28:30.729578 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 208 Oct 12 13:28:30.729578 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:28:30.729578 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:28:30.729578 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:28:30.729578 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:28:30.729578 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsD95B5agtTUFUDr61Hel6TAa7XFgP8beFOyRlwbLKJTpjmDsYWZe_C-ZyQXYUxjy4Zj3h8rS-QOKdEsA1UikvZWdiIde7GJJ_p5XMH3masQG9bWhrmeBDMnlAnBYIVCeBVHKOp_U9gwKS0RakjhyzzO3tE8bBvXI0upGhHfxxKLKSU Oct 12 13:28:30.729578 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:28:30.729578 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:28:30.729578 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:28:30.729578 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:28:30.729578 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:28:30.729578 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:28:30.729578 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 14a909451d974275a0aaa8eb8e01b8b2 Oct 12 13:28:30.729578 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServersNegativeTestJSON-753932147 Oct 12 13:28:30.729578 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:28:30.729578 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:28:30.731202 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/14a909451d974275a0aaa8eb8e01b8b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_14a909451d974275a0aaa8eb8e01b8b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/14a909451d974275a0aaa8eb8e01b8b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/14a909451d974275a0aaa8eb8e01b8b2"}]}] Oct 12 13:28:30.731202 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServersNegativeTestJSON-753932147 Oct 12 13:28:30.731202 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 14a909451d974275a0aaa8eb8e01b8b2 Oct 12 13:28:30.731202 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServersNegativeTestJSON-753932147 Oct 12 13:28:30.731202 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServersNegativeTestJSON-753932147-project Oct 12 13:28:30.731202 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:28:30.731202 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:28:30.731202 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 9c42cbae070348b3b21eb84577b38b92 Oct 12 13:28:30.731202 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServersNegativeTestJSON-753932147-project Oct 12 13:28:30.731202 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:28:30.731202 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-338342953", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "681528a1-41bb-47c5-a625-bc33666a1d4b"}]}} Oct 12 13:28:30.732018 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:28:30.732018 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:30.732018 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:28:30.732018 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-338342953', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '681528a1-41bb-47c5-a625-bc33666a1d4b'}]}}} Oct 12 13:28:30.732018 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:28:30.732018 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:30.732018 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:28:30.732018 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:28:30.732018 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:30.732018 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:30.732018 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:30.732018 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:30.732018 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:30.732018 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:30.732018 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:28:30.732018 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:28:30.732018 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:28:30.732018 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:28:30.732018 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:28:30.733391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:28:30.733391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:28:30.733391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:28:30.733391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:28:30.733391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:28:30.733391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:28:30.733391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:28:30.733391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:28:30.733391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:28:30.733391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:28:30.733391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:28:30.733391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:28:30.733391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:30.733391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:30.733391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:28:30.733391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:28:30.733391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:30.733391 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:30.736114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:28:30.736114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:28:30.736114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:30.736114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:30.736114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:28:30.736114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:28:30.736114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:30.736114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:30.736114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:28:30.736114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:28:30.736114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:28:30.736114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:28:30.736114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:28:30.736114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:28:30.736114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:28:30.736114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:28:30.736114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:28:30.736114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:28:30.738462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:28:30.738462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:28:30.738462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:28:30.738462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:28:30.738462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:28:30.738462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:28:30.738462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:28:30.738462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:28:30.738462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:28:30.738462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:28:30.738462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:28:30.738462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:28:30.738462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:28:30.738462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:28:30.738462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:28:30.738462 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:28:30.740356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bcc47080-a711-480e-bcf1-810711fd6233) Oct 12 13:28:30.740356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:30.740356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:28:30.740356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:30.740356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:30.740356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:28:30.740356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:28:30.740356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:28:30.740356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:28:30.740356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:28:30.740356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:28:30.740356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:30.740356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:30.740356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:30.740356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:28:30.740356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:30.740356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:30.740356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:28:30.740356 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:28:30.749398 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:28:30.749398 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:28:30.749398 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:30.749398 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:30.749398 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:30.749398 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d132445c-cc85-49e7-9363-bb3109b4bb6d tempest-ServersNegativeTestJSON-753932147 tempest-ServersNegativeTestJSON-753932147-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:30.749398 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:28:30.749398 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d132445c-cc85-49e7-9363-bb3109b4bb6d tempest-ServersNegativeTestJSON-753932147 tempest-ServersNegativeTestJSON-753932147-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.227641 Oct 12 13:28:30.749398 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 764/1479] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:28:29 2022] POST /compute/v2.1/servers => generated 214 bytes in 1229 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:28:30.754523 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e3536e04-3cea-44f7-8714-b009d849e2f0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:30.755360 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-e3536e04-3cea-44f7-8714-b009d849e2f0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:30.763620 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e3536e04-3cea-44f7-8714-b009d849e2f0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:30.764295 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e3536e04-3cea-44f7-8714-b009d849e2f0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:30.764889 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e3536e04-3cea-44f7-8714-b009d849e2f0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:30.766507 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e3536e04-3cea-44f7-8714-b009d849e2f0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:30.767211 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e3536e04-3cea-44f7-8714-b009d849e2f0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:30.767887 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e3536e04-3cea-44f7-8714-b009d849e2f0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:30.903856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-0f0ebca7-41ef-4c06-aedb-84c116010e28 tempest-FloatingIPsAssociationNegativeTestJSON-1116577060 tempest-FloatingIPsAssociationNegativeTestJSON-1116577060-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-281c20cf-4fa6-4e1e-a6d5-67728b40fdfc) Oct 12 13:28:30.903856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:30.903856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:28:30.903856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:28:30.903856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:30.903856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:30.903856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:30.903856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:30.903856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:30.903856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:30.903856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:28:30.903856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:28:30.903856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:28:30.903856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:28:30.903856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:28:30.903856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:28:30.905428 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:28:30.905428 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:28:30.905428 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:28:30.905428 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:28:30.905428 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:28:30.905428 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:28:30.905428 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:28:30.905428 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:28:30.905428 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:28:30.905428 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:28:30.905428 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:28:30.905428 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:30.905428 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:30.905428 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:28:30.905428 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:28:30.905428 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:30.905428 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:30.905428 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:28:30.907306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:28:30.907306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:30.907306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:30.907306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:28:30.907306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:28:30.907306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:30.907306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:30.907306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:28:30.907306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:28:30.907306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:28:30.907306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:28:30.907306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:28:30.907306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:28:30.907306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:28:30.907306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:28:30.907306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:28:30.907306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:28:30.907306 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:28:30.908608 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:28:30.908608 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:28:30.908608 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:28:30.908608 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:28:30.908608 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:28:30.908608 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:28:30.908608 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:28:30.908608 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:28:30.908608 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:28:30.908608 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:28:30.908608 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:28:30.908608 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:28:30.908608 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:28:30.908608 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:28:30.908608 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:28:30.910615 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-281c20cf-4fa6-4e1e-a6d5-67728b40fdfc) Oct 12 13:28:30.910615 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:28:30.911971 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-0f0ebca7-41ef-4c06-aedb-84c116010e28 tempest-FloatingIPsAssociationNegativeTestJSON-1116577060 tempest-FloatingIPsAssociationNegativeTestJSON-1116577060-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:30.911971 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:28:30.914651 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0f0ebca7-41ef-4c06-aedb-84c116010e28 tempest-FloatingIPsAssociationNegativeTestJSON-1116577060 tempest-FloatingIPsAssociationNegativeTestJSON-1116577060-project] Request method failure captured: Oct 12 13:28:30.914651 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:28:30.914651 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:28:30.914651 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:28:30.914651 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:28:30.914651 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 223 Oct 12 13:28:30.914651 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:28:30.914651 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:28:30.914651 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:28:30.914651 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:28:30.914651 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsD9lB9MxV0-6OWjPpG_M0-BHcyhsmSJotCmBs2w3OzGm1zT_M9VCmelAr38FkwJKtA3RF7K4tikfdoRKC8MohOnJZLDKEovWmBaJMevjVpjpORff3d8ARnaNeiSs88vDSu2Wf2B6XMtqL0-LCp4gfUPifhzB-p-NuCaIGekmQ8PYYU Oct 12 13:28:30.914651 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:28:30.914651 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:28:30.914651 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:28:30.914651 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:28:30.914651 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:28:30.914651 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:28:30.914651 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: f9410c82df97417aaf46bc09754f3ef6 Oct 12 13:28:30.914651 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1116577060 Oct 12 13:28:30.914651 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:28:30.914651 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:28:30.919397 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9410c82df97417aaf46bc09754f3ef6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9410c82df97417aaf46bc09754f3ef6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9410c82df97417aaf46bc09754f3ef6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9410c82df97417aaf46bc09754f3ef6"}]}] Oct 12 13:28:30.919397 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1116577060 Oct 12 13:28:30.919397 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: f9410c82df97417aaf46bc09754f3ef6 Oct 12 13:28:30.919397 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1116577060 Oct 12 13:28:30.919397 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1116577060-project Oct 12 13:28:30.919397 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:28:30.919397 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:28:30.919397 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 6532cac56ba54e6194bdb286f9213ac5 Oct 12 13:28:30.919397 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1116577060-project Oct 12 13:28:30.919397 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:28:30.919397 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-387987167", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "94cc4b5a-f773-4c41-b84d-1ddbd7c148cb"}]}} Oct 12 13:28:30.920373 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:28:30.920373 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:30.920373 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:28:30.920373 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-server-387987167', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '94cc4b5a-f773-4c41-b84d-1ddbd7c148cb'}]}}} Oct 12 13:28:30.920373 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:28:30.920373 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:30.920373 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:28:30.920373 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:28:30.920373 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:30.920373 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:30.920373 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:30.920373 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:30.920373 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:30.920373 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:30.920373 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:28:30.920373 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:28:30.920373 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:28:30.920373 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:28:30.920373 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:28:30.922064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:28:30.922064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:28:30.922064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:28:30.922064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:28:30.922064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:28:30.922064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:28:30.922064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:28:30.922064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:28:30.922064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:28:30.922064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:28:30.922064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:28:30.922064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:28:30.922064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:30.922064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:30.922064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:28:30.922064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:28:30.922064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:30.922064 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:30.923714 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:28:30.923714 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:28:30.923714 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:30.923714 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:30.923714 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:28:30.923714 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:28:30.923714 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:30.923714 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:30.923714 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:28:30.923714 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:28:30.923714 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:28:30.923714 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:28:30.923714 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:28:30.923714 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:28:30.923714 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:28:30.923714 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:28:30.923714 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:28:30.923714 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:28:30.925307 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:28:30.925307 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:28:30.925307 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:28:30.925307 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:28:30.925307 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:28:30.925307 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:28:30.925307 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:28:30.925307 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:28:30.925307 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:28:30.925307 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:28:30.925307 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:28:30.925307 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:28:30.925307 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:28:30.925307 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:28:30.925307 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:28:30.925307 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:28:30.926534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-281c20cf-4fa6-4e1e-a6d5-67728b40fdfc) Oct 12 13:28:30.926534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:28:30.926534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:28:30.926534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:28:30.926534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:30.926534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:28:30.926534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:28:30.926534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:28:30.926534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:28:30.926534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:28:30.926534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:28:30.926534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:30.926534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:28:30.926534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:28:30.926534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:28:30.926534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:28:30.926534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:30.926534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:28:30.926534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:28:30.930311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:28:30.930311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:28:30.930311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:30.930311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:28:30.930311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:28:30.930311 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0f0ebca7-41ef-4c06-aedb-84c116010e28 tempest-FloatingIPsAssociationNegativeTestJSON-1116577060 tempest-FloatingIPsAssociationNegativeTestJSON-1116577060-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:30.930311 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:28:30.930311 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0f0ebca7-41ef-4c06-aedb-84c116010e28 tempest-FloatingIPsAssociationNegativeTestJSON-1116577060 tempest-FloatingIPsAssociationNegativeTestJSON-1116577060-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.463579 Oct 12 13:28:30.930311 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 716/1480] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:28:29 2022] POST /compute/v2.1/servers => generated 214 bytes in 1465 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:28:30.940664 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a9515adb-9fcd-4016-ab54-266fc1f3b7bb tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:30.944840 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a9515adb-9fcd-4016-ab54-266fc1f3b7bb tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:30.961749 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a9515adb-9fcd-4016-ab54-266fc1f3b7bb tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:30.964200 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a9515adb-9fcd-4016-ab54-266fc1f3b7bb tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:30.964841 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a9515adb-9fcd-4016-ab54-266fc1f3b7bb tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:30.965857 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a9515adb-9fcd-4016-ab54-266fc1f3b7bb tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:30.967847 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a9515adb-9fcd-4016-ab54-266fc1f3b7bb tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:30.970645 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a9515adb-9fcd-4016-ab54-266fc1f3b7bb tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:32.010505 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-a9515adb-9fcd-4016-ab54-266fc1f3b7bb tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:32.025425 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a9515adb-9fcd-4016-ab54-266fc1f3b7bb tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 200 len: 1318 microversion: 2.1 time: 1.096467 Oct 12 13:28:32.027334 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 717/1481] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:30 2022] GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 1318 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:32.046218 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ce4660a1-00a2-4883-8a9c-05a5b2f3f740 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:32.048580 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ce4660a1-00a2-4883-8a9c-05a5b2f3f740 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:32.058515 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ce4660a1-00a2-4883-8a9c-05a5b2f3f740 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:32.059374 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ce4660a1-00a2-4883-8a9c-05a5b2f3f740 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:32.060855 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ce4660a1-00a2-4883-8a9c-05a5b2f3f740 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:32.061835 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ce4660a1-00a2-4883-8a9c-05a5b2f3f740 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:32.062375 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ce4660a1-00a2-4883-8a9c-05a5b2f3f740 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:32.063592 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ce4660a1-00a2-4883-8a9c-05a5b2f3f740 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:32.092587 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e3536e04-3cea-44f7-8714-b009d849e2f0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:32.113819 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:28:32.125930 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e3536e04-3cea-44f7-8714-b009d849e2f0 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1463 microversion: 2.1 time: 1.377367 Oct 12 13:28:32.126518 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 765/1482] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:30 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1463 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:32.144810 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fa45fb88-63c8-41d9-a1a7-f9683a1c9587 tempest-ServersTestFqdnHostnames-812441362 tempest-ServersTestFqdnHostnames-812441362-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "b3602770-f60a-49a9-b4b5-10fe2ccaa227"}], "security_groups": [{"name": "tempest-securitygroup--1233113607"}], "key_name": "tempest-keypair-1121561565", "user_data": "}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:32.296199 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-ce4660a1-00a2-4883-8a9c-05a5b2f3f740 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:32.306077 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-ce4660a1-00a2-4883-8a9c-05a5b2f3f740 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:32.308116 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-ce4660a1-00a2-4883-8a9c-05a5b2f3f740 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:32.309667 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ce4660a1-00a2-4883-8a9c-05a5b2f3f740 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1407 microversion: 2.54 time: 0.281024 Oct 12 13:28:32.310406 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 718/1483] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:32 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:32.338595 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fa8d2050-3259-4aae-8402-e07361526ff1 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:32.342091 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fa8d2050-3259-4aae-8402-e07361526ff1 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:32.348727 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa8d2050-3259-4aae-8402-e07361526ff1 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:32.349776 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa8d2050-3259-4aae-8402-e07361526ff1 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:32.350505 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa8d2050-3259-4aae-8402-e07361526ff1 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:32.351860 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa8d2050-3259-4aae-8402-e07361526ff1 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:32.352516 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa8d2050-3259-4aae-8402-e07361526ff1 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:32.353144 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa8d2050-3259-4aae-8402-e07361526ff1 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:32.487607 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-fa45fb88-63c8-41d9-a1a7-f9683a1c9587 tempest-ServersTestFqdnHostnames-812441362 tempest-ServersTestFqdnHostnames-812441362-project] validate_networks() for [('b3602770-f60a-49a9-b4b5-10fe2ccaa227', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:28:32.712626 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fa8d2050-3259-4aae-8402-e07361526ff1 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80/action" status: 202 len: 0 microversion: 2.1 time: 0.378189 Oct 12 13:28:32.713595 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 719/1484] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:28:32 2022] POST /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:28:32.728279 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3ea5fe13-0da3-470d-8638-08808baba009 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:32.729142 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3ea5fe13-0da3-470d-8638-08808baba009 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:32.739234 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ea5fe13-0da3-470d-8638-08808baba009 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:32.740312 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ea5fe13-0da3-470d-8638-08808baba009 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:32.741436 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ea5fe13-0da3-470d-8638-08808baba009 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:32.743918 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ea5fe13-0da3-470d-8638-08808baba009 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:32.744659 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ea5fe13-0da3-470d-8638-08808baba009 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:32.746749 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ea5fe13-0da3-470d-8638-08808baba009 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:32.846075 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ea5fe13-0da3-470d-8638-08808baba009 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:32.857226 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ea5fe13-0da3-470d-8638-08808baba009 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:32.858002 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ea5fe13-0da3-470d-8638-08808baba009 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:32.858477 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-3ea5fe13-0da3-470d-8638-08808baba009 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lazy-loading 'fault' on Instance uuid 3fbda837-cf92-4aa6-8551-96cd4a3f1b80 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:28:33.262005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-fa45fb88-63c8-41d9-a1a7-f9683a1c9587 tempest-ServersTestFqdnHostnames-812441362 tempest-ServersTestFqdnHostnames-812441362-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8e246642-96e1-4fe3-9b07-c16a98277c5d) Oct 12 13:28:33.262005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:33.262005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:28:33.262005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:28:33.262005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:33.262005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:33.262005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:33.262005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:33.262005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:33.262005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:33.262005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:28:33.262005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:28:33.262005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:28:33.262005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:28:33.262005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:28:33.262005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:28:33.263837 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:28:33.263837 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:28:33.263837 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:28:33.263837 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:28:33.263837 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:28:33.263837 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:28:33.263837 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:28:33.263837 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:28:33.263837 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:28:33.263837 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:28:33.263837 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:28:33.263837 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:33.263837 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:33.263837 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:28:33.263837 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:28:33.263837 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:33.263837 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:33.263837 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:28:33.265269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:28:33.265269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:33.265269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:33.265269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:28:33.265269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:28:33.265269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:33.265269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:33.265269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:28:33.265269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:28:33.265269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:28:33.265269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:28:33.265269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:28:33.265269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:28:33.265269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:28:33.265269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:28:33.265269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:28:33.265269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:28:33.265269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:28:33.267598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:28:33.267598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:28:33.267598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:28:33.267598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:28:33.267598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:28:33.267598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:28:33.267598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:28:33.267598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:28:33.267598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:28:33.267598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:28:33.267598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:28:33.267598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:28:33.267598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:28:33.267598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:28:33.267598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8e246642-96e1-4fe3-9b07-c16a98277c5d) Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-fa45fb88-63c8-41d9-a1a7-f9683a1c9587 tempest-ServersTestFqdnHostnames-812441362 tempest-ServersTestFqdnHostnames-812441362-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fa45fb88-63c8-41d9-a1a7-f9683a1c9587 tempest-ServersTestFqdnHostnames-812441362 tempest-ServersTestFqdnHostnames-812441362-project] Request method failure captured: Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 499 Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsD3QI2d_w6jBxtzYGzaWWIVJcWD-cv3KBw7Rwmt7nSQ6L7G5iK58evbYUPx05OllZsudGLVqM1nYtEPDKIEnumeh9_v_JzRHim3XQUyUdNnnZRt_TtW7HYdR65l_roedV8BLlx6lxa16ewuhorOOO7rIUwEHsn-GhfjdHwy73beOcI Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 09fadfcf2d854a5e88787f23c6bc4389 Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServersTestFqdnHostnames-812441362 Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:28:33.269594 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:28:33.272710 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09fadfcf2d854a5e88787f23c6bc4389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09fadfcf2d854a5e88787f23c6bc4389"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09fadfcf2d854a5e88787f23c6bc4389"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09fadfcf2d854a5e88787f23c6bc4389"}]}] Oct 12 13:28:33.272710 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServersTestFqdnHostnames-812441362 Oct 12 13:28:33.272710 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 09fadfcf2d854a5e88787f23c6bc4389 Oct 12 13:28:33.272710 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-812441362 Oct 12 13:28:33.272710 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServersTestFqdnHostnames-812441362-project Oct 12 13:28:33.272710 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:28:33.272710 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:28:33.272710 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: dace29defabb4226b305399567f646da Oct 12 13:28:33.272710 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServersTestFqdnHostnames-812441362-project Oct 12 13:28:33.272710 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:28:33.274401 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "I9*o4MMte_+qJ~3", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "b3602770-f60a-49a9-b4b5-10fe2ccaa227"}], "security_groups": [{"name": "tempest-securitygroup--1233113607"}], "key_name": "tempest-keypair-1121561565", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 12 13:28:33.274401 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:28:33.274401 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:33.274401 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:28:33.274401 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'guest-instance-1.domain.com', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'adminPass': 'I9*o4MMte_+qJ~3', 'networks': [{'uuid': 'b3602770-f60a-49a9-b4b5-10fe2ccaa227'}], 'security_groups': [{'name': 'tempest-securitygroup--1233113607'}], 'key_name': 'tempest-keypair-1121561565', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 12 13:28:33.274401 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:28:33.274401 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:33.274401 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:28:33.274401 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:28:33.274401 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:33.274401 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:33.274401 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:33.275968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:33.275968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:33.275968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:33.275968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:28:33.275968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:28:33.275968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:28:33.275968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:28:33.275968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:28:33.275968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:28:33.275968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:28:33.275968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:28:33.275968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:28:33.275968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:28:33.275968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:28:33.275968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:28:33.275968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:28:33.275968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:28:33.275968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:28:33.275968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:28:33.278184 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:28:33.278184 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:33.278184 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:33.278184 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:28:33.278184 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:28:33.278184 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:33.278184 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:33.278184 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:28:33.278184 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:28:33.278184 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:33.278184 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:33.278184 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:28:33.278184 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:28:33.278184 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:33.278184 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:33.278184 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:28:33.278184 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:28:33.278184 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:28:33.279968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:28:33.279968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:28:33.279968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:28:33.279968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:28:33.279968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:28:33.279968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:28:33.279968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:28:33.279968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:28:33.279968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:28:33.279968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:28:33.279968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:28:33.279968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:28:33.279968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:28:33.279968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:28:33.279968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:28:33.279968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:28:33.279968 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:28:33.283849 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:28:33.283849 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:28:33.283849 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:28:33.283849 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:28:33.283849 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:28:33.283849 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:28:33.283849 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8e246642-96e1-4fe3-9b07-c16a98277c5d) Oct 12 13:28:33.283849 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:33.283849 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:28:33.283849 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:33.283849 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:33.283849 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:28:33.283849 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:28:33.283849 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:28:33.283849 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:28:33.283849 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:28:33.283849 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:28:33.296217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:33.296217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:33.296217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:33.296217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:28:33.296217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:33.296217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:33.296217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:28:33.296217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:28:33.296217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:28:33.296217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:28:33.296217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:33.296217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:33.296217 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:33.296217 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fa45fb88-63c8-41d9-a1a7-f9683a1c9587 tempest-ServersTestFqdnHostnames-812441362 tempest-ServersTestFqdnHostnames-812441362-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:33.296217 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:28:33.299641 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fa45fb88-63c8-41d9-a1a7-f9683a1c9587 tempest-ServersTestFqdnHostnames-812441362 tempest-ServersTestFqdnHostnames-812441362-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.132949 Oct 12 13:28:33.299641 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 766/1485] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:28:32 2022] POST /compute/v2.1/servers => generated 214 bytes in 1141 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:28:33.299641 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cd16dee5-cfd7-43b0-b202-486a9aa20be9 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:33.299641 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-cd16dee5-cfd7-43b0-b202-486a9aa20be9 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:33.312461 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cd16dee5-cfd7-43b0-b202-486a9aa20be9 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:33.313169 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cd16dee5-cfd7-43b0-b202-486a9aa20be9 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:33.319123 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cd16dee5-cfd7-43b0-b202-486a9aa20be9 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:33.319123 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cd16dee5-cfd7-43b0-b202-486a9aa20be9 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:33.319123 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cd16dee5-cfd7-43b0-b202-486a9aa20be9 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:33.319123 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-cd16dee5-cfd7-43b0-b202-486a9aa20be9 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:33.455260 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3ea5fe13-0da3-470d-8638-08808baba009 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1597 microversion: 2.1 time: 0.726832 Oct 12 13:28:33.457769 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 720/1486] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:32 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1597 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:28:33.474020 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5dc30835-c74b-4f56-845f-4be8cb592755 tempest-ServersTestFqdnHostnames-812441362 tempest-ServersTestFqdnHostnames-812441362-project] Calling method '.version_select at 0x7f8a9b635670>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:33.595249 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5dc30835-c74b-4f56-845f-4be8cb592755 tempest-ServersTestFqdnHostnames-812441362 tempest-ServersTestFqdnHostnames-812441362-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1121561565" status: 202 len: 0 microversion: 2.1 time: 0.135172 Oct 12 13:28:33.596441 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 721/1487] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 12 13:28:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1121561565 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:28:33.609660 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f7145f2e-7d64-4ea5-af96-4056b7d0f184 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:33.615584 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f7145f2e-7d64-4ea5-af96-4056b7d0f184 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:33.619072 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=28 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:28:33.652871 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f7145f2e-7d64-4ea5-af96-4056b7d0f184 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:33.653753 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f7145f2e-7d64-4ea5-af96-4056b7d0f184 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:33.678708 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f7145f2e-7d64-4ea5-af96-4056b7d0f184 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:33.679575 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f7145f2e-7d64-4ea5-af96-4056b7d0f184 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:33.680064 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f7145f2e-7d64-4ea5-af96-4056b7d0f184 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:33.680562 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f7145f2e-7d64-4ea5-af96-4056b7d0f184 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:33.974654 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-cd16dee5-cfd7-43b0-b202-486a9aa20be9 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:33.995855 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f7145f2e-7d64-4ea5-af96-4056b7d0f184 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:34.009301 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f7145f2e-7d64-4ea5-af96-4056b7d0f184 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:34.014036 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f7145f2e-7d64-4ea5-af96-4056b7d0f184 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:34.017333 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f7145f2e-7d64-4ea5-af96-4056b7d0f184 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1407 microversion: 2.54 time: 0.417190 Oct 12 13:28:34.019428 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-cd16dee5-cfd7-43b0-b202-486a9aa20be9 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 200 len: 1318 microversion: 2.1 time: 0.738034 Oct 12 13:28:34.021413 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 722/1488] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:33 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1407 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:34.023440 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 767/1489] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:33 2022] GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 1318 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:34.041058 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-53626140-b84f-47f0-9dd3-8ccd64234714 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:34.051662 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-53626140-b84f-47f0-9dd3-8ccd64234714 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:34.062005 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-53626140-b84f-47f0-9dd3-8ccd64234714 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:34.064742 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-53626140-b84f-47f0-9dd3-8ccd64234714 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:34.065472 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-53626140-b84f-47f0-9dd3-8ccd64234714 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:34.066800 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-53626140-b84f-47f0-9dd3-8ccd64234714 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:34.067476 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-53626140-b84f-47f0-9dd3-8ccd64234714 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:34.068226 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-53626140-b84f-47f0-9dd3-8ccd64234714 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:34.258799 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b531500a-bb4f-42b3-853e-8aad3dc21d65 tempest-ServerTagsTestJSON-923935155 tempest-ServerTagsTestJSON-923935155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-353499193", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "14d60393-11bc-44b0-bcab-bf99cb866344"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:34.345940 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:28:34.348220 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-b531500a-bb4f-42b3-853e-8aad3dc21d65 tempest-ServerTagsTestJSON-923935155 tempest-ServerTagsTestJSON-923935155-project] validate_networks() for [('14d60393-11bc-44b0-bcab-bf99cb866344', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:28:34.503586 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-53626140-b84f-47f0-9dd3-8ccd64234714 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80/action" status: 202 len: 0 microversion: 2.1 time: 0.480718 Oct 12 13:28:34.504659 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 723/1490] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:28:34 2022] POST /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:28:34.513200 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-61ced0c9-6948-4173-91f9-d404916ff9a3 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:34.514206 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-61ced0c9-6948-4173-91f9-d404916ff9a3 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:34.528422 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-61ced0c9-6948-4173-91f9-d404916ff9a3 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:34.529316 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-61ced0c9-6948-4173-91f9-d404916ff9a3 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:34.529982 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-61ced0c9-6948-4173-91f9-d404916ff9a3 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:34.530888 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-61ced0c9-6948-4173-91f9-d404916ff9a3 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:34.532050 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-61ced0c9-6948-4173-91f9-d404916ff9a3 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:34.532679 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-61ced0c9-6948-4173-91f9-d404916ff9a3 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:34.910237 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-61ced0c9-6948-4173-91f9-d404916ff9a3 tempest-ServersAdminTestJSON-1964012681 tempest-ServersAdminTestJSON-1964012681-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1614 microversion: 2.1 time: 0.400644 Oct 12 13:28:34.911613 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 724/1491] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:34 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1614 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:28:34.939055 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d9634532-7d21-4388-9b7e-6d56fc58f4a9 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:34.941809 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d9634532-7d21-4388-9b7e-6d56fc58f4a9 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2d3ddb28-5b74-43dc-9579-d48a61b6d24e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:34.947072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-b531500a-bb4f-42b3-853e-8aad3dc21d65 tempest-ServerTagsTestJSON-923935155 tempest-ServerTagsTestJSON-923935155-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3b7ae80b-719d-4883-b6f7-303d25f98a25) Oct 12 13:28:34.947072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:34.947072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:28:34.947072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:28:34.947072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:34.947072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:34.947072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:34.947072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:34.947072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:34.947072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:34.947072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:28:34.947072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:28:34.947072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:28:34.947072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:28:34.947072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:28:34.947072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:28:34.948269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:28:34.948269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:28:34.948269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:28:34.948269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:28:34.948269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:28:34.948269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:28:34.948269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:28:34.948269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:28:34.948269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:28:34.948269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:28:34.948269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:28:34.948269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:34.948269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:34.948269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:28:34.948269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:28:34.948269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:34.948269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:34.948269 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:28:34.949563 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:28:34.949563 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:34.949563 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:34.949563 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:28:34.949563 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:28:34.949563 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:34.949563 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:34.949563 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:28:34.949563 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:28:34.949563 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:28:34.949563 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:28:34.949563 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:28:34.949563 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:28:34.949563 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:28:34.949563 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:28:34.949563 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:28:34.949563 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:28:34.949563 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:28:34.950810 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:28:34.950810 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:28:34.950810 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:28:34.950810 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:28:34.950810 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:28:34.950810 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:28:34.950810 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:28:34.950810 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:28:34.950810 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:28:34.950810 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:28:34.950810 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:28:34.950810 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:28:34.950810 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:28:34.950810 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:28:34.950810 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:28:34.951875 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3b7ae80b-719d-4883-b6f7-303d25f98a25) Oct 12 13:28:34.951875 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:34.951875 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-b531500a-bb4f-42b3-853e-8aad3dc21d65 tempest-ServerTagsTestJSON-923935155 tempest-ServerTagsTestJSON-923935155-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:34.951875 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:28:34.952203 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d9634532-7d21-4388-9b7e-6d56fc58f4a9 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:34.952203 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d9634532-7d21-4388-9b7e-6d56fc58f4a9 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:34.952203 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d9634532-7d21-4388-9b7e-6d56fc58f4a9 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:34.952437 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b531500a-bb4f-42b3-853e-8aad3dc21d65 tempest-ServerTagsTestJSON-923935155 tempest-ServerTagsTestJSON-923935155-project] Request method failure captured: Oct 12 13:28:34.952437 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:28:34.952437 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:28:34.952437 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:28:34.952437 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:28:34.952437 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 203 Oct 12 13:28:34.952437 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:28:34.952437 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:28:34.952437 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:28:34.952437 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:28:34.952437 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsEB42TJMGi2q08sxuNCI5DEINlWke3FwRK3Aw4N3BzD9buUlFGUYSI6ylshzrPtKUXKUIyRtl_2Z_Lpmn12mE6VITvnM5G6TRdhWkrMy1eLRusnO71YlpEjv-Weq-eiaT_KjvHDcJrLK_1pUCr5L_3-jYHeaYWpczsLc86Ozdxkycs Oct 12 13:28:34.952437 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:28:34.952437 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:28:34.952437 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:28:34.952437 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:28:34.952437 n-d-861076-2 devstack@n-api.service[120933]: X-Openstack-Nova-Api-Version: 2.26 Oct 12 13:28:34.952437 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:28:34.952437 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:28:34.952437 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: f2a69cb511974b3a9f66fb8597b78626 Oct 12 13:28:34.952437 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServerTagsTestJSON-923935155 Oct 12 13:28:34.952437 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:28:34.952437 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:28:34.961185 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f2a69cb511974b3a9f66fb8597b78626"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f2a69cb511974b3a9f66fb8597b78626"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f2a69cb511974b3a9f66fb8597b78626"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f2a69cb511974b3a9f66fb8597b78626"}]}] Oct 12 13:28:34.961185 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServerTagsTestJSON-923935155 Oct 12 13:28:34.961185 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: f2a69cb511974b3a9f66fb8597b78626 Oct 12 13:28:34.961185 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServerTagsTestJSON-923935155 Oct 12 13:28:34.961185 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServerTagsTestJSON-923935155-project Oct 12 13:28:34.961185 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:28:34.961185 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:28:34.961185 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: a95e7f87a5b444728a20186380e53cb2 Oct 12 13:28:34.961185 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServerTagsTestJSON-923935155-project Oct 12 13:28:34.961185 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:28:34.961185 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-ServerTagsTestJSON-server-353499193", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "14d60393-11bc-44b0-bcab-bf99cb866344"}]}} Oct 12 13:28:34.961185 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:28:34.963245 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:34.963245 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:28:34.963245 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-ServerTagsTestJSON-server-353499193', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '14d60393-11bc-44b0-bcab-bf99cb866344'}]}}} Oct 12 13:28:34.963245 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:28:34.963245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:34.963245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:28:34.963245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:28:34.963245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:34.963245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:34.963245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:34.963245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:34.963245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:34.963245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:34.963245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:28:34.963245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:28:34.963245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:28:34.963245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:28:34.963245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:28:34.963245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:28:34.968621 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:28:34.968621 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:28:34.968621 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:28:34.968621 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:28:34.968621 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:28:34.968621 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:28:34.968621 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:28:34.968621 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:28:34.968621 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:28:34.968621 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:28:34.968621 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:28:34.968621 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:34.968621 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:34.968621 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:28:34.968621 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:28:34.968621 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:34.968621 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:34.968621 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:28:34.972230 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:28:34.972230 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:34.972230 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:34.972230 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:28:34.972230 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:28:34.972230 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:34.972230 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:34.972230 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:28:34.972230 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:28:34.972230 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:28:34.972230 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:28:34.972230 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:28:34.972230 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:28:34.972230 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:28:34.972230 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:28:34.972230 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:28:34.972230 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:28:34.972230 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:28:34.974844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:28:34.974844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:28:34.974844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:28:34.974844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:28:34.974844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:28:34.974844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:28:34.974844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:28:34.974844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:28:34.974844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:28:34.974844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:28:34.974844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:28:34.974844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:28:34.974844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:28:34.974844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:28:34.974844 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:28:34.976478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3b7ae80b-719d-4883-b6f7-303d25f98a25) Oct 12 13:28:34.976478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:34.976478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:28:34.976478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:34.976478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:34.976478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:28:34.976478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:28:34.976478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:28:34.976478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:28:34.976478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:28:34.976478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:28:34.976478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:34.976478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:34.976478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:34.976478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:28:34.976478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:34.976478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:34.976478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:28:34.976478 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:28:34.979426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:28:34.979426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:28:34.979426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:34.979426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:34.979426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:34.979996 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d9634532-7d21-4388-9b7e-6d56fc58f4a9 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:34.980147 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b531500a-bb4f-42b3-853e-8aad3dc21d65 tempest-ServerTagsTestJSON-923935155 tempest-ServerTagsTestJSON-923935155-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:34.980147 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:28:34.980440 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d9634532-7d21-4388-9b7e-6d56fc58f4a9 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:34.980440 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d9634532-7d21-4388-9b7e-6d56fc58f4a9 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:34.980742 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b531500a-bb4f-42b3-853e-8aad3dc21d65 tempest-ServerTagsTestJSON-923935155 tempest-ServerTagsTestJSON-923935155-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.26 time: 0.789099 Oct 12 13:28:34.980742 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 768/1492] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 12 13:28:34 2022] POST /compute/v2.1/servers => generated 214 bytes in 790 msecs (HTTP/1.1 500) 9 headers in 393 bytes (2 switches on core 0) Oct 12 13:28:34.993517 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d9634532-7d21-4388-9b7e-6d56fc58f4a9 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2d3ddb28-5b74-43dc-9579-d48a61b6d24e] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:28:35.046321 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c846439c-8073-446d-ba13-51b7953909ca tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:35.048973 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c846439c-8073-446d-ba13-51b7953909ca tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:35.056988 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c846439c-8073-446d-ba13-51b7953909ca tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:35.058565 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c846439c-8073-446d-ba13-51b7953909ca tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:35.059803 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c846439c-8073-446d-ba13-51b7953909ca tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:35.060826 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c846439c-8073-446d-ba13-51b7953909ca tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:35.062341 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c846439c-8073-446d-ba13-51b7953909ca tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:35.063162 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c846439c-8073-446d-ba13-51b7953909ca tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:35.372287 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d9634532-7d21-4388-9b7e-6d56fc58f4a9 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e" status: 204 len: 0 microversion: 2.1 time: 0.437327 Oct 12 13:28:35.373771 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 725/1493] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:28:34 2022] DELETE /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 13:28:35.390265 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1dc92ed0-6d71-4a4c-9b8c-c2a8ce325b88 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:35.391259 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1dc92ed0-6d71-4a4c-9b8c-c2a8ce325b88 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:35.404738 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1dc92ed0-6d71-4a4c-9b8c-c2a8ce325b88 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:35.405565 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1dc92ed0-6d71-4a4c-9b8c-c2a8ce325b88 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:35.406171 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1dc92ed0-6d71-4a4c-9b8c-c2a8ce325b88 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:35.408798 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1dc92ed0-6d71-4a4c-9b8c-c2a8ce325b88 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:35.415577 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1dc92ed0-6d71-4a4c-9b8c-c2a8ce325b88 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:35.416420 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1dc92ed0-6d71-4a4c-9b8c-c2a8ce325b88 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:35.929638 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-1dc92ed0-6d71-4a4c-9b8c-c2a8ce325b88 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:35.942119 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-1dc92ed0-6d71-4a4c-9b8c-c2a8ce325b88 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:35.947119 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-1dc92ed0-6d71-4a4c-9b8c-c2a8ce325b88 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:35.952217 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1dc92ed0-6d71-4a4c-9b8c-c2a8ce325b88 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1407 microversion: 2.54 time: 0.575113 Oct 12 13:28:35.961070 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 726/1494] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:35 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1407 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:35.975630 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ba4e91b2-d0c3-41a6-8983-6960bb77b9c4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:35.978792 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ba4e91b2-d0c3-41a6-8983-6960bb77b9c4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2d3ddb28-5b74-43dc-9579-d48a61b6d24e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:35.981831 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-c846439c-8073-446d-ba13-51b7953909ca tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:35.996580 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c846439c-8073-446d-ba13-51b7953909ca tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 200 len: 1318 microversion: 2.1 time: 0.954413 Oct 12 13:28:35.998992 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 769/1495] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:35 2022] GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 1318 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:28:36.006487 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba4e91b2-d0c3-41a6-8983-6960bb77b9c4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:36.015689 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba4e91b2-d0c3-41a6-8983-6960bb77b9c4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:36.016344 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba4e91b2-d0c3-41a6-8983-6960bb77b9c4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:36.018968 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba4e91b2-d0c3-41a6-8983-6960bb77b9c4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:36.019573 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba4e91b2-d0c3-41a6-8983-6960bb77b9c4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:36.024635 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba4e91b2-d0c3-41a6-8983-6960bb77b9c4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:36.865203 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-ba4e91b2-d0c3-41a6-8983-6960bb77b9c4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:36.873802 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ba4e91b2-d0c3-41a6-8983-6960bb77b9c4 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e" status: 200 len: 1470 microversion: 2.1 time: 0.909901 Oct 12 13:28:36.880844 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 727/1496] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:35 2022] GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e => generated 1470 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:36.980712 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b6623929-b71e-491b-aefe-ea588b84c5c0 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:36.981520 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-b6623929-b71e-491b-aefe-ea588b84c5c0 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:36.991017 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b6623929-b71e-491b-aefe-ea588b84c5c0 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:36.992796 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b6623929-b71e-491b-aefe-ea588b84c5c0 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:36.994804 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b6623929-b71e-491b-aefe-ea588b84c5c0 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:36.996358 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b6623929-b71e-491b-aefe-ea588b84c5c0 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:36.997155 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b6623929-b71e-491b-aefe-ea588b84c5c0 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:36.998342 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b6623929-b71e-491b-aefe-ea588b84c5c0 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:37.024291 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-59d48fbd-0fb5-46a5-b2b4-c59ecc590363 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:37.025100 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-59d48fbd-0fb5-46a5-b2b4-c59ecc590363 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:37.035399 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-59d48fbd-0fb5-46a5-b2b4-c59ecc590363 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:37.040273 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-59d48fbd-0fb5-46a5-b2b4-c59ecc590363 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:37.041014 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-59d48fbd-0fb5-46a5-b2b4-c59ecc590363 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:37.042072 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-59d48fbd-0fb5-46a5-b2b4-c59ecc590363 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:37.042544 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-59d48fbd-0fb5-46a5-b2b4-c59ecc590363 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:37.043563 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-59d48fbd-0fb5-46a5-b2b4-c59ecc590363 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:37.275483 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b6623929-b71e-491b-aefe-ea588b84c5c0 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:37.289245 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b6623929-b71e-491b-aefe-ea588b84c5c0 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:37.290835 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b6623929-b71e-491b-aefe-ea588b84c5c0 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:37.305091 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b6623929-b71e-491b-aefe-ea588b84c5c0 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1407 microversion: 2.54 time: 0.316129 Oct 12 13:28:37.306003 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 770/1497] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:36 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1407 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:37.311023 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-babe75cc-7a56-4466-942c-a57daa35bae8 req-c9baec30-783e-4416-bf13-95d97ac12b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed6ad20-8975-4ce5-b6b6-da604e6de75a", "name": "network-vif-plugged", "status": "completed", "tag": "d7975bf0-8638-44b5-8a0a-5ee6ef6227ef"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:37.328391 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-babe75cc-7a56-4466-942c-a57daa35bae8 req-c9baec30-783e-4416-bf13-95d97ac12b1e service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:37.330245 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-babe75cc-7a56-4466-942c-a57daa35bae8 req-c9baec30-783e-4416-bf13-95d97ac12b1e service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:37.336813 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-babe75cc-7a56-4466-942c-a57daa35bae8 req-c9baec30-783e-4416-bf13-95d97ac12b1e service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:37.414762 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-babe75cc-7a56-4466-942c-a57daa35bae8 req-c9baec30-783e-4416-bf13-95d97ac12b1e service nova] Creating event network-vif-plugged:d7975bf0-8638-44b5-8a0a-5ee6ef6227ef for instance bed6ad20-8975-4ce5-b6b6-da604e6de75a on n-h2-861076-2 Oct 12 13:28:37.426267 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-babe75cc-7a56-4466-942c-a57daa35bae8 req-c9baec30-783e-4416-bf13-95d97ac12b1e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118765 Oct 12 13:28:37.430092 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 771/1498] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:28:37.904689 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:28:37.911236 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-500385f9-8051-457e-ae99-315bd8f1fe66 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:37.912719 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-500385f9-8051-457e-ae99-315bd8f1fe66 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2d3ddb28-5b74-43dc-9579-d48a61b6d24e] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:37.924671 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-500385f9-8051-457e-ae99-315bd8f1fe66 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:37.929549 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-500385f9-8051-457e-ae99-315bd8f1fe66 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:37.930600 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-500385f9-8051-457e-ae99-315bd8f1fe66 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:37.931595 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-500385f9-8051-457e-ae99-315bd8f1fe66 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:37.934323 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-500385f9-8051-457e-ae99-315bd8f1fe66 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:37.936973 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-500385f9-8051-457e-ae99-315bd8f1fe66 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:38.642873 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-59d48fbd-0fb5-46a5-b2b4-c59ecc590363 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:38.653386 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-59d48fbd-0fb5-46a5-b2b4-c59ecc590363 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 200 len: 1318 microversion: 2.1 time: 1.634875 Oct 12 13:28:38.653974 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 728/1499] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:37 2022] GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 1318 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:38.662824 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-22bf55dc-b68c-4ceb-8d76-50fbfb667cfa tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:38.667245 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-22bf55dc-b68c-4ceb-8d76-50fbfb667cfa tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:38.680178 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22bf55dc-b68c-4ceb-8d76-50fbfb667cfa tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:38.680561 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22bf55dc-b68c-4ceb-8d76-50fbfb667cfa tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:38.681041 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22bf55dc-b68c-4ceb-8d76-50fbfb667cfa tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:38.681758 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22bf55dc-b68c-4ceb-8d76-50fbfb667cfa tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:38.682223 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22bf55dc-b68c-4ceb-8d76-50fbfb667cfa tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:38.682656 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22bf55dc-b68c-4ceb-8d76-50fbfb667cfa tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:38.924740 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-22bf55dc-b68c-4ceb-8d76-50fbfb667cfa tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:38.955776 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-22bf55dc-b68c-4ceb-8d76-50fbfb667cfa tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:38.957758 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-22bf55dc-b68c-4ceb-8d76-50fbfb667cfa tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:38.959632 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-22bf55dc-b68c-4ceb-8d76-50fbfb667cfa tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1407 microversion: 2.54 time: 0.302201 Oct 12 13:28:38.960392 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 729/1500] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:38 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:39.457289 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-61ca9362-a175-40f9-9093-48eeb9f6bdf3 req-9566fd69-8ad7-4cc5-aa3a-1bad2e2096b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3ddb28-5b74-43dc-9579-d48a61b6d24e", "name": "network-vif-deleted", "tag": "75aaeb66-849a-4294-a96c-56858c711618"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:39.463843 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-500385f9-8051-457e-ae99-315bd8f1fe66 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:39.474542 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-500385f9-8051-457e-ae99-315bd8f1fe66 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e" status: 200 len: 1470 microversion: 2.1 time: 1.567509 Oct 12 13:28:39.480479 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 772/1501] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:37 2022] GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e => generated 1470 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:39.503614 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-61ca9362-a175-40f9-9093-48eeb9f6bdf3 req-9566fd69-8ad7-4cc5-aa3a-1bad2e2096b9 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:39.509465 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-61ca9362-a175-40f9-9093-48eeb9f6bdf3 req-9566fd69-8ad7-4cc5-aa3a-1bad2e2096b9 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:39.510029 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-61ca9362-a175-40f9-9093-48eeb9f6bdf3 req-9566fd69-8ad7-4cc5-aa3a-1bad2e2096b9 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:39.557987 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-61ca9362-a175-40f9-9093-48eeb9f6bdf3 req-9566fd69-8ad7-4cc5-aa3a-1bad2e2096b9 service nova] Creating event network-vif-deleted:75aaeb66-849a-4294-a96c-56858c711618 for instance 2d3ddb28-5b74-43dc-9579-d48a61b6d24e on n-h1-861076-2 Oct 12 13:28:39.567152 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-61ca9362-a175-40f9-9093-48eeb9f6bdf3 req-9566fd69-8ad7-4cc5-aa3a-1bad2e2096b9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114741 Oct 12 13:28:39.571095 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 730/1502] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:28:39.678972 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d919862f-72a9-4ed1-8eb8-874e50c4d67e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:39.679847 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-d919862f-72a9-4ed1-8eb8-874e50c4d67e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:39.689694 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d919862f-72a9-4ed1-8eb8-874e50c4d67e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:39.700187 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d919862f-72a9-4ed1-8eb8-874e50c4d67e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:39.700963 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d919862f-72a9-4ed1-8eb8-874e50c4d67e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:39.713800 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d919862f-72a9-4ed1-8eb8-874e50c4d67e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:39.714473 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d919862f-72a9-4ed1-8eb8-874e50c4d67e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:39.715144 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d919862f-72a9-4ed1-8eb8-874e50c4d67e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:39.994426 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9142f577-ac7b-4fd4-9b8b-0065308a7e0d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:39.996754 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9142f577-ac7b-4fd4-9b8b-0065308a7e0d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:40.029026 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9142f577-ac7b-4fd4-9b8b-0065308a7e0d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:40.029461 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9142f577-ac7b-4fd4-9b8b-0065308a7e0d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:40.029901 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9142f577-ac7b-4fd4-9b8b-0065308a7e0d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:40.055739 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9142f577-ac7b-4fd4-9b8b-0065308a7e0d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:40.056491 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9142f577-ac7b-4fd4-9b8b-0065308a7e0d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:40.057177 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9142f577-ac7b-4fd4-9b8b-0065308a7e0d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:40.305998 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-9142f577-ac7b-4fd4-9b8b-0065308a7e0d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:40.331074 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-9142f577-ac7b-4fd4-9b8b-0065308a7e0d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:40.333456 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-9142f577-ac7b-4fd4-9b8b-0065308a7e0d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:40.336202 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9142f577-ac7b-4fd4-9b8b-0065308a7e0d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1407 microversion: 2.54 time: 0.350976 Oct 12 13:28:40.339670 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 731/1503] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:39 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:28:40.509039 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0680b3f3-dddf-4e98-b255-9d59c989d537 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:40.510806 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0680b3f3-dddf-4e98-b255-9d59c989d537 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2d3ddb28-5b74-43dc-9579-d48a61b6d24e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:40.527672 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0680b3f3-dddf-4e98-b255-9d59c989d537 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:40.528192 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0680b3f3-dddf-4e98-b255-9d59c989d537 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:40.528644 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0680b3f3-dddf-4e98-b255-9d59c989d537 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:40.535860 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0680b3f3-dddf-4e98-b255-9d59c989d537 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:40.537364 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0680b3f3-dddf-4e98-b255-9d59c989d537 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:40.540676 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0680b3f3-dddf-4e98-b255-9d59c989d537 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:40.553796 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d919862f-72a9-4ed1-8eb8-874e50c4d67e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:40.579783 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d919862f-72a9-4ed1-8eb8-874e50c4d67e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 200 len: 1318 microversion: 2.1 time: 0.906680 Oct 12 13:28:40.581950 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 773/1504] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:39 2022] GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 1318 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:40.653827 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0680b3f3-dddf-4e98-b255-9d59c989d537 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:40.654465 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0680b3f3-dddf-4e98-b255-9d59c989d537 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:40.657667 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0680b3f3-dddf-4e98-b255-9d59c989d537 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:40.658182 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-0680b3f3-dddf-4e98-b255-9d59c989d537 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lazy-loading 'fault' on Instance uuid 2d3ddb28-5b74-43dc-9579-d48a61b6d24e {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:28:40.816233 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-0680b3f3-dddf-4e98-b255-9d59c989d537 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:40.831720 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0680b3f3-dddf-4e98-b255-9d59c989d537 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e" status: 200 len: 1304 microversion: 2.1 time: 0.320353 Oct 12 13:28:40.832801 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 732/1505] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:40 2022] GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e => generated 1304 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:28:41.370135 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9a9d099b-e2aa-4a90-bcb3-a72d47dc4754 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:41.370888 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-9a9d099b-e2aa-4a90-bcb3-a72d47dc4754 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:41.385367 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9a9d099b-e2aa-4a90-bcb3-a72d47dc4754 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:41.385367 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9a9d099b-e2aa-4a90-bcb3-a72d47dc4754 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:41.385367 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9a9d099b-e2aa-4a90-bcb3-a72d47dc4754 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:41.385367 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9a9d099b-e2aa-4a90-bcb3-a72d47dc4754 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:41.387241 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9a9d099b-e2aa-4a90-bcb3-a72d47dc4754 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:41.387685 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9a9d099b-e2aa-4a90-bcb3-a72d47dc4754 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:41.597481 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9a9d099b-e2aa-4a90-bcb3-a72d47dc4754 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:41.607728 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-073ca1df-fa95-49c4-afe1-81b4f0ccc7bd tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:41.608888 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-073ca1df-fa95-49c4-afe1-81b4f0ccc7bd tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:41.616435 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9a9d099b-e2aa-4a90-bcb3-a72d47dc4754 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:41.616582 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-073ca1df-fa95-49c4-afe1-81b4f0ccc7bd tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:41.616833 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-073ca1df-fa95-49c4-afe1-81b4f0ccc7bd tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:41.621500 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-073ca1df-fa95-49c4-afe1-81b4f0ccc7bd tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:41.622273 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-073ca1df-fa95-49c4-afe1-81b4f0ccc7bd tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:41.622754 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-073ca1df-fa95-49c4-afe1-81b4f0ccc7bd tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:41.624550 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9a9d099b-e2aa-4a90-bcb3-a72d47dc4754 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:41.625645 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-073ca1df-fa95-49c4-afe1-81b4f0ccc7bd tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:41.638962 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9a9d099b-e2aa-4a90-bcb3-a72d47dc4754 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1407 microversion: 2.54 time: 0.260775 Oct 12 13:28:41.644076 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 774/1506] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:41 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:41.860047 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-92643062-f771-4b39-8fea-486b4af1e884 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:41.861862 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-92643062-f771-4b39-8fea-486b4af1e884 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2d3ddb28-5b74-43dc-9579-d48a61b6d24e] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:41.912438 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-92643062-f771-4b39-8fea-486b4af1e884 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:41.914112 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-92643062-f771-4b39-8fea-486b4af1e884 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:41.915711 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-92643062-f771-4b39-8fea-486b4af1e884 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:41.918041 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-92643062-f771-4b39-8fea-486b4af1e884 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:41.919484 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-92643062-f771-4b39-8fea-486b4af1e884 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:41.921570 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-92643062-f771-4b39-8fea-486b4af1e884 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:41.978626 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-92643062-f771-4b39-8fea-486b4af1e884 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] HTTP exception thrown: Instance 2d3ddb28-5b74-43dc-9579-d48a61b6d24e could not be found. Oct 12 13:28:41.980528 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-92643062-f771-4b39-8fea-486b4af1e884 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Request method failure captured: Oct 12 13:28:41.980528 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e HTTP/1.1 Oct 12 13:28:41.980528 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:28:41.980528 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:28:41.980528 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:28:41.980528 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:28:41.980528 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:28:41.980528 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:28:41.980528 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:28:41.980528 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:28:41.980528 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsBi4xHBrer6lBGhkUJpIvqrl1I3XTS6WcdnkMPTgyrBgwmWzXC1XxDw6f0DGeeOjkXunqcCiv1k_s6tGvtE00QiDmmCqY4XpmNm3xiVjOwWwX5Vqmi8mUgzLyqqJT0nte9-8TEG6VoiahlE1CIFzuYG5vXK3UP8kq6OohbCqDcfYiU Oct 12 13:28:41.980528 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:28:41.980528 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:28:41.980528 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:28:41.980528 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:28:41.980528 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:28:41.980528 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:28:41.980528 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 2bb790004fd34993aeee9b0f5820b798 Oct 12 13:28:41.980528 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServersAdminTestJSON-980445995 Oct 12 13:28:41.980528 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:28:41.980528 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:28:41.983566 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2bb790004fd34993aeee9b0f5820b798"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2bb790004fd34993aeee9b0f5820b798"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2bb790004fd34993aeee9b0f5820b798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2bb790004fd34993aeee9b0f5820b798"}]}] Oct 12 13:28:41.983566 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServersAdminTestJSON-980445995 Oct 12 13:28:41.983566 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 2bb790004fd34993aeee9b0f5820b798 Oct 12 13:28:41.983566 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServersAdminTestJSON-980445995 Oct 12 13:28:41.983566 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServersAdminTestJSON-980445995-project Oct 12 13:28:41.983566 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:28:41.983566 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:28:41.983566 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: aecb9d3ecf9d4f29bc40f00736887149 Oct 12 13:28:41.983566 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServersAdminTestJSON-980445995-project Oct 12 13:28:41.983566 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:28:41.983566 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance 2d3ddb28-5b74-43dc-9579-d48a61b6d24e could not be found. Oct 12 13:28:41.983566 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '2d3ddb28-5b74-43dc-9579-d48a61b6d24e'} Oct 12 13:28:41.984632 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:28:41.984632 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:41.984632 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:28:41.984632 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:28:41.984632 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:28:41.984632 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:28:41.984632 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:28:41.984632 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:28:41.984632 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:28:41.984632 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:28:41.984632 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d3ddb28-5b74-43dc-9579-d48a61b6d24e could not be found. Oct 12 13:28:41.984632 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:41.984632 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:28:41.984632 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:41.984632 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:41.984632 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:28:41.984632 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:28:41.984632 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:28:41.984632 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:28:41.984632 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:28:41.988220 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:28:41.988220 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:28:41.988220 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:28:41.988220 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:28:41.988220 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:28:41.988220 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:28:41.988220 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:28:41.988220 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d3ddb28-5b74-43dc-9579-d48a61b6d24e could not be found. Oct 12 13:28:41.988220 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:41.988220 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:28:41.988220 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:41.988220 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:41.988220 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:28:41.988220 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:28:41.988220 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:28:41.988220 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:28:41.988220 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d3ddb28-5b74-43dc-9579-d48a61b6d24e could not be found. Oct 12 13:28:41.988220 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:41.993552 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-92643062-f771-4b39-8fea-486b4af1e884 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Returning 404 to user: Instance 2d3ddb28-5b74-43dc-9579-d48a61b6d24e could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:28:41.996382 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-92643062-f771-4b39-8fea-486b4af1e884 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e" status: 404 len: 111 microversion: 2.1 time: 0.143070 Oct 12 13:28:42.002380 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 775/1507] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:41 2022] GET /compute/v2.1/servers/2d3ddb28-5b74-43dc-9579-d48a61b6d24e => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:28:42.008097 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4a823be6-3f62-4918-bdb0-7cc0a5385af3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:42.010260 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-4a823be6-3f62-4918-bdb0-7cc0a5385af3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2e5ecdb4-eaf0-4b44-9a4c-e442345da741] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:42.022997 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4a823be6-3f62-4918-bdb0-7cc0a5385af3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:42.023598 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4a823be6-3f62-4918-bdb0-7cc0a5385af3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:42.025733 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4a823be6-3f62-4918-bdb0-7cc0a5385af3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:42.026781 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4a823be6-3f62-4918-bdb0-7cc0a5385af3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:42.027479 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4a823be6-3f62-4918-bdb0-7cc0a5385af3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:42.028135 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4a823be6-3f62-4918-bdb0-7cc0a5385af3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:42.076081 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-4a823be6-3f62-4918-bdb0-7cc0a5385af3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2e5ecdb4-eaf0-4b44-9a4c-e442345da741] Going to try to terminate instance {{(pid=120933) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:28:42.153854 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-073ca1df-fa95-49c4-afe1-81b4f0ccc7bd tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:42.164159 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-073ca1df-fa95-49c4-afe1-81b4f0ccc7bd tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 200 len: 1468 microversion: 2.1 time: 0.562089 Oct 12 13:28:42.177705 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 733/1508] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:41 2022] GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 1468 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:42.481041 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fa7f678c-f448-48a5-8ec8-8736cf9f6cf4 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1515576894", "block_migration": true, "disk_over_commit": false}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:42.483623 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fa7f678c-f448-48a5-8ec8-8736cf9f6cf4 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:42.512581 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4a823be6-3f62-4918-bdb0-7cc0a5385af3 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741" status: 204 len: 0 microversion: 2.1 time: 0.508232 Oct 12 13:28:42.515689 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 776/1509] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:28:42 2022] DELETE /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:28:42.529044 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-dc7cb15a-5019-4d60-a259-f5fdeabfc966 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:42.529818 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-dc7cb15a-5019-4d60-a259-f5fdeabfc966 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2e5ecdb4-eaf0-4b44-9a4c-e442345da741] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:42.534825 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa7f678c-f448-48a5-8ec8-8736cf9f6cf4 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:42.539754 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa7f678c-f448-48a5-8ec8-8736cf9f6cf4 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:42.544512 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dc7cb15a-5019-4d60-a259-f5fdeabfc966 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:42.545034 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dc7cb15a-5019-4d60-a259-f5fdeabfc966 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:42.545568 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa7f678c-f448-48a5-8ec8-8736cf9f6cf4 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:42.545859 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dc7cb15a-5019-4d60-a259-f5fdeabfc966 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:42.556268 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa7f678c-f448-48a5-8ec8-8736cf9f6cf4 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:42.556458 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dc7cb15a-5019-4d60-a259-f5fdeabfc966 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:42.556458 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dc7cb15a-5019-4d60-a259-f5fdeabfc966 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:42.556458 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dc7cb15a-5019-4d60-a259-f5fdeabfc966 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:42.556756 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa7f678c-f448-48a5-8ec8-8736cf9f6cf4 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:42.556756 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa7f678c-f448-48a5-8ec8-8736cf9f6cf4 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:42.724038 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-fa7f678c-f448-48a5-8ec8-8736cf9f6cf4 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-68b6a636-db98-4d45-b776-9b22bab4a27b) Oct 12 13:28:42.724038 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:42.724038 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:28:42.724038 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:28:42.724038 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:42.724038 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:42.724038 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:42.724038 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:42.724038 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:42.724038 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:42.724038 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 13:28:42.724038 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 12 13:28:42.724038 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 12 13:28:42.724038 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 12 13:28:42.724038 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 12 13:28:42.725837 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 12 13:28:42.725837 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 12 13:28:42.725837 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:28:42.725837 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:28:42.725837 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:28:42.725837 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:28:42.725837 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:28:42.725837 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:28:42.725837 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:42.725837 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:42.725837 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:28:42.725837 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:28:42.725837 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:42.725837 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:42.725837 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:28:42.725837 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:28:42.725837 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:42.725837 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:42.727326 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:28:42.727326 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:28:42.727326 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:42.727326 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:42.727326 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:28:42.727326 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:28:42.727326 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:28:42.727326 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:28:42.727326 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:28:42.727326 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:28:42.727326 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:28:42.727326 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:28:42.727326 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:28:42.727326 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:28:42.727326 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:28:42.727326 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:28:42.727326 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:28:42.728880 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:28:42.728880 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:28:42.728880 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:28:42.728880 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:28:42.728880 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:28:42.728880 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:28:42.728880 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:28:42.728880 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:28:42.728880 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:28:42.728880 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:28:42.728880 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:28:42.728880 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:28:42.728880 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:28:42.728880 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-68b6a636-db98-4d45-b776-9b22bab4a27b) Oct 12 13:28:42.728880 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:28:42.734101 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-fa7f678c-f448-48a5-8ec8-8736cf9f6cf4 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:42.734101 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:28:42.744216 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fa7f678c-f448-48a5-8ec8-8736cf9f6cf4 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Request method failure captured: Oct 12 13:28:42.744216 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a/action HTTP/1.1 Oct 12 13:28:42.744216 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:28:42.744216 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:28:42.744216 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:28:42.744216 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 107 Oct 12 13:28:42.744216 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:28:42.744216 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:28:42.744216 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:28:42.744216 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:28:42.744216 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsDnnHaB9GdGLbDReR7sXESZtFUtw6v50yh695Jyw81nU8BwEhkbWBMBZeI987khI19G2G2oEQHiJ1MiYXvdeSuOAzeS0uy7qR6TDB2aQMOzdmxUAkb6iyP-bKY3cWUwaejg3axuswlRCBbtETeEzz_Yx3s91A_PPfYcsYV3O625sKA Oct 12 13:28:42.744216 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:28:42.744216 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:28:42.744216 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:28:42.744216 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:28:42.744216 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:28:42.744216 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:28:42.744216 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: f803180ee6d64af6a1c4dde0eef17857 Oct 12 13:28:42.744216 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-LiveMigrationNegativeTest-1084821230 Oct 12 13:28:42.744216 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,admin,reader Oct 12 13:28:42.744216 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,admin,reader Oct 12 13:28:42.750134 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f803180ee6d64af6a1c4dde0eef17857"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f803180ee6d64af6a1c4dde0eef17857"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f803180ee6d64af6a1c4dde0eef17857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f803180ee6d64af6a1c4dde0eef17857"}]}] Oct 12 13:28:42.750134 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-LiveMigrationNegativeTest-1084821230 Oct 12 13:28:42.750134 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: f803180ee6d64af6a1c4dde0eef17857 Oct 12 13:28:42.750134 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1084821230 Oct 12 13:28:42.750134 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-LiveMigrationNegativeTest-1084821230-project-admin Oct 12 13:28:42.750134 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:28:42.750134 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:28:42.750134 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 7343fb18a1354c169dfc2a002f3054b0 Oct 12 13:28:42.750134 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-LiveMigrationNegativeTest-1084821230-project-admin Oct 12 13:28:42.750134 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:28:42.750134 n-d-861076-2 devstack@n-api.service[120932]: {"os-migrateLive": {"host": "tempest-host-1515576894", "block_migration": true, "disk_over_commit": false}} Oct 12 13:28:42.750134 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:28:42.751743 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:42.751743 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:28:42.751743 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'bed6ad20-8975-4ce5-b6b6-da604e6de75a', 'body': {'os-migrateLive': {'host': 'tempest-host-1515576894', 'block_migration': True, 'disk_over_commit': False}}} Oct 12 13:28:42.751743 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:28:42.751743 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:42.751743 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:28:42.751743 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:28:42.751743 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:42.751743 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:42.751743 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:42.751743 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:42.751743 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:42.751743 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:42.751743 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 13:28:42.751743 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 12 13:28:42.751743 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 12 13:28:42.751743 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 12 13:28:42.751743 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 12 13:28:42.751743 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 12 13:28:42.753855 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 12 13:28:42.753855 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:28:42.753855 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:28:42.753855 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:28:42.753855 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:28:42.753855 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:28:42.753855 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:28:42.753855 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:42.753855 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:42.753855 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:28:42.753855 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:28:42.753855 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:42.753855 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:42.753855 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:28:42.753855 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:28:42.753855 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:42.753855 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:42.753855 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:28:42.755253 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:28:42.755253 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:42.755253 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:42.755253 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:28:42.755253 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:28:42.755253 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:28:42.755253 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:28:42.755253 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:28:42.755253 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:28:42.755253 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:28:42.755253 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:28:42.755253 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:28:42.755253 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:28:42.755253 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:28:42.755253 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:28:42.755253 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:28:42.755253 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:28:42.756655 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:28:42.756655 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:28:42.756655 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:28:42.756655 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:28:42.756655 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:28:42.756655 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:28:42.756655 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:28:42.756655 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:28:42.756655 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:28:42.756655 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:28:42.756655 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:28:42.756655 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:28:42.756655 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-68b6a636-db98-4d45-b776-9b22bab4a27b) Oct 12 13:28:42.756655 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:28:42.756655 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:28:42.756655 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:28:42.758083 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:42.758083 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:28:42.758083 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:28:42.758083 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:28:42.758083 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:28:42.758083 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:28:42.758083 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:28:42.758083 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:42.758083 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:28:42.758083 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:28:42.758083 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:28:42.758083 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:28:42.758083 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:42.758083 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:28:42.758083 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:28:42.758083 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:28:42.758083 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:28:42.758083 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:42.758083 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:28:42.758083 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:28:42.761372 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fa7f678c-f448-48a5-8ec8-8736cf9f6cf4 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:42.761372 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:28:42.761372 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fa7f678c-f448-48a5-8ec8-8736cf9f6cf4 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a/action" status: 500 len: 214 microversion: 2.1 time: 0.554917 Oct 12 13:28:42.761372 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 734/1510] 10.222.0.52 () {60 vars in 1279 bytes} [Wed Oct 12 13:28:42 2022] POST /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a/action => generated 214 bytes in 556 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:28:42.768866 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-13f634dc-8918-48f2-b4ad-1f88d5781a46 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:42.772562 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-13f634dc-8918-48f2-b4ad-1f88d5781a46 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:42.784204 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-13f634dc-8918-48f2-b4ad-1f88d5781a46 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:42.785783 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-13f634dc-8918-48f2-b4ad-1f88d5781a46 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:42.786240 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-13f634dc-8918-48f2-b4ad-1f88d5781a46 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:42.787626 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-13f634dc-8918-48f2-b4ad-1f88d5781a46 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:42.788101 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-13f634dc-8918-48f2-b4ad-1f88d5781a46 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:42.788530 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-13f634dc-8918-48f2-b4ad-1f88d5781a46 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:43.190445 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-13f634dc-8918-48f2-b4ad-1f88d5781a46 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:43.213095 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-13f634dc-8918-48f2-b4ad-1f88d5781a46 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:43.226634 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-13f634dc-8918-48f2-b4ad-1f88d5781a46 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:43.233304 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-13f634dc-8918-48f2-b4ad-1f88d5781a46 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1407 microversion: 2.54 time: 0.492690 Oct 12 13:28:43.242519 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 735/1511] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:42 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1407 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:43.250774 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f436c1ac-dc39-4e25-b2ac-cfcfa61c78ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-132826319", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:43.355820 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-f436c1ac-dc39-4e25-b2ac-cfcfa61c78ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] validate_networks() for None {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:28:43.625174 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-dc7cb15a-5019-4d60-a259-f5fdeabfc966 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:43.631119 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-dc7cb15a-5019-4d60-a259-f5fdeabfc966 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741" status: 200 len: 1470 microversion: 2.1 time: 1.110868 Oct 12 13:28:43.637229 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 777/1512] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:42 2022] GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741 => generated 1470 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:43.855265 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-63b7b8c6-d120-4a3c-9dfd-5f3066559e6b tempest-ServersTestManualDisk-1147363400 tempest-ServersTestManualDisk-1147363400-project] Action: 'create', calling method: .version_select at 0x7f8a9ba2d8b0>, body: {"keypair": {"name": "tempest-keypair-1695804358", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUP6H1dzXlIPLyj2lhNfsmmVN2vw38lJUGEESNgOTr8wBCRI3sHM6tuhFYyR04LxIETYVQxho+AOPDS4FT0qvkKMhdRlQeFRf+z30NoNqqxg/pwq2fmCzpYmRGV4Flwjg=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:43.888394 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-63b7b8c6-d120-4a3c-9dfd-5f3066559e6b tempest-ServersTestManualDisk-1147363400 tempest-ServersTestManualDisk-1147363400-project] Getting quotas for project fd6d592722e64729ad72f62ccd53f2f5. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:28:43.902328 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-63b7b8c6-d120-4a3c-9dfd-5f3066559e6b tempest-ServersTestManualDisk-1147363400 tempest-ServersTestManualDisk-1147363400-project] Getting quotas for user da9da4be0b2f49f19e146c46ad0f82e4 and project fd6d592722e64729ad72f62ccd53f2f5. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:28:44.002005 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-63b7b8c6-d120-4a3c-9dfd-5f3066559e6b tempest-ServersTestManualDisk-1147363400 tempest-ServersTestManualDisk-1147363400-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.216686 Oct 12 13:28:44.004309 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 778/1513] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:28:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:28:44.270664 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ebc6f57c-5d73-45af-a40c-afc781ce9bb7 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:44.271277 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-ebc6f57c-5d73-45af-a40c-afc781ce9bb7 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:44.296339 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebc6f57c-5d73-45af-a40c-afc781ce9bb7 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:44.296833 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebc6f57c-5d73-45af-a40c-afc781ce9bb7 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:44.297308 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebc6f57c-5d73-45af-a40c-afc781ce9bb7 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:44.298707 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebc6f57c-5d73-45af-a40c-afc781ce9bb7 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:44.299412 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebc6f57c-5d73-45af-a40c-afc781ce9bb7 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:44.299842 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ebc6f57c-5d73-45af-a40c-afc781ce9bb7 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:44.333743 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-f436c1ac-dc39-4e25-b2ac-cfcfa61c78ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:28:44.334885 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-f436c1ac-dc39-4e25-b2ac-cfcfa61c78ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:28:44.335410 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-f436c1ac-dc39-4e25-b2ac-cfcfa61c78ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:28:44.335826 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-f436c1ac-dc39-4e25-b2ac-cfcfa61c78ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:28:44.337798 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-f436c1ac-dc39-4e25-b2ac-cfcfa61c78ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:28:44.381955 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f436c1ac-dc39-4e25-b2ac-cfcfa61c78ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:44.392201 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f436c1ac-dc39-4e25-b2ac-cfcfa61c78ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:44.394020 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f436c1ac-dc39-4e25-b2ac-cfcfa61c78ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:44.399372 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f436c1ac-dc39-4e25-b2ac-cfcfa61c78ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:44.400320 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f436c1ac-dc39-4e25-b2ac-cfcfa61c78ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:44.400985 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f436c1ac-dc39-4e25-b2ac-cfcfa61c78ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:44.447737 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-f436c1ac-dc39-4e25-b2ac-cfcfa61c78ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Getting quotas for project 46912a6dbce642efa054f5fc83b1bbaf. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:28:44.487693 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-ebc6f57c-5d73-45af-a40c-afc781ce9bb7 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:44.491359 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-f436c1ac-dc39-4e25-b2ac-cfcfa61c78ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Getting quotas for user ace4b2fa8c4c4198a7215456e7f52fe9 and project 46912a6dbce642efa054f5fc83b1bbaf. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:28:44.515928 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f436c1ac-dc39-4e25-b2ac-cfcfa61c78ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:28:44.518262 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-ebc6f57c-5d73-45af-a40c-afc781ce9bb7 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:44.521084 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f436c1ac-dc39-4e25-b2ac-cfcfa61c78ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:28:44.525733 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-ebc6f57c-5d73-45af-a40c-afc781ce9bb7 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:44.527224 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ebc6f57c-5d73-45af-a40c-afc781ce9bb7 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1407 microversion: 2.54 time: 0.260544 Oct 12 13:28:44.536047 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 779/1514] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:44 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:28:44.603064 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:28:44.664432 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6c59c58e-9134-4005-a993-5fb1906224b1 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:44.665243 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-6c59c58e-9134-4005-a993-5fb1906224b1 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2e5ecdb4-eaf0-4b44-9a4c-e442345da741] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:44.689419 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6c59c58e-9134-4005-a993-5fb1906224b1 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:44.694564 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6c59c58e-9134-4005-a993-5fb1906224b1 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:44.695919 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6c59c58e-9134-4005-a993-5fb1906224b1 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:44.699213 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6c59c58e-9134-4005-a993-5fb1906224b1 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:44.699867 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6c59c58e-9134-4005-a993-5fb1906224b1 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:44.700471 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6c59c58e-9134-4005-a993-5fb1906224b1 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:44.701604 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f436c1ac-dc39-4e25-b2ac-cfcfa61c78ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.457372 Oct 12 13:28:44.714538 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 736/1515] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:28:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 13:28:44.727042 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a9922f51-c8eb-44d3-bd10-a02217a0d5cb tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:44.727673 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a9922f51-c8eb-44d3-bd10-a02217a0d5cb tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:45.044853 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-a9922f51-c8eb-44d3-bd10-a02217a0d5cb tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:45.055280 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a9922f51-c8eb-44d3-bd10-a02217a0d5cb tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805" status: 200 len: 1218 microversion: 2.1 time: 0.339339 Oct 12 13:28:45.057421 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 737/1516] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:44 2022] GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805 => generated 1218 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:45.451988 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-6c59c58e-9134-4005-a993-5fb1906224b1 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:45.463385 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6c59c58e-9134-4005-a993-5fb1906224b1 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741" status: 200 len: 1470 microversion: 2.1 time: 0.804504 Oct 12 13:28:45.465130 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 780/1517] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:44 2022] GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741 => generated 1470 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:28:45.556459 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f1bf2947-8688-45fc-ab01-791344c709c5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:45.557121 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f1bf2947-8688-45fc-ab01-791344c709c5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:45.578132 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1bf2947-8688-45fc-ab01-791344c709c5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:45.578671 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1bf2947-8688-45fc-ab01-791344c709c5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:45.580653 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1bf2947-8688-45fc-ab01-791344c709c5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:45.584048 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1bf2947-8688-45fc-ab01-791344c709c5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:45.584650 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1bf2947-8688-45fc-ab01-791344c709c5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:45.586220 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1bf2947-8688-45fc-ab01-791344c709c5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:45.993945 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f1bf2947-8688-45fc-ab01-791344c709c5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:46.016573 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f1bf2947-8688-45fc-ab01-791344c709c5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:46.021165 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f1bf2947-8688-45fc-ab01-791344c709c5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:46.022668 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f1bf2947-8688-45fc-ab01-791344c709c5 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1407 microversion: 2.54 time: 0.470361 Oct 12 13:28:46.024149 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 738/1518] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:45 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1407 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:46.078648 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7fe36377-ea63-420d-80fd-3c41f56cf592 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:46.079285 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7fe36377-ea63-420d-80fd-3c41f56cf592 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:46.492097 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2728951b-c477-4acf-aca5-2c06a43e20f2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:46.492704 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2728951b-c477-4acf-aca5-2c06a43e20f2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2e5ecdb4-eaf0-4b44-9a4c-e442345da741] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:46.505952 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2728951b-c477-4acf-aca5-2c06a43e20f2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:46.506706 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2728951b-c477-4acf-aca5-2c06a43e20f2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:46.507319 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2728951b-c477-4acf-aca5-2c06a43e20f2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:46.508286 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2728951b-c477-4acf-aca5-2c06a43e20f2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:46.508936 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2728951b-c477-4acf-aca5-2c06a43e20f2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:46.509532 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2728951b-c477-4acf-aca5-2c06a43e20f2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:46.670924 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-2728951b-c477-4acf-aca5-2c06a43e20f2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:46.679508 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2728951b-c477-4acf-aca5-2c06a43e20f2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741" status: 200 len: 1428 microversion: 2.1 time: 0.191489 Oct 12 13:28:46.683411 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 739/1519] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:46 2022] GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741 => generated 1428 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:46.750705 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-7fe36377-ea63-420d-80fd-3c41f56cf592 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:46.762225 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-ea4372bb-1fa4-4ffb-8bd6-3ad8f71521b0 req-22d6aa0f-818d-4bee-afbc-5ce3266ba034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e5ecdb4-eaf0-4b44-9a4c-e442345da741", "name": "network-vif-deleted", "tag": "695f956c-e26c-42e8-9eef-abbf05e8c6fb"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:46.774221 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-7fe36377-ea63-420d-80fd-3c41f56cf592 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805" status: 200 len: 1218 microversion: 2.1 time: 0.697587 Oct 12 13:28:46.777862 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 781/1520] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:46 2022] GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805 => generated 1218 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:46.817773 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ea4372bb-1fa4-4ffb-8bd6-3ad8f71521b0 req-22d6aa0f-818d-4bee-afbc-5ce3266ba034 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:46.819590 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ea4372bb-1fa4-4ffb-8bd6-3ad8f71521b0 req-22d6aa0f-818d-4bee-afbc-5ce3266ba034 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:46.819590 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ea4372bb-1fa4-4ffb-8bd6-3ad8f71521b0 req-22d6aa0f-818d-4bee-afbc-5ce3266ba034 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:46.833333 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-ea4372bb-1fa4-4ffb-8bd6-3ad8f71521b0 req-22d6aa0f-818d-4bee-afbc-5ce3266ba034 service nova] Creating event network-vif-deleted:695f956c-e26c-42e8-9eef-abbf05e8c6fb for instance 2e5ecdb4-eaf0-4b44-9a4c-e442345da741 on n-h1-861076-2 Oct 12 13:28:46.841174 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-ea4372bb-1fa4-4ffb-8bd6-3ad8f71521b0 req-22d6aa0f-818d-4bee-afbc-5ce3266ba034 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091730 Oct 12 13:28:46.846058 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 740/1521] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:28:47.048658 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ce57aba8-593e-440d-8333-b9754bdd2d5d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:47.050028 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-ce57aba8-593e-440d-8333-b9754bdd2d5d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:47.063414 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ce57aba8-593e-440d-8333-b9754bdd2d5d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:47.063962 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ce57aba8-593e-440d-8333-b9754bdd2d5d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:47.064406 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ce57aba8-593e-440d-8333-b9754bdd2d5d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:47.065159 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ce57aba8-593e-440d-8333-b9754bdd2d5d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:47.065647 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ce57aba8-593e-440d-8333-b9754bdd2d5d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:47.066076 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ce57aba8-593e-440d-8333-b9754bdd2d5d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:47.154915 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-ce57aba8-593e-440d-8333-b9754bdd2d5d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:47.167343 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-ce57aba8-593e-440d-8333-b9754bdd2d5d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:47.168786 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-ce57aba8-593e-440d-8333-b9754bdd2d5d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:47.170216 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ce57aba8-593e-440d-8333-b9754bdd2d5d tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1407 microversion: 2.54 time: 0.125607 Oct 12 13:28:47.185461 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 782/1522] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:47 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1407 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:47.707592 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-78ef5532-225c-4f6b-a325-112e892c4db2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:47.708140 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-78ef5532-225c-4f6b-a325-112e892c4db2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2e5ecdb4-eaf0-4b44-9a4c-e442345da741] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:47.717232 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-78ef5532-225c-4f6b-a325-112e892c4db2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:47.722724 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-78ef5532-225c-4f6b-a325-112e892c4db2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:47.723465 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-78ef5532-225c-4f6b-a325-112e892c4db2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:47.727726 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-78ef5532-225c-4f6b-a325-112e892c4db2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:47.727726 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-78ef5532-225c-4f6b-a325-112e892c4db2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:47.727726 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-78ef5532-225c-4f6b-a325-112e892c4db2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:47.805886 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c287d8f0-9efe-442f-a14e-3c5e8e656fd3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:47.806759 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c287d8f0-9efe-442f-a14e-3c5e8e656fd3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:47.813753 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c287d8f0-9efe-442f-a14e-3c5e8e656fd3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:47.819295 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-78ef5532-225c-4f6b-a325-112e892c4db2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:47.820162 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c287d8f0-9efe-442f-a14e-3c5e8e656fd3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:47.820912 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-78ef5532-225c-4f6b-a325-112e892c4db2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:47.825735 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c287d8f0-9efe-442f-a14e-3c5e8e656fd3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:47.825735 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c287d8f0-9efe-442f-a14e-3c5e8e656fd3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:47.825735 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c287d8f0-9efe-442f-a14e-3c5e8e656fd3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:47.825735 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c287d8f0-9efe-442f-a14e-3c5e8e656fd3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:47.827161 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-78ef5532-225c-4f6b-a325-112e892c4db2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:47.830430 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-78ef5532-225c-4f6b-a325-112e892c4db2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lazy-loading 'fault' on Instance uuid 2e5ecdb4-eaf0-4b44-9a4c-e442345da741 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:28:47.838954 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:28:47.973819 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-78ef5532-225c-4f6b-a325-112e892c4db2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:47.985858 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-78ef5532-225c-4f6b-a325-112e892c4db2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741" status: 200 len: 1304 microversion: 2.1 time: 0.279962 Oct 12 13:28:47.985858 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 741/1523] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:47 2022] GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741 => generated 1304 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:48.031127 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-c287d8f0-9efe-442f-a14e-3c5e8e656fd3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:48.041120 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c287d8f0-9efe-442f-a14e-3c5e8e656fd3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805" status: 200 len: 1270 microversion: 2.1 time: 0.241801 Oct 12 13:28:48.042898 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 783/1524] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:47 2022] GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805 => generated 1270 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:48.203733 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f73571a2-d331-421e-a92e-506a2d957e82 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:48.204416 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f73571a2-d331-421e-a92e-506a2d957e82 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:48.226238 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f73571a2-d331-421e-a92e-506a2d957e82 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:48.226736 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f73571a2-d331-421e-a92e-506a2d957e82 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:48.227180 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f73571a2-d331-421e-a92e-506a2d957e82 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:48.227897 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f73571a2-d331-421e-a92e-506a2d957e82 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:48.228626 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f73571a2-d331-421e-a92e-506a2d957e82 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:48.229281 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f73571a2-d331-421e-a92e-506a2d957e82 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:48.328590 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f73571a2-d331-421e-a92e-506a2d957e82 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:48.348548 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f73571a2-d331-421e-a92e-506a2d957e82 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:48.352032 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f73571a2-d331-421e-a92e-506a2d957e82 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:48.354879 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f73571a2-d331-421e-a92e-506a2d957e82 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1407 microversion: 2.54 time: 0.155012 Oct 12 13:28:48.372544 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 742/1525] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:48 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:49.007669 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f6f48681-aa86-4ee4-be5b-19d6d5a40e77 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:49.008362 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f6f48681-aa86-4ee4-be5b-19d6d5a40e77 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 2e5ecdb4-eaf0-4b44-9a4c-e442345da741] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:49.024447 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f6f48681-aa86-4ee4-be5b-19d6d5a40e77 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:49.025035 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f6f48681-aa86-4ee4-be5b-19d6d5a40e77 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:49.025486 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f6f48681-aa86-4ee4-be5b-19d6d5a40e77 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:49.026199 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f6f48681-aa86-4ee4-be5b-19d6d5a40e77 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:49.026662 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f6f48681-aa86-4ee4-be5b-19d6d5a40e77 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:49.027090 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f6f48681-aa86-4ee4-be5b-19d6d5a40e77 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:49.058663 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-f6f48681-aa86-4ee4-be5b-19d6d5a40e77 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] HTTP exception thrown: Instance 2e5ecdb4-eaf0-4b44-9a4c-e442345da741 could not be found. Oct 12 13:28:49.060421 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f6f48681-aa86-4ee4-be5b-19d6d5a40e77 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Request method failure captured: Oct 12 13:28:49.060421 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741 HTTP/1.1 Oct 12 13:28:49.060421 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:28:49.060421 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:28:49.060421 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:28:49.060421 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:28:49.060421 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:28:49.060421 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:28:49.060421 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:28:49.060421 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:28:49.060421 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsBi4xHBrer6lBGhkUJpIvqrl1I3XTS6WcdnkMPTgyrBgwmWzXC1XxDw6f0DGeeOjkXunqcCiv1k_s6tGvtE00QiDmmCqY4XpmNm3xiVjOwWwX5Vqmi8mUgzLyqqJT0nte9-8TEG6VoiahlE1CIFzuYG5vXK3UP8kq6OohbCqDcfYiU Oct 12 13:28:49.060421 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:28:49.060421 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:28:49.060421 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:28:49.060421 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:28:49.060421 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:28:49.060421 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:28:49.060421 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 2bb790004fd34993aeee9b0f5820b798 Oct 12 13:28:49.060421 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServersAdminTestJSON-980445995 Oct 12 13:28:49.060421 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:28:49.060421 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:28:49.062341 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2bb790004fd34993aeee9b0f5820b798"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2bb790004fd34993aeee9b0f5820b798"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2bb790004fd34993aeee9b0f5820b798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2bb790004fd34993aeee9b0f5820b798"}]}] Oct 12 13:28:49.062341 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServersAdminTestJSON-980445995 Oct 12 13:28:49.062341 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 2bb790004fd34993aeee9b0f5820b798 Oct 12 13:28:49.062341 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServersAdminTestJSON-980445995 Oct 12 13:28:49.062341 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServersAdminTestJSON-980445995-project Oct 12 13:28:49.062341 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:28:49.062341 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:28:49.062341 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: aecb9d3ecf9d4f29bc40f00736887149 Oct 12 13:28:49.062341 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServersAdminTestJSON-980445995-project Oct 12 13:28:49.062341 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:28:49.062341 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance 2e5ecdb4-eaf0-4b44-9a4c-e442345da741 could not be found. Oct 12 13:28:49.062341 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '2e5ecdb4-eaf0-4b44-9a4c-e442345da741'} Oct 12 13:28:49.063272 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:28:49.063272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:49.063272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:28:49.063272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:28:49.063272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:28:49.063272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:28:49.063272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:28:49.063272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:28:49.063272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:28:49.063272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:28:49.063272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e5ecdb4-eaf0-4b44-9a4c-e442345da741 could not be found. Oct 12 13:28:49.063272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:49.063272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:28:49.063272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:49.063272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:49.063272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:28:49.063272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:28:49.063272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:28:49.063272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:28:49.063272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:28:49.064887 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:28:49.064887 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:28:49.064887 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:28:49.064887 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:28:49.064887 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:28:49.064887 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:28:49.064887 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:28:49.064887 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e5ecdb4-eaf0-4b44-9a4c-e442345da741 could not be found. Oct 12 13:28:49.064887 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:49.064887 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:28:49.064887 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:49.064887 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:49.064887 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:28:49.064887 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:28:49.064887 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:28:49.064887 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:28:49.064887 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e5ecdb4-eaf0-4b44-9a4c-e442345da741 could not be found. Oct 12 13:28:49.064887 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:49.066887 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f6f48681-aa86-4ee4-be5b-19d6d5a40e77 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Returning 404 to user: Instance 2e5ecdb4-eaf0-4b44-9a4c-e442345da741 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:28:49.066887 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f6f48681-aa86-4ee4-be5b-19d6d5a40e77 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741" status: 404 len: 111 microversion: 2.1 time: 0.058129 Oct 12 13:28:49.066887 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 784/1526] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:49 2022] GET /compute/v2.1/servers/2e5ecdb4-eaf0-4b44-9a4c-e442345da741 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:28:49.075462 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a5094034-0dc2-46e1-be78-b4455c9da817 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:49.076007 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a5094034-0dc2-46e1-be78-b4455c9da817 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:49.077019 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-00f38a2b-ff9f-4350-91e0-4957f3ca1cc8 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:49.077959 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-00f38a2b-ff9f-4350-91e0-4957f3ca1cc8 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:49.101598 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-00f38a2b-ff9f-4350-91e0-4957f3ca1cc8 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:49.101598 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-00f38a2b-ff9f-4350-91e0-4957f3ca1cc8 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:49.101934 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a5094034-0dc2-46e1-be78-b4455c9da817 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:49.101934 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a5094034-0dc2-46e1-be78-b4455c9da817 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:49.101934 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a5094034-0dc2-46e1-be78-b4455c9da817 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:49.101934 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a5094034-0dc2-46e1-be78-b4455c9da817 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:49.102334 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a5094034-0dc2-46e1-be78-b4455c9da817 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:49.102434 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-00f38a2b-ff9f-4350-91e0-4957f3ca1cc8 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:49.102542 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a5094034-0dc2-46e1-be78-b4455c9da817 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:49.102643 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-00f38a2b-ff9f-4350-91e0-4957f3ca1cc8 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:49.102643 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-00f38a2b-ff9f-4350-91e0-4957f3ca1cc8 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:49.102643 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-00f38a2b-ff9f-4350-91e0-4957f3ca1cc8 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:49.164906 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a5094034-0dc2-46e1-be78-b4455c9da817 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Going to try to terminate instance {{(pid=120933) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:28:49.271992 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:28:49.325373 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-00f38a2b-ff9f-4350-91e0-4957f3ca1cc8 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:49.334208 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-00f38a2b-ff9f-4350-91e0-4957f3ca1cc8 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805" status: 200 len: 1276 microversion: 2.1 time: 0.266153 Oct 12 13:28:49.359071 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 743/1527] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:49 2022] GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805 => generated 1276 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:49.400226 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8ed5a3ee-9276-4f07-989a-446a44a14681 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:49.400226 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8ed5a3ee-9276-4f07-989a-446a44a14681 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:49.437607 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8ed5a3ee-9276-4f07-989a-446a44a14681 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:49.438427 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8ed5a3ee-9276-4f07-989a-446a44a14681 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:49.448702 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8ed5a3ee-9276-4f07-989a-446a44a14681 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:49.450782 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8ed5a3ee-9276-4f07-989a-446a44a14681 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:49.451287 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8ed5a3ee-9276-4f07-989a-446a44a14681 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:49.454144 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8ed5a3ee-9276-4f07-989a-446a44a14681 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:49.674375 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a5094034-0dc2-46e1-be78-b4455c9da817 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 204 len: 0 microversion: 2.1 time: 0.605725 Oct 12 13:28:49.675843 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 785/1528] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:28:49 2022] DELETE /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:28:49.684030 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9db8615d-c5b5-4a21-bc67-2bdc0134055d tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:49.685006 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-9db8615d-c5b5-4a21-bc67-2bdc0134055d tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:49.705176 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9db8615d-c5b5-4a21-bc67-2bdc0134055d tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:49.707519 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9db8615d-c5b5-4a21-bc67-2bdc0134055d tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:49.709250 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9db8615d-c5b5-4a21-bc67-2bdc0134055d tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:49.712836 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9db8615d-c5b5-4a21-bc67-2bdc0134055d tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:49.713694 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9db8615d-c5b5-4a21-bc67-2bdc0134055d tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:49.719099 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9db8615d-c5b5-4a21-bc67-2bdc0134055d tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:50.344349 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8ed5a3ee-9276-4f07-989a-446a44a14681 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:50.354242 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8ed5a3ee-9276-4f07-989a-446a44a14681 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:50.356107 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8ed5a3ee-9276-4f07-989a-446a44a14681 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:50.357591 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8ed5a3ee-9276-4f07-989a-446a44a14681 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1407 microversion: 2.54 time: 0.972824 Oct 12 13:28:50.373001 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 744/1529] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:49 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1407 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:50.384471 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-23125d18-ca60-4791-af13-55ac946969b1 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:50.385442 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-23125d18-ca60-4791-af13-55ac946969b1 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:50.393463 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-23125d18-ca60-4791-af13-55ac946969b1 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:50.407848 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-23125d18-ca60-4791-af13-55ac946969b1 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:50.407848 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-23125d18-ca60-4791-af13-55ac946969b1 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:50.407848 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-23125d18-ca60-4791-af13-55ac946969b1 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:50.407848 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-23125d18-ca60-4791-af13-55ac946969b1 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:50.408335 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-23125d18-ca60-4791-af13-55ac946969b1 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:50.601037 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9db8615d-c5b5-4a21-bc67-2bdc0134055d tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:50.638218 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9db8615d-c5b5-4a21-bc67-2bdc0134055d tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1469 microversion: 2.1 time: 0.956468 Oct 12 13:28:50.644784 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 786/1530] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:49 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1469 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:50.926608 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-23125d18-ca60-4791-af13-55ac946969b1 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:50.954290 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-35c1b718-50b9-4bfa-b661-426d27b29dc0 tempest-ServersTestManualDisk-1147363400 tempest-ServersTestManualDisk-1147363400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-109422763", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "52ddeeb9-2d11-4548-80ab-8b8032af60ec"}], "security_groups": [{"name": "tempest-securitygroup--1499780325"}], "key_name": "tempest-keypair-1695804358", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:50.964095 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-23125d18-ca60-4791-af13-55ac946969b1 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805" status: 200 len: 1318 microversion: 2.1 time: 0.589078 Oct 12 13:28:50.964095 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 745/1531] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:50 2022] GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805 => generated 1318 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:51.389540 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8c1648f9-8d65-4fa7-8f25-aa34f31b370b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:51.390160 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8c1648f9-8d65-4fa7-8f25-aa34f31b370b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:51.400575 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8c1648f9-8d65-4fa7-8f25-aa34f31b370b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:51.400764 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-35c1b718-50b9-4bfa-b661-426d27b29dc0 tempest-ServersTestManualDisk-1147363400 tempest-ServersTestManualDisk-1147363400-project] validate_networks() for [('52ddeeb9-2d11-4548-80ab-8b8032af60ec', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:28:51.402716 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8c1648f9-8d65-4fa7-8f25-aa34f31b370b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:51.403788 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8c1648f9-8d65-4fa7-8f25-aa34f31b370b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:51.405116 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8c1648f9-8d65-4fa7-8f25-aa34f31b370b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:51.405763 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8c1648f9-8d65-4fa7-8f25-aa34f31b370b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:51.406551 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8c1648f9-8d65-4fa7-8f25-aa34f31b370b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:51.521626 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8c1648f9-8d65-4fa7-8f25-aa34f31b370b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:51.529803 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8c1648f9-8d65-4fa7-8f25-aa34f31b370b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:51.531253 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8c1648f9-8d65-4fa7-8f25-aa34f31b370b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:51.532426 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8c1648f9-8d65-4fa7-8f25-aa34f31b370b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1407 microversion: 2.54 time: 0.149327 Oct 12 13:28:51.533630 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 746/1532] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:51 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:51.844330 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-68a9d578-e672-4559-aa1a-4ae98f832c43 tempest-ExtensionsTest-609458482 tempest-ExtensionsTest-609458482-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:51.846484 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-68a9d578-e672-4559-aa1a-4ae98f832c43 tempest-ExtensionsTest-609458482 tempest-ExtensionsTest-609458482-project] 10.222.0.52 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.311933 Oct 12 13:28:51.848064 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 747/1533] 10.222.0.52 () {58 vars in 1170 bytes} [Wed Oct 12 13:28:51 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:28:51.859360 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-27011e56-16a3-4bb3-a2df-5c0b5846e5e2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:51.861588 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-27011e56-16a3-4bb3-a2df-5c0b5846e5e2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:51.872233 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-27011e56-16a3-4bb3-a2df-5c0b5846e5e2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:51.872749 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-27011e56-16a3-4bb3-a2df-5c0b5846e5e2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:51.873860 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-27011e56-16a3-4bb3-a2df-5c0b5846e5e2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:51.875342 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-27011e56-16a3-4bb3-a2df-5c0b5846e5e2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:51.875851 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-27011e56-16a3-4bb3-a2df-5c0b5846e5e2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:51.878062 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-27011e56-16a3-4bb3-a2df-5c0b5846e5e2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:51.988035 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-35c1b718-50b9-4bfa-b661-426d27b29dc0 tempest-ServersTestManualDisk-1147363400 tempest-ServersTestManualDisk-1147363400-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-678741a0-a875-4ef9-95cb-c07259e18ad9) Oct 12 13:28:51.988035 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:51.988035 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:28:51.988035 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:28:51.988035 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:51.988035 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:51.988035 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:51.988035 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:51.988035 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:51.988035 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:51.988035 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:28:51.988035 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:28:51.988035 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:28:51.988035 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:28:51.988035 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:28:51.988035 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:28:51.989979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:28:51.989979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:28:51.989979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:28:51.989979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:28:51.989979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:28:51.989979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:28:51.989979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:28:51.989979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:28:51.989979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:28:51.989979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:28:51.989979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:28:51.989979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:51.989979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:51.989979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:28:51.989979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:28:51.989979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:51.989979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:51.989979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:28:51.991903 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:28:51.991903 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:51.991903 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:51.991903 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:28:51.991903 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:28:51.991903 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:51.991903 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:51.991903 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:28:51.991903 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:28:51.991903 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:28:51.991903 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:28:51.991903 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:28:51.991903 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:28:51.991903 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:28:51.991903 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:28:51.991903 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:28:51.991903 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:28:51.991903 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:28:51.993577 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:28:51.993577 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:28:51.993577 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:28:51.993577 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:28:51.993577 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:28:51.993577 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:28:51.993577 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:28:51.993577 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:28:51.993577 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:28:51.993577 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:28:51.993577 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:28:51.993577 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:28:51.993577 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:28:51.993577 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:28:51.993577 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:28:51.994864 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-678741a0-a875-4ef9-95cb-c07259e18ad9) Oct 12 13:28:51.994864 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:51.997086 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-35c1b718-50b9-4bfa-b661-426d27b29dc0 tempest-ServersTestManualDisk-1147363400 tempest-ServersTestManualDisk-1147363400-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:51.997086 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:28:51.998746 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-35c1b718-50b9-4bfa-b661-426d27b29dc0 tempest-ServersTestManualDisk-1147363400 tempest-ServersTestManualDisk-1147363400-project] Request method failure captured: Oct 12 13:28:51.998746 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:28:51.998746 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:28:51.998746 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:28:51.998746 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:28:51.998746 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 640 Oct 12 13:28:51.998746 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:28:51.998746 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:28:51.998746 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:28:51.998746 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:28:51.998746 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsEL1k8KR1ANOguJZyhfT9fKBqeP9MyiYuo1pKJu7c7PMiM7ShBqqsPH-iuFORQkEteVa1WjBfcaFaHwLT-OSgf5fn8gv3tfezWZMJPrOHAVAYP-MQ_Ndol5vzQhYOdii72TxwsUWLVBo2hPN2SzoLOuQ0QmllUA7drtkqFsxd5KMXo Oct 12 13:28:51.998746 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:28:51.998746 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:28:51.998746 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:28:51.998746 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:28:51.998746 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:28:51.998746 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:28:51.998746 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: fd6d592722e64729ad72f62ccd53f2f5 Oct 12 13:28:51.998746 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServersTestManualDisk-1147363400 Oct 12 13:28:51.998746 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:28:51.998746 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:28:52.000572 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fd6d592722e64729ad72f62ccd53f2f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fd6d592722e64729ad72f62ccd53f2f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fd6d592722e64729ad72f62ccd53f2f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fd6d592722e64729ad72f62ccd53f2f5"}]}] Oct 12 13:28:52.000572 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServersTestManualDisk-1147363400 Oct 12 13:28:52.000572 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: fd6d592722e64729ad72f62ccd53f2f5 Oct 12 13:28:52.000572 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServersTestManualDisk-1147363400 Oct 12 13:28:52.000572 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServersTestManualDisk-1147363400-project Oct 12 13:28:52.000572 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:28:52.000572 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:28:52.000572 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: da9da4be0b2f49f19e146c46ad0f82e4 Oct 12 13:28:52.000572 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServersTestManualDisk-1147363400-project Oct 12 13:28:52.000572 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:28:52.001549 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-ServersTestManualDisk-server-109422763", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "Z6!Xmu0IbFrzGN^", "networks": [{"uuid": "52ddeeb9-2d11-4548-80ab-8b8032af60ec"}], "security_groups": [{"name": "tempest-securitygroup--1499780325"}], "key_name": "tempest-keypair-1695804358", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "MANUAL"}} Oct 12 13:28:52.001549 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:28:52.001549 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:52.001549 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:28:52.001549 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-ServersTestManualDisk-server-109422763', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'metadata': {'hello': 'world'}, 'adminPass': 'Z6!Xmu0IbFrzGN^', 'networks': [{'uuid': '52ddeeb9-2d11-4548-80ab-8b8032af60ec'}], 'security_groups': [{'name': 'tempest-securitygroup--1499780325'}], 'key_name': 'tempest-keypair-1695804358', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 12 13:28:52.001549 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:28:52.001549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:52.001549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:28:52.001549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:28:52.001549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:52.002691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:52.002691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:52.002691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:52.002691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:28:52.002691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:28:52.002691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:28:52.002691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:28:52.002691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:28:52.002691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:28:52.002691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:28:52.002691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:28:52.002691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:28:52.002691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:28:52.002691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:28:52.002691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:28:52.002691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:28:52.002691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:28:52.002691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:28:52.002691 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:28:52.004272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:28:52.004272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:28:52.004272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:28:52.004272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:52.004272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:52.004272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:28:52.004272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:28:52.004272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:52.004272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:52.004272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:28:52.004272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:28:52.004272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:52.004272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:52.004272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:28:52.004272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:28:52.004272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:28:52.004272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:28:52.004272 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:28:52.006219 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:28:52.006219 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:28:52.006219 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:28:52.006219 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:28:52.006219 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:28:52.006219 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:28:52.006219 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:28:52.006219 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:28:52.006219 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:28:52.006219 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:28:52.006219 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:28:52.006219 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:28:52.006219 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:28:52.006219 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:28:52.006219 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:28:52.006219 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:28:52.006219 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:28:52.008700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:28:52.008700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:28:52.008700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:28:52.008700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:28:52.008700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:28:52.008700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:28:52.008700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:28:52.008700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:28:52.008700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-678741a0-a875-4ef9-95cb-c07259e18ad9) Oct 12 13:28:52.008700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:52.008700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:28:52.008700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:52.008700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:52.008700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:28:52.008700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:28:52.008700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:28:52.008700 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:28:52.011052 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:28:52.011052 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:28:52.011052 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:52.011052 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:52.011052 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:52.011052 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:28:52.011052 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:52.011052 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:52.011052 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:28:52.011052 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:28:52.011052 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:28:52.011052 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:28:52.011052 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:52.011052 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:52.011052 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:28:52.011052 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-35c1b718-50b9-4bfa-b661-426d27b29dc0 tempest-ServersTestManualDisk-1147363400 tempest-ServersTestManualDisk-1147363400-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:28:52.011052 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:28:52.013910 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-35c1b718-50b9-4bfa-b661-426d27b29dc0 tempest-ServersTestManualDisk-1147363400 tempest-ServersTestManualDisk-1147363400-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.063799 Oct 12 13:28:52.013910 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 787/1534] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:28:50 2022] POST /compute/v2.1/servers => generated 214 bytes in 1065 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 12 13:28:52.019444 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b59a900f-d15a-4dfd-a872-7ea42631d5de tempest-ExtensionsTest-609458482 tempest-ExtensionsTest-609458482-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:52.022518 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b59a900f-d15a-4dfd-a872-7ea42631d5de tempest-ExtensionsTest-609458482 tempest-ExtensionsTest-609458482-project] 10.222.0.52 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.009870 Oct 12 13:28:52.024455 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 788/1535] 10.222.0.52 () {58 vars in 1134 bytes} [Wed Oct 12 13:28:52 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 13:28:52.043349 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-24d0f7af-8b09-4c0b-8b1c-5871b4d32cab tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:52.044347 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-24d0f7af-8b09-4c0b-8b1c-5871b4d32cab tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:52.053747 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-24d0f7af-8b09-4c0b-8b1c-5871b4d32cab tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:52.054247 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-24d0f7af-8b09-4c0b-8b1c-5871b4d32cab tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:52.054691 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-24d0f7af-8b09-4c0b-8b1c-5871b4d32cab tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:52.055404 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-24d0f7af-8b09-4c0b-8b1c-5871b4d32cab tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:52.056031 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-24d0f7af-8b09-4c0b-8b1c-5871b4d32cab tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:52.056462 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-24d0f7af-8b09-4c0b-8b1c-5871b4d32cab tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:52.545299 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-27011e56-16a3-4bb3-a2df-5c0b5846e5e2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:52.553328 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-27011e56-16a3-4bb3-a2df-5c0b5846e5e2 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1469 microversion: 2.1 time: 0.700738 Oct 12 13:28:52.566288 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 748/1536] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:51 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1469 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:52.572500 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-92628bb2-7978-4fab-bd99-5fe35b5d1975 tempest-ServersTestManualDisk-1147363400 tempest-ServersTestManualDisk-1147363400-project] Calling method '.version_select at 0x7f8a9ba295e0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:52.597666 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-24d0f7af-8b09-4c0b-8b1c-5871b4d32cab tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:52.606030 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-24d0f7af-8b09-4c0b-8b1c-5871b4d32cab tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805" status: 200 len: 1318 microversion: 2.1 time: 0.578304 Oct 12 13:28:52.606605 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 789/1537] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:52 2022] GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805 => generated 1318 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:52.611423 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2d09158e-2aab-4204-9ae0-d00fd8d861bb tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:52.612266 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-2d09158e-2aab-4204-9ae0-d00fd8d861bb tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:52.619108 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2d09158e-2aab-4204-9ae0-d00fd8d861bb tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:52.619694 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2d09158e-2aab-4204-9ae0-d00fd8d861bb tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:52.620322 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2d09158e-2aab-4204-9ae0-d00fd8d861bb tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:52.621164 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2d09158e-2aab-4204-9ae0-d00fd8d861bb tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:52.621707 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2d09158e-2aab-4204-9ae0-d00fd8d861bb tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:52.622356 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2d09158e-2aab-4204-9ae0-d00fd8d861bb tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:52.700315 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-2d09158e-2aab-4204-9ae0-d00fd8d861bb tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:52.711078 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-2d09158e-2aab-4204-9ae0-d00fd8d861bb tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:52.712829 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-2d09158e-2aab-4204-9ae0-d00fd8d861bb tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:52.714859 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2d09158e-2aab-4204-9ae0-d00fd8d861bb tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1407 microversion: 2.54 time: 0.106386 Oct 12 13:28:52.715747 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 790/1538] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:52 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:52.723425 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-92628bb2-7978-4fab-bd99-5fe35b5d1975 tempest-ServersTestManualDisk-1147363400 tempest-ServersTestManualDisk-1147363400-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695804358" status: 202 len: 0 microversion: 2.1 time: 0.155511 Oct 12 13:28:52.724481 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 749/1539] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 12 13:28:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695804358 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:28:52.942762 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-9fcf1c70-b870-451e-bb96-4c1b0e357627 req-48d7e9ba-5535-4536-90ed-09dda0c0fea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fbda837-cf92-4aa6-8551-96cd4a3f1b80", "name": "network-vif-deleted", "tag": "cf85a1bd-8e0c-48d6-9580-9faf6388ba80"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:52.953011 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-9fcf1c70-b870-451e-bb96-4c1b0e357627 req-48d7e9ba-5535-4536-90ed-09dda0c0fea2 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:52.953886 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-9fcf1c70-b870-451e-bb96-4c1b0e357627 req-48d7e9ba-5535-4536-90ed-09dda0c0fea2 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:52.954535 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-9fcf1c70-b870-451e-bb96-4c1b0e357627 req-48d7e9ba-5535-4536-90ed-09dda0c0fea2 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:52.967165 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-9fcf1c70-b870-451e-bb96-4c1b0e357627 req-48d7e9ba-5535-4536-90ed-09dda0c0fea2 service nova] Creating event network-vif-deleted:cf85a1bd-8e0c-48d6-9580-9faf6388ba80 for instance 3fbda837-cf92-4aa6-8551-96cd4a3f1b80 on n-h1-861076-2 Oct 12 13:28:52.974371 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-9fcf1c70-b870-451e-bb96-4c1b0e357627 req-48d7e9ba-5535-4536-90ed-09dda0c0fea2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035646 Oct 12 13:28:52.975068 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 791/1540] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:28:53.589825 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-610edffe-43e5-4ce8-93ea-08494c91bb4c tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:53.590333 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-610edffe-43e5-4ce8-93ea-08494c91bb4c tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:53.602515 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-610edffe-43e5-4ce8-93ea-08494c91bb4c tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:53.603019 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-610edffe-43e5-4ce8-93ea-08494c91bb4c tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:53.606749 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-610edffe-43e5-4ce8-93ea-08494c91bb4c tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:53.607866 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-610edffe-43e5-4ce8-93ea-08494c91bb4c tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:53.608683 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-610edffe-43e5-4ce8-93ea-08494c91bb4c tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:53.609300 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-610edffe-43e5-4ce8-93ea-08494c91bb4c tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:53.630942 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f55760df-e593-481b-93d4-8099859293c4 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:53.633100 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f55760df-e593-481b-93d4-8099859293c4 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:53.650397 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f55760df-e593-481b-93d4-8099859293c4 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:53.654526 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f55760df-e593-481b-93d4-8099859293c4 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:53.655008 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f55760df-e593-481b-93d4-8099859293c4 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:53.655747 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f55760df-e593-481b-93d4-8099859293c4 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:53.656213 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f55760df-e593-481b-93d4-8099859293c4 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:53.656639 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f55760df-e593-481b-93d4-8099859293c4 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:53.726454 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-610edffe-43e5-4ce8-93ea-08494c91bb4c tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:53.727836 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-610edffe-43e5-4ce8-93ea-08494c91bb4c tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:53.729556 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-610edffe-43e5-4ce8-93ea-08494c91bb4c tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:53.731419 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-610edffe-43e5-4ce8-93ea-08494c91bb4c tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lazy-loading 'fault' on Instance uuid 3fbda837-cf92-4aa6-8551-96cd4a3f1b80 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:28:53.839457 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-610edffe-43e5-4ce8-93ea-08494c91bb4c tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecb9d3ecf9d4f29bc40f00736887149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb790004fd34993aeee9b0f5820b798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:53.847981 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-610edffe-43e5-4ce8-93ea-08494c91bb4c tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 200 len: 1303 microversion: 2.1 time: 0.262869 Oct 12 13:28:53.863274 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 750/1541] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:53 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 1303 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:53.869454 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1505996a-6357-43f9-bc2c-f09cd703ac03 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:53.870295 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1505996a-6357-43f9-bc2c-f09cd703ac03 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:53.892926 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1505996a-6357-43f9-bc2c-f09cd703ac03 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:53.893686 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1505996a-6357-43f9-bc2c-f09cd703ac03 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:53.894308 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1505996a-6357-43f9-bc2c-f09cd703ac03 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:53.895230 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1505996a-6357-43f9-bc2c-f09cd703ac03 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:53.895874 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1505996a-6357-43f9-bc2c-f09cd703ac03 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:53.896488 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1505996a-6357-43f9-bc2c-f09cd703ac03 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:54.005369 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-1505996a-6357-43f9-bc2c-f09cd703ac03 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:54.015389 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-1505996a-6357-43f9-bc2c-f09cd703ac03 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:54.017652 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-1505996a-6357-43f9-bc2c-f09cd703ac03 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:54.018888 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1505996a-6357-43f9-bc2c-f09cd703ac03 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1407 microversion: 2.54 time: 0.156376 Oct 12 13:28:54.019452 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 751/1542] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:53 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:54.134461 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f55760df-e593-481b-93d4-8099859293c4 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:54.146337 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f55760df-e593-481b-93d4-8099859293c4 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805" status: 200 len: 1318 microversion: 2.1 time: 0.519448 Oct 12 13:28:54.150453 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 792/1543] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:53 2022] GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805 => generated 1318 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:28:54.370696 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-21aab97a-391a-4860-8b94-5e59fa7465d4 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-748425748", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": "none"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:54.427138 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:28:54.472292 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-21aab97a-391a-4860-8b94-5e59fa7465d4 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:28:54.472729 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-21aab97a-391a-4860-8b94-5e59fa7465d4 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:28:54.473249 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-21aab97a-391a-4860-8b94-5e59fa7465d4 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:28:54.473665 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-21aab97a-391a-4860-8b94-5e59fa7465d4 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:28:54.474087 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-21aab97a-391a-4860-8b94-5e59fa7465d4 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:28:54.497080 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-21aab97a-391a-4860-8b94-5e59fa7465d4 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:54.497977 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-21aab97a-391a-4860-8b94-5e59fa7465d4 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:54.498822 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-21aab97a-391a-4860-8b94-5e59fa7465d4 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:54.499795 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-21aab97a-391a-4860-8b94-5e59fa7465d4 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:54.500266 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-21aab97a-391a-4860-8b94-5e59fa7465d4 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:54.500701 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-21aab97a-391a-4860-8b94-5e59fa7465d4 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:54.529849 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-21aab97a-391a-4860-8b94-5e59fa7465d4 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Getting quotas for project 67eb4b79a11f440db02f09d62b478cc6. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:28:54.543179 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-21aab97a-391a-4860-8b94-5e59fa7465d4 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Getting quotas for user ea94127c4bb043f9b9b7fbf6de00584c and project 67eb4b79a11f440db02f09d62b478cc6. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:28:54.563918 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-21aab97a-391a-4860-8b94-5e59fa7465d4 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:28:54.566744 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-21aab97a-391a-4860-8b94-5e59fa7465d4 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 62558ce2-7abd-4687-8887-14d341462e99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:28:54.812391 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-21aab97a-391a-4860-8b94-5e59fa7465d4 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.786367 Oct 12 13:28:54.813248 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 752/1544] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 12 13:28:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 13:28:54.826712 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0ae941fe-0f30-426d-b108-0534fcfd2e11 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:54.828696 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-0ae941fe-0f30-426d-b108-0534fcfd2e11 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 62558ce2-7abd-4687-8887-14d341462e99] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:54.873243 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-daf4ecb1-ca95-483a-a1fa-b2dab0d82549 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:54.874121 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-daf4ecb1-ca95-483a-a1fa-b2dab0d82549 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] [instance: 3fbda837-cf92-4aa6-8551-96cd4a3f1b80] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:54.882463 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-daf4ecb1-ca95-483a-a1fa-b2dab0d82549 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:54.883222 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-daf4ecb1-ca95-483a-a1fa-b2dab0d82549 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:54.883915 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-daf4ecb1-ca95-483a-a1fa-b2dab0d82549 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:54.884803 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-daf4ecb1-ca95-483a-a1fa-b2dab0d82549 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:54.885454 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-daf4ecb1-ca95-483a-a1fa-b2dab0d82549 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:54.886057 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-daf4ecb1-ca95-483a-a1fa-b2dab0d82549 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:54.913531 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-daf4ecb1-ca95-483a-a1fa-b2dab0d82549 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] HTTP exception thrown: Instance 3fbda837-cf92-4aa6-8551-96cd4a3f1b80 could not be found. Oct 12 13:28:54.915209 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-daf4ecb1-ca95-483a-a1fa-b2dab0d82549 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Request method failure captured: Oct 12 13:28:54.915209 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 HTTP/1.1 Oct 12 13:28:54.915209 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:28:54.915209 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:28:54.915209 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:28:54.915209 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:28:54.915209 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:28:54.915209 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:28:54.915209 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:28:54.915209 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:28:54.915209 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsBi4xHBrer6lBGhkUJpIvqrl1I3XTS6WcdnkMPTgyrBgwmWzXC1XxDw6f0DGeeOjkXunqcCiv1k_s6tGvtE00QiDmmCqY4XpmNm3xiVjOwWwX5Vqmi8mUgzLyqqJT0nte9-8TEG6VoiahlE1CIFzuYG5vXK3UP8kq6OohbCqDcfYiU Oct 12 13:28:54.915209 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:28:54.915209 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:28:54.915209 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:28:54.915209 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:28:54.915209 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:28:54.915209 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:28:54.915209 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 2bb790004fd34993aeee9b0f5820b798 Oct 12 13:28:54.915209 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServersAdminTestJSON-980445995 Oct 12 13:28:54.915209 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:28:54.915209 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:28:54.920808 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2bb790004fd34993aeee9b0f5820b798"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2bb790004fd34993aeee9b0f5820b798"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2bb790004fd34993aeee9b0f5820b798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2bb790004fd34993aeee9b0f5820b798"}]}] Oct 12 13:28:54.920808 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServersAdminTestJSON-980445995 Oct 12 13:28:54.920808 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 2bb790004fd34993aeee9b0f5820b798 Oct 12 13:28:54.920808 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServersAdminTestJSON-980445995 Oct 12 13:28:54.920808 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServersAdminTestJSON-980445995-project Oct 12 13:28:54.920808 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:28:54.920808 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:28:54.920808 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: aecb9d3ecf9d4f29bc40f00736887149 Oct 12 13:28:54.920808 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServersAdminTestJSON-980445995-project Oct 12 13:28:54.920808 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:28:54.920808 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance 3fbda837-cf92-4aa6-8551-96cd4a3f1b80 could not be found. Oct 12 13:28:54.920808 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '3fbda837-cf92-4aa6-8551-96cd4a3f1b80'} Oct 12 13:28:54.921937 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:28:54.921937 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:54.921937 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:28:54.921937 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:28:54.921937 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:28:54.921937 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:28:54.921937 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:28:54.921937 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:28:54.921937 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:28:54.921937 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:28:54.921937 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fbda837-cf92-4aa6-8551-96cd4a3f1b80 could not be found. Oct 12 13:28:54.921937 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:28:54.921937 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:28:54.921937 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:28:54.921937 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:54.921937 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:28:54.921937 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:28:54.921937 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:28:54.921937 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:28:54.921937 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:28:54.923380 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:28:54.923380 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:28:54.923380 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:28:54.923380 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:28:54.923380 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:28:54.923380 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:28:54.923380 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:28:54.923380 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fbda837-cf92-4aa6-8551-96cd4a3f1b80 could not be found. Oct 12 13:28:54.923380 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:28:54.923380 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:28:54.923380 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:28:54.923380 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:28:54.923380 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:28:54.923380 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:28:54.923380 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:28:54.923380 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:28:54.923380 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fbda837-cf92-4aa6-8551-96cd4a3f1b80 could not be found. Oct 12 13:28:54.923380 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:28:54.925646 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-daf4ecb1-ca95-483a-a1fa-b2dab0d82549 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] Returning 404 to user: Instance 3fbda837-cf92-4aa6-8551-96cd4a3f1b80 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:28:54.925646 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-daf4ecb1-ca95-483a-a1fa-b2dab0d82549 tempest-ServersAdminTestJSON-980445995 tempest-ServersAdminTestJSON-980445995-project] 10.222.0.52 "GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80" status: 404 len: 111 microversion: 2.1 time: 0.047452 Oct 12 13:28:54.925646 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 753/1545] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:54 2022] GET /compute/v2.1/servers/3fbda837-cf92-4aa6-8551-96cd4a3f1b80 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 13:28:54.942500 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-0ae941fe-0f30-426d-b108-0534fcfd2e11 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:54.954458 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-0ae941fe-0f30-426d-b108-0534fcfd2e11 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:54.957300 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-0ae941fe-0f30-426d-b108-0534fcfd2e11 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:54.958702 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0ae941fe-0f30-426d-b108-0534fcfd2e11 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/62558ce2-7abd-4687-8887-14d341462e99" status: 200 len: 1277 microversion: 2.47 time: 0.137120 Oct 12 13:28:54.960169 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 793/1546] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:54 2022] GET /compute/v2.1/servers/62558ce2-7abd-4687-8887-14d341462e99 => generated 1277 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:55.037380 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-da8bf4d8-06ff-4d15-bfd5-bcf30083901f req-20f42ad6-4ce7-4727-82a7-8573246c137f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9922a424-28b3-4f9c-a13a-7a5fa11fa805", "tag": "69c1a565-df7e-4919-ab81-f1d086f1349e"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:55.045517 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ef1b58ea-83eb-4ade-a681-b09d0195d9a6 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:55.047409 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-ef1b58ea-83eb-4ade-a681-b09d0195d9a6 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:55.051493 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:28:55.056365 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-da8bf4d8-06ff-4d15-bfd5-bcf30083901f req-20f42ad6-4ce7-4727-82a7-8573246c137f service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:55.056868 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-da8bf4d8-06ff-4d15-bfd5-bcf30083901f req-20f42ad6-4ce7-4727-82a7-8573246c137f service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:55.057343 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-da8bf4d8-06ff-4d15-bfd5-bcf30083901f req-20f42ad6-4ce7-4727-82a7-8573246c137f service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:55.064968 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ef1b58ea-83eb-4ade-a681-b09d0195d9a6 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:55.068341 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ef1b58ea-83eb-4ade-a681-b09d0195d9a6 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:55.069215 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ef1b58ea-83eb-4ade-a681-b09d0195d9a6 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:55.077752 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ef1b58ea-83eb-4ade-a681-b09d0195d9a6 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:55.077752 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ef1b58ea-83eb-4ade-a681-b09d0195d9a6 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:55.077752 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ef1b58ea-83eb-4ade-a681-b09d0195d9a6 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:55.092096 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-da8bf4d8-06ff-4d15-bfd5-bcf30083901f req-20f42ad6-4ce7-4727-82a7-8573246c137f service nova] Creating event network-changed:69c1a565-df7e-4919-ab81-f1d086f1349e for instance 9922a424-28b3-4f9c-a13a-7a5fa11fa805 on n-h1-861076-2 Oct 12 13:28:55.102267 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-da8bf4d8-06ff-4d15-bfd5-bcf30083901f req-20f42ad6-4ce7-4727-82a7-8573246c137f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068686 Oct 12 13:28:55.106544 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 754/1547] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:28:55.175670 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3035317b-4e58-41e2-8392-92c50b1a773d tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:55.176332 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3035317b-4e58-41e2-8392-92c50b1a773d tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:55.184928 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3035317b-4e58-41e2-8392-92c50b1a773d tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:55.185439 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3035317b-4e58-41e2-8392-92c50b1a773d tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:55.185879 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3035317b-4e58-41e2-8392-92c50b1a773d tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:55.186590 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3035317b-4e58-41e2-8392-92c50b1a773d tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:55.187047 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3035317b-4e58-41e2-8392-92c50b1a773d tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:55.187479 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3035317b-4e58-41e2-8392-92c50b1a773d tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:55.406107 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-ef1b58ea-83eb-4ade-a681-b09d0195d9a6 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:55.420454 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-ef1b58ea-83eb-4ade-a681-b09d0195d9a6 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:55.423126 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-ef1b58ea-83eb-4ade-a681-b09d0195d9a6 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:55.425653 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ef1b58ea-83eb-4ade-a681-b09d0195d9a6 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1407 microversion: 2.54 time: 0.384238 Oct 12 13:28:55.429393 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 794/1548] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:55 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1407 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:28:55.446398 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f0f5785b-1505-409c-b181-db8bb30d146e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-261400556", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": "none"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:55.541885 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-f0f5785b-1505-409c-b181-db8bb30d146e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:28:55.541885 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-f0f5785b-1505-409c-b181-db8bb30d146e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:28:55.541885 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-f0f5785b-1505-409c-b181-db8bb30d146e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:28:55.541885 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-f0f5785b-1505-409c-b181-db8bb30d146e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:28:55.541885 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-f0f5785b-1505-409c-b181-db8bb30d146e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:28:55.550785 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f0f5785b-1505-409c-b181-db8bb30d146e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:55.551473 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f0f5785b-1505-409c-b181-db8bb30d146e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:55.552073 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f0f5785b-1505-409c-b181-db8bb30d146e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:55.553009 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f0f5785b-1505-409c-b181-db8bb30d146e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:55.553634 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f0f5785b-1505-409c-b181-db8bb30d146e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:55.554256 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f0f5785b-1505-409c-b181-db8bb30d146e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:55.590763 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-f0f5785b-1505-409c-b181-db8bb30d146e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Getting quotas for project 67eb4b79a11f440db02f09d62b478cc6. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:28:55.593792 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-3035317b-4e58-41e2-8392-92c50b1a773d tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:55.602741 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-f0f5785b-1505-409c-b181-db8bb30d146e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Getting quotas for user ea94127c4bb043f9b9b7fbf6de00584c and project 67eb4b79a11f440db02f09d62b478cc6. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:28:55.615101 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3035317b-4e58-41e2-8392-92c50b1a773d tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805" status: 200 len: 1318 microversion: 2.1 time: 0.444667 Oct 12 13:28:55.629293 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 755/1549] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:55 2022] GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805 => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:55.632396 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f0f5785b-1505-409c-b181-db8bb30d146e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Going to run 1 instances... {{(pid=120933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:28:55.632778 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f0f5785b-1505-409c-b181-db8bb30d146e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:28:55.786525 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f0f5785b-1505-409c-b181-db8bb30d146e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.355588 Oct 12 13:28:55.796001 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 795/1550] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 12 13:28:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 366 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 13:28:55.801829 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b67cef4c-58d7-41a3-8bd1-580be874a3eb tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:28:55.806741 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b67cef4c-58d7-41a3-8bd1-580be874a3eb tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:55.940884 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b67cef4c-58d7-41a3-8bd1-580be874a3eb tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "PUT /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 991 microversion: 2.47 time: 0.145581 Oct 12 13:28:55.953673 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 756/1551] 10.222.0.52 () {62 vars in 1297 bytes} [Wed Oct 12 13:28:55 2022] PUT /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 991 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 13:28:55.981615 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9f3d50d5-39e9-49b4-bc00-34bf24f7d85e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:55.993048 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-9f3d50d5-39e9-49b4-bc00-34bf24f7d85e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:56.178017 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9f3d50d5-39e9-49b4-bc00-34bf24f7d85e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:56.190250 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9f3d50d5-39e9-49b4-bc00-34bf24f7d85e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:56.195580 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9f3d50d5-39e9-49b4-bc00-34bf24f7d85e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:56.197037 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9f3d50d5-39e9-49b4-bc00-34bf24f7d85e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1277 microversion: 2.47 time: 0.220424 Oct 12 13:28:56.200083 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 796/1552] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:55 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1277 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:56.458038 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-caa84c73-383c-4fc0-a415-daf9f6d78f8a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:56.459999 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-caa84c73-383c-4fc0-a415-daf9f6d78f8a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:56.473569 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-caa84c73-383c-4fc0-a415-daf9f6d78f8a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:56.475760 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-caa84c73-383c-4fc0-a415-daf9f6d78f8a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:56.476930 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-caa84c73-383c-4fc0-a415-daf9f6d78f8a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:56.479748 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-caa84c73-383c-4fc0-a415-daf9f6d78f8a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:56.481200 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-caa84c73-383c-4fc0-a415-daf9f6d78f8a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:56.481749 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-caa84c73-383c-4fc0-a415-daf9f6d78f8a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:56.641806 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-117bcbdc-999e-4ab4-8431-61c8f87804f3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:56.642478 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-117bcbdc-999e-4ab4-8431-61c8f87804f3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:56.655279 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-117bcbdc-999e-4ab4-8431-61c8f87804f3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:56.657072 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-117bcbdc-999e-4ab4-8431-61c8f87804f3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:56.660470 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-117bcbdc-999e-4ab4-8431-61c8f87804f3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:56.661279 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-117bcbdc-999e-4ab4-8431-61c8f87804f3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:56.661754 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-117bcbdc-999e-4ab4-8431-61c8f87804f3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:56.662187 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-117bcbdc-999e-4ab4-8431-61c8f87804f3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:56.856955 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-caa84c73-383c-4fc0-a415-daf9f6d78f8a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:56.894518 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-caa84c73-383c-4fc0-a415-daf9f6d78f8a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:56.900030 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-caa84c73-383c-4fc0-a415-daf9f6d78f8a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:56.903440 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-caa84c73-383c-4fc0-a415-daf9f6d78f8a tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1407 microversion: 2.54 time: 0.450956 Oct 12 13:28:56.905381 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 757/1553] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:56 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1407 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:57.229956 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-46d343da-15df-40b1-9c06-ed9def7440dd tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:57.231300 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-46d343da-15df-40b1-9c06-ed9def7440dd tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:57.454373 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-46d343da-15df-40b1-9c06-ed9def7440dd tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:57.466461 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-46d343da-15df-40b1-9c06-ed9def7440dd tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:57.468120 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-46d343da-15df-40b1-9c06-ed9def7440dd tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:57.472592 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-46d343da-15df-40b1-9c06-ed9def7440dd tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1277 microversion: 2.47 time: 0.248759 Oct 12 13:28:57.479044 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 758/1554] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:57 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1277 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:57.900832 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-117bcbdc-999e-4ab4-8431-61c8f87804f3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:57.920235 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-117bcbdc-999e-4ab4-8431-61c8f87804f3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805" status: 200 len: 1318 microversion: 2.1 time: 1.283382 Oct 12 13:28:57.929119 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 797/1555] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:56 2022] GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805 => generated 1318 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:57.938154 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7fbdfb4b-f329-454d-82ab-9a80ef65abd9 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:57.938899 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7fbdfb4b-f329-454d-82ab-9a80ef65abd9 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:57.962149 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7fbdfb4b-f329-454d-82ab-9a80ef65abd9 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:57.962645 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7fbdfb4b-f329-454d-82ab-9a80ef65abd9 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:57.970870 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7fbdfb4b-f329-454d-82ab-9a80ef65abd9 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:57.972179 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7fbdfb4b-f329-454d-82ab-9a80ef65abd9 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:57.972822 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7fbdfb4b-f329-454d-82ab-9a80ef65abd9 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:57.973439 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7fbdfb4b-f329-454d-82ab-9a80ef65abd9 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:58.419070 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-7fbdfb4b-f329-454d-82ab-9a80ef65abd9 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:58.434347 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-7fbdfb4b-f329-454d-82ab-9a80ef65abd9 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:58.438529 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-7fbdfb4b-f329-454d-82ab-9a80ef65abd9 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:58.442274 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7fbdfb4b-f329-454d-82ab-9a80ef65abd9 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1413 microversion: 2.54 time: 0.513163 Oct 12 13:28:58.445219 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 759/1556] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:57 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1413 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:58.511156 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fb82327a-2d8c-4819-be86-c6002d14176d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:58.511658 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-fb82327a-2d8c-4819-be86-c6002d14176d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:58.536371 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb82327a-2d8c-4819-be86-c6002d14176d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:58.536872 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb82327a-2d8c-4819-be86-c6002d14176d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:58.541076 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb82327a-2d8c-4819-be86-c6002d14176d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:58.542508 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb82327a-2d8c-4819-be86-c6002d14176d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:58.542991 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb82327a-2d8c-4819-be86-c6002d14176d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:58.545432 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb82327a-2d8c-4819-be86-c6002d14176d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:58.747649 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-fb82327a-2d8c-4819-be86-c6002d14176d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:58.781129 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-fb82327a-2d8c-4819-be86-c6002d14176d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:58.788975 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-fb82327a-2d8c-4819-be86-c6002d14176d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:58.793055 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fb82327a-2d8c-4819-be86-c6002d14176d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1329 microversion: 2.47 time: 0.288711 Oct 12 13:28:58.796252 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 798/1557] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:58 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1329 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:28:58.960453 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a94410b7-b115-45ff-adfe-9601783a55e1 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:58.961958 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a94410b7-b115-45ff-adfe-9601783a55e1 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:58.990906 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a94410b7-b115-45ff-adfe-9601783a55e1 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:58.993505 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a94410b7-b115-45ff-adfe-9601783a55e1 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:58.995878 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a94410b7-b115-45ff-adfe-9601783a55e1 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:58.997314 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a94410b7-b115-45ff-adfe-9601783a55e1 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:59.002119 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a94410b7-b115-45ff-adfe-9601783a55e1 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:59.002905 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a94410b7-b115-45ff-adfe-9601783a55e1 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:59.199703 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e58632ff-835f-4a0d-b404-d4fff25112f4 tempest-ComputeTenantNetworksTest-687129254 tempest-ComputeTenantNetworksTest-687129254-project] Calling method '.version_select at 0x7f8a9b6725e0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:59.566385 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a94410b7-b115-45ff-adfe-9601783a55e1 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:28:59.577682 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a94410b7-b115-45ff-adfe-9601783a55e1 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805" status: 200 len: 1318 microversion: 2.1 time: 0.631303 Oct 12 13:28:59.580432 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 799/1558] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:28:58 2022] GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805 => generated 1318 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:28:59.589145 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-aeac1651-2bbe-4c8d-8560-9a0b7848ce06 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:28:59.614942 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-aeac1651-2bbe-4c8d-8560-9a0b7848ce06 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:28:59.633843 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-aeac1651-2bbe-4c8d-8560-9a0b7848ce06 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:59.634580 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-aeac1651-2bbe-4c8d-8560-9a0b7848ce06 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:59.636939 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-aeac1651-2bbe-4c8d-8560-9a0b7848ce06 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:59.638594 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-aeac1651-2bbe-4c8d-8560-9a0b7848ce06 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:28:59.640425 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-aeac1651-2bbe-4c8d-8560-9a0b7848ce06 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:28:59.641681 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-aeac1651-2bbe-4c8d-8560-9a0b7848ce06 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:28:59.755828 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e58632ff-835f-4a0d-b404-d4fff25112f4 tempest-ComputeTenantNetworksTest-687129254 tempest-ComputeTenantNetworksTest-687129254-project] 10.222.0.52 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.882510 Oct 12 13:28:59.756462 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 760/1559] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 12 13:28:58 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:28:59.767794 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-19a2420c-1fd6-4a5d-a0a7-f56909cc6ba4 tempest-ComputeTenantNetworksTest-687129254 tempest-ComputeTenantNetworksTest-687129254-project] Calling method '.version_select at 0x7f8a9ba05e50>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:00.001817 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-19a2420c-1fd6-4a5d-a0a7-f56909cc6ba4 tempest-ComputeTenantNetworksTest-687129254 tempest-ComputeTenantNetworksTest-687129254-project] 10.222.0.52 "GET /compute/v2.1/os-tenant-networks/39e303be-d393-4d21-9e86-80fcbb3fcbe9" status: 200 len: 140 microversion: 2.1 time: 0.237878 Oct 12 13:29:00.010024 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 761/1560] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 12 13:28:59 2022] GET /compute/v2.1/os-tenant-networks/39e303be-d393-4d21-9e86-80fcbb3fcbe9 => generated 140 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:29:00.017324 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ff917010-219c-41f4-9970-db0100426a1d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:00.018110 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ff917010-219c-41f4-9970-db0100426a1d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:00.029440 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff917010-219c-41f4-9970-db0100426a1d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:00.037071 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff917010-219c-41f4-9970-db0100426a1d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:00.039200 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff917010-219c-41f4-9970-db0100426a1d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:00.041594 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff917010-219c-41f4-9970-db0100426a1d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:00.042977 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff917010-219c-41f4-9970-db0100426a1d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:00.045283 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff917010-219c-41f4-9970-db0100426a1d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:00.125640 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-aeac1651-2bbe-4c8d-8560-9a0b7848ce06 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:00.143687 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-aeac1651-2bbe-4c8d-8560-9a0b7848ce06 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:00.146640 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-aeac1651-2bbe-4c8d-8560-9a0b7848ce06 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:00.149946 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-aeac1651-2bbe-4c8d-8560-9a0b7848ce06 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1413 microversion: 2.54 time: 0.568092 Oct 12 13:29:00.153270 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 800/1561] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:28:59 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1413 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:00.173793 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-c9997ddb-c6c9-462c-a1ea-36010aecf030 req-4176a59d-65e3-41f0-b607-282d60a8ee7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9922a424-28b3-4f9c-a13a-7a5fa11fa805", "name": "network-vif-plugged", "status": "completed", "tag": "69c1a565-df7e-4919-ab81-f1d086f1349e"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:00.204210 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-c9997ddb-c6c9-462c-a1ea-36010aecf030 req-4176a59d-65e3-41f0-b607-282d60a8ee7c service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:00.206357 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-c9997ddb-c6c9-462c-a1ea-36010aecf030 req-4176a59d-65e3-41f0-b607-282d60a8ee7c service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:00.206357 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-c9997ddb-c6c9-462c-a1ea-36010aecf030 req-4176a59d-65e3-41f0-b607-282d60a8ee7c service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:00.222061 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-ff917010-219c-41f4-9970-db0100426a1d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:00.231709 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-ff917010-219c-41f4-9970-db0100426a1d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:00.238723 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-ff917010-219c-41f4-9970-db0100426a1d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:00.241420 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-c9997ddb-c6c9-462c-a1ea-36010aecf030 req-4176a59d-65e3-41f0-b607-282d60a8ee7c service nova] Creating event network-vif-plugged:69c1a565-df7e-4919-ab81-f1d086f1349e for instance 9922a424-28b3-4f9c-a13a-7a5fa11fa805 on n-h1-861076-2 Oct 12 13:29:00.255455 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ff917010-219c-41f4-9970-db0100426a1d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1337 microversion: 2.47 time: 0.230260 Oct 12 13:29:00.255455 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 762/1562] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:00 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1337 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:00.270161 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-c9997ddb-c6c9-462c-a1ea-36010aecf030 req-4176a59d-65e3-41f0-b607-282d60a8ee7c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115376 Oct 12 13:29:00.276470 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 801/1563] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:29:00.602301 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5f5817f1-2caf-4683-848b-c7a4503222c3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:00.603682 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5f5817f1-2caf-4683-848b-c7a4503222c3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:00.619352 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f5817f1-2caf-4683-848b-c7a4503222c3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:00.623516 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f5817f1-2caf-4683-848b-c7a4503222c3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:00.624562 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f5817f1-2caf-4683-848b-c7a4503222c3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:00.628456 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f5817f1-2caf-4683-848b-c7a4503222c3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:00.629156 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f5817f1-2caf-4683-848b-c7a4503222c3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:00.630588 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f5817f1-2caf-4683-848b-c7a4503222c3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:01.160800 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-5f5817f1-2caf-4683-848b-c7a4503222c3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:01.176327 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5f5817f1-2caf-4683-848b-c7a4503222c3 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805" status: 200 len: 1318 microversion: 2.1 time: 0.578887 Oct 12 13:29:01.177246 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 763/1564] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:29:00 2022] GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805 => generated 1318 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:29:01.181018 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7ec51df3-38cd-4bf2-b7e8-8fab02d15551 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:01.181731 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7ec51df3-38cd-4bf2-b7e8-8fab02d15551 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:01.195035 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7ec51df3-38cd-4bf2-b7e8-8fab02d15551 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:01.198702 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7ec51df3-38cd-4bf2-b7e8-8fab02d15551 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:01.198702 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7ec51df3-38cd-4bf2-b7e8-8fab02d15551 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:01.198702 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7ec51df3-38cd-4bf2-b7e8-8fab02d15551 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:01.198702 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7ec51df3-38cd-4bf2-b7e8-8fab02d15551 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:01.206146 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7ec51df3-38cd-4bf2-b7e8-8fab02d15551 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:01.269737 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6203fa01-d241-4619-9cda-84fff570a2f1 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:01.270629 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6203fa01-d241-4619-9cda-84fff570a2f1 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:01.282650 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6203fa01-d241-4619-9cda-84fff570a2f1 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:01.284065 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6203fa01-d241-4619-9cda-84fff570a2f1 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:01.285660 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6203fa01-d241-4619-9cda-84fff570a2f1 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:01.287325 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6203fa01-d241-4619-9cda-84fff570a2f1 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:01.289470 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6203fa01-d241-4619-9cda-84fff570a2f1 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:01.303569 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6203fa01-d241-4619-9cda-84fff570a2f1 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:01.417242 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-7ec51df3-38cd-4bf2-b7e8-8fab02d15551 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:01.452271 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-7ec51df3-38cd-4bf2-b7e8-8fab02d15551 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:01.454859 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-7ec51df3-38cd-4bf2-b7e8-8fab02d15551 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:01.457251 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-7ec51df3-38cd-4bf2-b7e8-8fab02d15551 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1413 microversion: 2.54 time: 0.280444 Oct 12 13:29:01.459364 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 802/1565] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:01 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1413 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:29:01.961566 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-6203fa01-d241-4619-9cda-84fff570a2f1 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:01.980520 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-6203fa01-d241-4619-9cda-84fff570a2f1 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:01.982226 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-6203fa01-d241-4619-9cda-84fff570a2f1 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:01.992281 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6203fa01-d241-4619-9cda-84fff570a2f1 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1335 microversion: 2.47 time: 0.725050 Oct 12 13:29:01.992936 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 764/1566] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:01 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1335 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:29:02.202426 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9b1676a3-0c62-4366-91c2-62b6a5e6966f tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:02.203046 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-9b1676a3-0c62-4366-91c2-62b6a5e6966f tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:02.226554 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9b1676a3-0c62-4366-91c2-62b6a5e6966f tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:02.227066 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9b1676a3-0c62-4366-91c2-62b6a5e6966f tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:02.227505 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9b1676a3-0c62-4366-91c2-62b6a5e6966f tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:02.229470 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9b1676a3-0c62-4366-91c2-62b6a5e6966f tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:02.230374 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9b1676a3-0c62-4366-91c2-62b6a5e6966f tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:02.231898 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9b1676a3-0c62-4366-91c2-62b6a5e6966f tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:02.487092 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2783de98-042f-4436-8d63-83962c49dc0b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:02.487758 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2783de98-042f-4436-8d63-83962c49dc0b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:02.503107 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2783de98-042f-4436-8d63-83962c49dc0b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:02.503649 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2783de98-042f-4436-8d63-83962c49dc0b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:02.504096 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2783de98-042f-4436-8d63-83962c49dc0b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:02.506116 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2783de98-042f-4436-8d63-83962c49dc0b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:02.506596 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2783de98-042f-4436-8d63-83962c49dc0b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:02.507035 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2783de98-042f-4436-8d63-83962c49dc0b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:02.549949 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9b1676a3-0c62-4366-91c2-62b6a5e6966f tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:02.569139 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9b1676a3-0c62-4366-91c2-62b6a5e6966f tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805" status: 200 len: 1318 microversion: 2.1 time: 0.371034 Oct 12 13:29:02.570247 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 803/1567] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:29:02 2022] GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805 => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:29:02.708022 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-2783de98-042f-4436-8d63-83962c49dc0b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:02.712153 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=100 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:29:02.729083 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-2783de98-042f-4436-8d63-83962c49dc0b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:02.732624 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-2783de98-042f-4436-8d63-83962c49dc0b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:02.737310 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2783de98-042f-4436-8d63-83962c49dc0b tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1398 microversion: 2.54 time: 0.252673 Oct 12 13:29:02.739807 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 765/1568] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:02 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1398 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:02.770755 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7014e6ab-8bad-45b4-82b2-3c31e522dde1 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '.version_select at 0x7f8a9ba42430>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:02.894448 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7014e6ab-8bad-45b4-82b2-3c31e522dde1 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-117988738" status: 204 len: 0 microversion: 2.54 time: 0.128513 Oct 12 13:29:02.899439 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 766/1569] 10.222.0.52 () {60 vars in 1316 bytes} [Wed Oct 12 13:29:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-117988738 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 13:29:02.910544 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-51a36d12-9ab0-4dae-8a4a-8f33cb00e086 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:02.911461 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-51a36d12-9ab0-4dae-8a4a-8f33cb00e086 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:02.919763 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-51a36d12-9ab0-4dae-8a4a-8f33cb00e086 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:02.920381 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-51a36d12-9ab0-4dae-8a4a-8f33cb00e086 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:02.921874 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-51a36d12-9ab0-4dae-8a4a-8f33cb00e086 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:02.922254 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-51a36d12-9ab0-4dae-8a4a-8f33cb00e086 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:02.922955 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-51a36d12-9ab0-4dae-8a4a-8f33cb00e086 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:02.923847 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-51a36d12-9ab0-4dae-8a4a-8f33cb00e086 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:02.959137 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-51a36d12-9ab0-4dae-8a4a-8f33cb00e086 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:29:03.079749 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2ad9d1b4-d0ce-4cd7-b3b7-e926493714e0 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-335150532", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "5e07b9b1-b128-4756-b270-a30579f500f6"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:03.195004 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-2ad9d1b4-d0ce-4cd7-b3b7-e926493714e0 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] validate_networks() for [('5e07b9b1-b128-4756-b270-a30579f500f6', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:29:03.400496 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-51a36d12-9ab0-4dae-8a4a-8f33cb00e086 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "DELETE /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 204 len: 0 microversion: 2.54 time: 0.494870 Oct 12 13:29:03.401791 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 767/1570] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 12 13:29:02 2022] DELETE /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 13:29:03.408528 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bb005578-7c7c-4573-8122-1e8f1f2827e9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:03.411468 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-bb005578-7c7c-4573-8122-1e8f1f2827e9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:03.423352 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb005578-7c7c-4573-8122-1e8f1f2827e9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:03.424580 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb005578-7c7c-4573-8122-1e8f1f2827e9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:03.425415 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb005578-7c7c-4573-8122-1e8f1f2827e9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:03.426619 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb005578-7c7c-4573-8122-1e8f1f2827e9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:03.427243 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb005578-7c7c-4573-8122-1e8f1f2827e9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:03.428576 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb005578-7c7c-4573-8122-1e8f1f2827e9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:03.553075 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-bb005578-7c7c-4573-8122-1e8f1f2827e9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:03.576613 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-bb005578-7c7c-4573-8122-1e8f1f2827e9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:03.594461 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-bb005578-7c7c-4573-8122-1e8f1f2827e9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:03.600123 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bb005578-7c7c-4573-8122-1e8f1f2827e9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1335 microversion: 2.47 time: 0.196697 Oct 12 13:29:03.625106 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 768/1571] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:03 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1335 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:03.632001 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a92f5047-c82b-4ee3-85b2-e753f1641eef tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:03.633034 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a92f5047-c82b-4ee3-85b2-e753f1641eef tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:03.644389 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a92f5047-c82b-4ee3-85b2-e753f1641eef tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:03.645878 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a92f5047-c82b-4ee3-85b2-e753f1641eef tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:03.646601 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a92f5047-c82b-4ee3-85b2-e753f1641eef tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:03.647523 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a92f5047-c82b-4ee3-85b2-e753f1641eef tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:03.648151 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a92f5047-c82b-4ee3-85b2-e753f1641eef tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:03.649351 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a92f5047-c82b-4ee3-85b2-e753f1641eef tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:03.852227 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-a92f5047-c82b-4ee3-85b2-e753f1641eef tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:03.870252 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-a92f5047-c82b-4ee3-85b2-e753f1641eef tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:03.874165 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-a92f5047-c82b-4ee3-85b2-e753f1641eef tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:03.875426 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a92f5047-c82b-4ee3-85b2-e753f1641eef tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1404 microversion: 2.54 time: 0.248951 Oct 12 13:29:03.876005 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 769/1572] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:03 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1404 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:03.892415 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6e4ca014-031c-4875-b185-070f823d15ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:03.894810 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6e4ca014-031c-4875-b185-070f823d15ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:03.898126 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=93,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:29:03.923012 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e4ca014-031c-4875-b185-070f823d15ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:03.923549 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e4ca014-031c-4875-b185-070f823d15ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:03.925299 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e4ca014-031c-4875-b185-070f823d15ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:03.926307 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e4ca014-031c-4875-b185-070f823d15ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:03.926671 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e4ca014-031c-4875-b185-070f823d15ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:03.927327 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e4ca014-031c-4875-b185-070f823d15ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:04.431885 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-2ad9d1b4-d0ce-4cd7-b3b7-e926493714e0 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b6413837-500e-4b98-a3f7-003514c972f4) Oct 12 13:29:04.431885 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:04.431885 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:04.431885 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:04.431885 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:04.431885 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:04.431885 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:04.431885 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:04.431885 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:04.431885 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:04.431885 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:29:04.431885 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:29:04.431885 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:29:04.431885 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:29:04.431885 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:29:04.431885 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:29:04.433629 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:29:04.433629 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:29:04.433629 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:29:04.433629 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:29:04.433629 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:29:04.433629 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:29:04.433629 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:29:04.433629 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:29:04.433629 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:29:04.433629 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:29:04.433629 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:29:04.433629 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:04.433629 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:04.433629 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:29:04.433629 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:29:04.433629 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:04.433629 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:04.433629 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:29:04.438286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:29:04.438286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:04.438286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:04.438286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:29:04.438286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:29:04.438286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:04.438286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:04.438286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:29:04.438286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:29:04.438286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:29:04.438286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:29:04.438286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:29:04.438286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:29:04.438286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:29:04.438286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:29:04.438286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:29:04.438286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:29:04.438286 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:29:04.439979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:29:04.439979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:29:04.439979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:29:04.439979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:29:04.439979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:29:04.439979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:29:04.439979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:29:04.439979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:29:04.439979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:29:04.439979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:29:04.439979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:29:04.439979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:29:04.439979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:29:04.439979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:29:04.439979 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b6413837-500e-4b98-a3f7-003514c972f4) Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-2ad9d1b4-d0ce-4cd7-b3b7-e926493714e0 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2ad9d1b4-d0ce-4cd7-b3b7-e926493714e0 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] Request method failure captured: Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 207 Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsEelmONuTF87F2c8Yzr-lX-esRJmFaEBs3F5iqLi5CVDclHBf4BhM2QSF-VzfklmfQ63rKsZGhAlHQhoae_TwB4LYe_x1bWQV2CDqOv5pSqEYh3AfcTcI7QHPTe4L_COual14KpmZUJJ9TIGLxzIcrTW06kmVASBh8SgBMPclBkQ8Q Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 10999e69618145e98836ff018fa734a4 Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ImagesNegativeTestJSON-2106444997 Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:29:04.441320 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:29:04.443437 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/10999e69618145e98836ff018fa734a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_10999e69618145e98836ff018fa734a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/10999e69618145e98836ff018fa734a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/10999e69618145e98836ff018fa734a4"}]}] Oct 12 13:29:04.443437 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ImagesNegativeTestJSON-2106444997 Oct 12 13:29:04.443437 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 10999e69618145e98836ff018fa734a4 Oct 12 13:29:04.443437 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2106444997 Oct 12 13:29:04.443437 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ImagesNegativeTestJSON-2106444997-project Oct 12 13:29:04.443437 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:29:04.443437 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:29:04.443437 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: ae145e5d37a3415b9158a043dc5465d3 Oct 12 13:29:04.443437 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ImagesNegativeTestJSON-2106444997-project Oct 12 13:29:04.443437 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:04.443437 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-335150532", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "5e07b9b1-b128-4756-b270-a30579f500f6"}]}} Oct 12 13:29:04.444454 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:29:04.444454 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:04.444454 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:04.444454 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-ImagesNegativeTestJSON-server-335150532', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '5e07b9b1-b128-4756-b270-a30579f500f6'}]}}} Oct 12 13:29:04.444454 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:04.444454 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:04.444454 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:04.444454 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:04.444454 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:04.444454 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:04.444454 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:04.444454 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:04.444454 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:04.444454 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:04.444454 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:29:04.444454 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:29:04.444454 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:29:04.444454 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:29:04.444454 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:29:04.446085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:29:04.446085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:29:04.446085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:29:04.446085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:29:04.446085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:29:04.446085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:29:04.446085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:29:04.446085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:29:04.446085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:29:04.446085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:29:04.446085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:29:04.446085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:29:04.446085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:04.446085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:04.446085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:29:04.446085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:29:04.446085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:04.446085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:04.447600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:29:04.447600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:29:04.447600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:04.447600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:04.447600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:29:04.447600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:29:04.447600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:04.447600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:04.447600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:29:04.447600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:29:04.447600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:29:04.447600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:29:04.447600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:29:04.447600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:29:04.447600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:29:04.447600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:29:04.447600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:29:04.447600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:29:04.452083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:29:04.452083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:29:04.452083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:29:04.452083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:29:04.452083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:29:04.452083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:29:04.452083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:29:04.452083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:29:04.452083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:29:04.452083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:29:04.452083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:29:04.452083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:29:04.452083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:29:04.452083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:29:04.452083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:29:04.452083 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:29:04.453873 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b6413837-500e-4b98-a3f7-003514c972f4) Oct 12 13:29:04.453873 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:04.453873 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:04.453873 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:04.453873 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:04.453873 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:04.453873 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:04.453873 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:04.453873 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:04.453873 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:29:04.453873 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:29:04.453873 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:04.453873 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:04.453873 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:04.453873 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:04.453873 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:04.453873 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:04.453873 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:04.453873 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:04.456725 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:04.456725 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:04.456725 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:04.456725 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:04.456725 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:04.456725 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2ad9d1b4-d0ce-4cd7-b3b7-e926493714e0 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:04.456725 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:04.456725 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2ad9d1b4-d0ce-4cd7-b3b7-e926493714e0 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.864042 Oct 12 13:29:04.456725 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 804/1573] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:29:02 2022] POST /compute/v2.1/servers => generated 214 bytes in 1865 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:29:04.469151 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-afa32fc7-454e-407c-a9a5-2c085e2ba957 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2077992989", "metadata": {"image_type": "test"}}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:04.473309 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-afa32fc7-454e-407c-a9a5-2c085e2ba957 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] Failed to fetch instance by id tempest-invalid-194208691 {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 13:29:04.479844 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-afa32fc7-454e-407c-a9a5-2c085e2ba957 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] HTTP exception thrown: Instance tempest-invalid-194208691 could not be found. Oct 12 13:29:04.482377 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-afa32fc7-454e-407c-a9a5-2c085e2ba957 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] Request method failure captured: Oct 12 13:29:04.482377 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers/tempest-invalid-194208691/action HTTP/1.1 Oct 12 13:29:04.482377 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:29:04.482377 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:29:04.482377 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:29:04.482377 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 112 Oct 12 13:29:04.482377 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:29:04.482377 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:29:04.482377 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:29:04.482377 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:04.482377 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsEelmONuTF87F2c8Yzr-lX-esRJmFaEBs3F5iqLi5CVDclHBf4BhM2QSF-VzfklmfQ63rKsZGhAlHQhoae_TwB4LYe_x1bWQV2CDqOv5pSqEYh3AfcTcI7QHPTe4L_COual14KpmZUJJ9TIGLxzIcrTW06kmVASBh8SgBMPclBkQ8Q Oct 12 13:29:04.482377 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:29:04.482377 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:29:04.482377 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:29:04.482377 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:29:04.482377 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:29:04.482377 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:29:04.482377 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 10999e69618145e98836ff018fa734a4 Oct 12 13:29:04.482377 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ImagesNegativeTestJSON-2106444997 Oct 12 13:29:04.482377 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:29:04.482377 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:29:04.484379 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/10999e69618145e98836ff018fa734a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_10999e69618145e98836ff018fa734a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/10999e69618145e98836ff018fa734a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/10999e69618145e98836ff018fa734a4"}]}] Oct 12 13:29:04.484379 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ImagesNegativeTestJSON-2106444997 Oct 12 13:29:04.484379 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 10999e69618145e98836ff018fa734a4 Oct 12 13:29:04.484379 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2106444997 Oct 12 13:29:04.484379 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ImagesNegativeTestJSON-2106444997-project Oct 12 13:29:04.484379 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:29:04.484379 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:29:04.484379 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: ae145e5d37a3415b9158a043dc5465d3 Oct 12 13:29:04.484379 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ImagesNegativeTestJSON-2106444997-project Oct 12 13:29:04.484379 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:04.484379 n-d-861076-2 devstack@n-api.service[120933]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2077992989", "metadata": {"image_type": "test"}}} Oct 12 13:29:04.484379 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:29:04.487224 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance tempest-invalid-194208691 could not be found. Oct 12 13:29:04.487224 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'tempest-invalid-194208691', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-2077992989', 'metadata': {'image_type': 'test'}}}} Oct 12 13:29:04.487224 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:04.487224 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:04.487224 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:29:04.487224 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:29:04.487224 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 13:29:04.487224 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 13:29:04.487224 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-194208691 could not be found. Oct 12 13:29:04.487224 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:04.487224 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:04.487224 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:04.487224 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:04.487224 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:04.487224 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:04.487224 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:04.487224 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:04.487224 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:04.487224 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:04.487224 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:04.488983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:04.488983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:04.488983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:04.488983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 12 13:29:04.488983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 13:29:04.488983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:29:04.488983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:29:04.488983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:29:04.488983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:29:04.488983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-194208691 could not be found. Oct 12 13:29:04.488983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:04.488983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:04.488983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:04.488983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:04.488983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:04.488983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:04.488983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:04.488983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:04.488983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-194208691 could not be found. Oct 12 13:29:04.488983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:04.490710 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-afa32fc7-454e-407c-a9a5-2c085e2ba957 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] Returning 404 to user: Instance tempest-invalid-194208691 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:04.491433 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-afa32fc7-454e-407c-a9a5-2c085e2ba957 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] 10.222.0.52 "POST /compute/v2.1/servers/tempest-invalid-194208691/action" status: 404 len: 100 microversion: 2.1 time: 0.028827 Oct 12 13:29:04.493291 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 805/1574] 10.222.0.52 () {60 vars in 1246 bytes} [Wed Oct 12 13:29:04 2022] POST /compute/v2.1/servers/tempest-invalid-194208691/action => generated 100 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:29:04.513840 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cdf3d324-0488-488d-988e-321fb75f7851 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1681373931"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:04.516335 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-cdf3d324-0488-488d-988e-321fb75f7851 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 13:29:04.521015 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-cdf3d324-0488-488d-988e-321fb75f7851 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 13:29:04.521015 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cdf3d324-0488-488d-988e-321fb75f7851 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] Request method failure captured: Oct 12 13:29:04.521015 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 12 13:29:04.521015 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:29:04.521015 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:29:04.521015 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:29:04.521015 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 57 Oct 12 13:29:04.521015 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:29:04.521015 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:29:04.521015 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:29:04.521015 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:04.521015 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsEelmONuTF87F2c8Yzr-lX-esRJmFaEBs3F5iqLi5CVDclHBf4BhM2QSF-VzfklmfQ63rKsZGhAlHQhoae_TwB4LYe_x1bWQV2CDqOv5pSqEYh3AfcTcI7QHPTe4L_COual14KpmZUJJ9TIGLxzIcrTW06kmVASBh8SgBMPclBkQ8Q Oct 12 13:29:04.521015 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:29:04.521015 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:29:04.521015 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:29:04.521015 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:29:04.521015 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:29:04.521015 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:29:04.521015 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 10999e69618145e98836ff018fa734a4 Oct 12 13:29:04.521015 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ImagesNegativeTestJSON-2106444997 Oct 12 13:29:04.521015 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:29:04.521015 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:29:04.523016 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/10999e69618145e98836ff018fa734a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_10999e69618145e98836ff018fa734a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/10999e69618145e98836ff018fa734a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/10999e69618145e98836ff018fa734a4"}]}] Oct 12 13:29:04.523016 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ImagesNegativeTestJSON-2106444997 Oct 12 13:29:04.523016 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 10999e69618145e98836ff018fa734a4 Oct 12 13:29:04.523016 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2106444997 Oct 12 13:29:04.523016 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ImagesNegativeTestJSON-2106444997-project Oct 12 13:29:04.523016 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:29:04.523016 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:29:04.523016 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: ae145e5d37a3415b9158a043dc5465d3 Oct 12 13:29:04.523016 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ImagesNegativeTestJSON-2106444997-project Oct 12 13:29:04.523016 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:04.523016 n-d-861076-2 devstack@n-api.service[120933]: {"createImage": {"name": "tempest-test-snap-1681373931"}} Oct 12 13:29:04.523016 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:29:04.523016 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 13:29:04.524037 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1681373931'}}} Oct 12 13:29:04.524037 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:04.524037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:04.524037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:29:04.524037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:29:04.524037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 13:29:04.524037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 13:29:04.524037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 13:29:04.524037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:04.524037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:04.524037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:04.524037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:04.524037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:04.524037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:04.524037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:04.524037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:04.524037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:04.524037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:04.524037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:04.524037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:04.525806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:04.525806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:04.525806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 12 13:29:04.525806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 13:29:04.525806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:29:04.525806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:29:04.525806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:29:04.525806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:29:04.525806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 13:29:04.525806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:04.525806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:04.525806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:04.525806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:04.525806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:04.525806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:04.525806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:04.525806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:04.525806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 13:29:04.525806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:04.527988 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-cdf3d324-0488-488d-988e-321fb75f7851 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:04.527988 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-cdf3d324-0488-488d-988e-321fb75f7851 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] 10.222.0.52 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.022333 Oct 12 13:29:04.527988 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 806/1575] 10.222.0.52 () {60 vars in 1275 bytes} [Wed Oct 12 13:29:04 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:29:04.534949 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9683dae3-3e0b-4298-b46b-86515f47a5f5 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2071969716"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:04.537857 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-9683dae3-3e0b-4298-b46b-86515f47a5f5 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 13:29:04.538658 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-9683dae3-3e0b-4298-b46b-86515f47a5f5 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 13:29:04.541109 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9683dae3-3e0b-4298-b46b-86515f47a5f5 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] Request method failure captured: Oct 12 13:29:04.541109 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 12 13:29:04.541109 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:29:04.541109 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:29:04.541109 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:29:04.541109 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 57 Oct 12 13:29:04.541109 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:29:04.541109 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:29:04.541109 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:29:04.541109 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:04.541109 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsEelmONuTF87F2c8Yzr-lX-esRJmFaEBs3F5iqLi5CVDclHBf4BhM2QSF-VzfklmfQ63rKsZGhAlHQhoae_TwB4LYe_x1bWQV2CDqOv5pSqEYh3AfcTcI7QHPTe4L_COual14KpmZUJJ9TIGLxzIcrTW06kmVASBh8SgBMPclBkQ8Q Oct 12 13:29:04.541109 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:29:04.541109 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:29:04.541109 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:29:04.541109 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:29:04.541109 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:29:04.541109 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:29:04.541109 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 10999e69618145e98836ff018fa734a4 Oct 12 13:29:04.541109 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ImagesNegativeTestJSON-2106444997 Oct 12 13:29:04.541109 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:29:04.541109 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:29:04.542938 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/10999e69618145e98836ff018fa734a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_10999e69618145e98836ff018fa734a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/10999e69618145e98836ff018fa734a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/10999e69618145e98836ff018fa734a4"}]}] Oct 12 13:29:04.542938 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ImagesNegativeTestJSON-2106444997 Oct 12 13:29:04.542938 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 10999e69618145e98836ff018fa734a4 Oct 12 13:29:04.542938 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2106444997 Oct 12 13:29:04.542938 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ImagesNegativeTestJSON-2106444997-project Oct 12 13:29:04.542938 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:29:04.542938 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:29:04.542938 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: ae145e5d37a3415b9158a043dc5465d3 Oct 12 13:29:04.542938 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ImagesNegativeTestJSON-2106444997-project Oct 12 13:29:04.542938 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:04.542938 n-d-861076-2 devstack@n-api.service[120933]: {"createImage": {"name": "tempest-test-snap-2071969716"}} Oct 12 13:29:04.542938 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:29:04.542938 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 13:29:04.544128 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2071969716'}}} Oct 12 13:29:04.544128 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:04.544128 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:04.544128 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:29:04.544128 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:29:04.544128 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 13:29:04.544128 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 13:29:04.544128 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 13:29:04.544128 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:04.544128 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:04.544128 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:04.544128 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:04.544128 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:04.544128 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:04.544128 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:04.544128 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:04.544128 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:04.544128 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:04.544128 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:04.544128 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:04.545598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:04.545598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:04.545598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 12 13:29:04.545598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 13:29:04.545598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:29:04.545598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:29:04.545598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:29:04.545598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:29:04.545598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 13:29:04.545598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:04.545598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:04.545598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:04.545598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:04.545598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:04.545598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:04.545598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:04.545598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:04.545598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 13:29:04.545598 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:04.547707 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9683dae3-3e0b-4298-b46b-86515f47a5f5 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:04.548032 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9683dae3-3e0b-4298-b46b-86515f47a5f5 tempest-ImagesNegativeTestJSON-2106444997 tempest-ImagesNegativeTestJSON-2106444997-project] 10.222.0.52 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.018015 Oct 12 13:29:04.549514 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 807/1576] 10.222.0.52 () {60 vars in 1281 bytes} [Wed Oct 12 13:29:04 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:29:04.610000 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-6e4ca014-031c-4875-b185-070f823d15ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:04.621518 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6e4ca014-031c-4875-b185-070f823d15ad tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805" status: 200 len: 1467 microversion: 2.1 time: 0.742383 Oct 12 13:29:04.622111 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 770/1577] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:29:03 2022] GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805 => generated 1467 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:29:04.636021 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-03ecafaa-8094-4f45-8b2a-8f8408098741 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:04.637039 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-03ecafaa-8094-4f45-8b2a-8f8408098741 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:04.648295 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03ecafaa-8094-4f45-8b2a-8f8408098741 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:04.649209 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03ecafaa-8094-4f45-8b2a-8f8408098741 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:04.653915 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c4732909-046b-4543-a56c-42d264951575 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:04.654480 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c4732909-046b-4543-a56c-42d264951575 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:04.655162 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03ecafaa-8094-4f45-8b2a-8f8408098741 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:04.656466 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03ecafaa-8094-4f45-8b2a-8f8408098741 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:04.657224 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03ecafaa-8094-4f45-8b2a-8f8408098741 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:04.657896 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-03ecafaa-8094-4f45-8b2a-8f8408098741 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:04.687367 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c4732909-046b-4543-a56c-42d264951575 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:04.687872 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c4732909-046b-4543-a56c-42d264951575 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:04.692620 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c4732909-046b-4543-a56c-42d264951575 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:04.704076 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c4732909-046b-4543-a56c-42d264951575 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:04.706167 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c4732909-046b-4543-a56c-42d264951575 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:04.711033 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c4732909-046b-4543-a56c-42d264951575 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:04.753743 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-c4732909-046b-4543-a56c-42d264951575 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Lazy-loading 'flavor' on Instance uuid 9922a424-28b3-4f9c-a13a-7a5fa11fa805 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:29:04.796151 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-03ecafaa-8094-4f45-8b2a-8f8408098741 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:04.805382 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-03ecafaa-8094-4f45-8b2a-8f8408098741 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:04.807183 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-03ecafaa-8094-4f45-8b2a-8f8408098741 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:04.808497 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-03ecafaa-8094-4f45-8b2a-8f8408098741 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1356 microversion: 2.47 time: 0.176930 Oct 12 13:29:04.809247 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 808/1578] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:04 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1356 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:05.036712 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e33280c1-46c2-4882-9fae-15b7a1720479 tempest-TenantUsagesNegativeTestJSON-790796218 tempest-TenantUsagesNegativeTestJSON-790796218-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-11T13%3A29%3A04.657169&end=2022-10-13T13%3A29%3A04.657169" status: 404 len: 112 microversion: - time: 0.226135 Oct 12 13:29:05.037854 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 809/1579] 10.222.0.52 () {58 vars in 1316 bytes} [Wed Oct 12 13:29:04 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-11T13%3A29%3A04.657169&end=2022-10-13T13%3A29%3A04.657169 => generated 112 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 12 13:29:05.043679 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7c438d91-c8ac-4395-90e5-644470497022 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:05.047822 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7c438d91-c8ac-4395-90e5-644470497022 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:05.058937 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7c438d91-c8ac-4395-90e5-644470497022 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:05.067852 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7c438d91-c8ac-4395-90e5-644470497022 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:05.068775 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7c438d91-c8ac-4395-90e5-644470497022 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:05.069740 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7c438d91-c8ac-4395-90e5-644470497022 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:05.070730 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7c438d91-c8ac-4395-90e5-644470497022 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:05.073564 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7c438d91-c8ac-4395-90e5-644470497022 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:05.171750 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:29:05.268282 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-7c438d91-c8ac-4395-90e5-644470497022 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:29:05.269774 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-7c438d91-c8ac-4395-90e5-644470497022 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:29:05.271000 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-7c438d91-c8ac-4395-90e5-644470497022 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:29:05.271580 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-7c438d91-c8ac-4395-90e5-644470497022 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:29:05.272160 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-7c438d91-c8ac-4395-90e5-644470497022 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:29:05.306305 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c4732909-046b-4543-a56c-42d264951575 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805/action" status: 202 len: 0 microversion: 2.1 time: 0.657554 Oct 12 13:29:05.323987 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 771/1580] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:29:04 2022] POST /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805/action => generated 0 bytes in 676 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 13:29:05.662538 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-377d7169-1f14-4dc2-a743-cdb382dee7db tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:05.662538 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-377d7169-1f14-4dc2-a743-cdb382dee7db tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:05.662538 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-377d7169-1f14-4dc2-a743-cdb382dee7db tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:05.662538 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-377d7169-1f14-4dc2-a743-cdb382dee7db tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:05.665248 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-377d7169-1f14-4dc2-a743-cdb382dee7db tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:05.665248 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-377d7169-1f14-4dc2-a743-cdb382dee7db tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:05.665248 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-377d7169-1f14-4dc2-a743-cdb382dee7db tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:05.665248 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-377d7169-1f14-4dc2-a743-cdb382dee7db tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:05.667683 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-377d7169-1f14-4dc2-a743-cdb382dee7db tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:05.667683 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-377d7169-1f14-4dc2-a743-cdb382dee7db tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:05.669875 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-377d7169-1f14-4dc2-a743-cdb382dee7db tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:05.669875 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-377d7169-1f14-4dc2-a743-cdb382dee7db tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1404 microversion: 2.54 time: 0.224749 Oct 12 13:29:05.669875 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 772/1581] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:05 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1404 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:05.669875 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f349e8d3-04c0-4f42-8b32-e11455601046 tempest-TenantUsagesNegativeTestJSON-790796218 tempest-TenantUsagesNegativeTestJSON-790796218-project-admin] Calling method '.version_select at 0x7f8a9b935940>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:05.671016 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:29:05.672230 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-f349e8d3-04c0-4f42-8b32-e11455601046 tempest-TenantUsagesNegativeTestJSON-790796218 tempest-TenantUsagesNegativeTestJSON-790796218-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 12 13:29:05.672230 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f349e8d3-04c0-4f42-8b32-e11455601046 tempest-TenantUsagesNegativeTestJSON-790796218 tempest-TenantUsagesNegativeTestJSON-790796218-project-admin] Request method failure captured: Oct 12 13:29:05.672230 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/os-simple-tenant-usage/c7800a1e0f0e4e23ac26b0096ff895c5?start=2022-10-13T13%3A29%3A04.657169&end=2022-10-11T13%3A29%3A04.657169 HTTP/1.1 Oct 12 13:29:05.672230 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:05.672230 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:05.672230 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:05.672230 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:29:05.672230 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:05.672230 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:05.672230 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:05.672230 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:05.672230 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsEgIXyCmD5s1VTZR8fQBL8pm4oqguaOYiclCpRyXfJblVv8GoQ6RwRCTNJQqeMzE7NrelY8WyOPQ-YgY9YdWVMoH8K6vBwVxoHSWtbvlJBUvVmnSbzmXeorJXZyijZZhxecPGDx8cYqdlHCQXYb1Y8BQn8g4DOpVSwxeYsXxdnS9b0 Oct 12 13:29:05.672230 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:05.672230 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:05.672230 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:05.672230 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:05.672230 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:05.672230 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:05.672230 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 938f6cc877dc4c39ba70a4c637142c5e Oct 12 13:29:05.672230 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-790796218 Oct 12 13:29:05.672230 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,admin,reader Oct 12 13:29:05.672230 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,admin,reader Oct 12 13:29:05.675818 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/938f6cc877dc4c39ba70a4c637142c5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_938f6cc877dc4c39ba70a4c637142c5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/938f6cc877dc4c39ba70a4c637142c5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/938f6cc877dc4c39ba70a4c637142c5e"}]}] Oct 12 13:29:05.675818 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-790796218 Oct 12 13:29:05.675818 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 938f6cc877dc4c39ba70a4c637142c5e Oct 12 13:29:05.675818 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-790796218 Oct 12 13:29:05.675818 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-TenantUsagesNegativeTestJSON-790796218-project-admin Oct 12 13:29:05.675818 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:05.675818 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:05.675818 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: d90cce964bcd467a8799938cc51c2559 Oct 12 13:29:05.675818 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-790796218-project-admin Oct 12 13:29:05.675818 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:29:05.675818 n-d-861076-2 devstack@n-api.service[120932]: exception: Invalid start time. The start time cannot occur after the end time. Oct 12 13:29:05.675818 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'c7800a1e0f0e4e23ac26b0096ff895c5'} Oct 12 13:29:05.677764 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:05.677764 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:05.677764 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:05.677764 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:05.677764 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:05.677764 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:05.677764 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:29:05.677764 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:29:05.677764 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 13:29:05.677764 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:05.677764 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:05.677764 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:05.677764 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 12 13:29:05.677764 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 12 13:29:05.677764 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 12 13:29:05.677764 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 12 13:29:05.677764 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 12 13:29:05.677764 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 12 13:29:05.677764 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 12 13:29:05.680622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:05.680622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:05.680622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:05.680622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:05.680622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:05.680622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:05.680622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:05.680622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:05.680622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 12 13:29:05.680622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:05.680622 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f349e8d3-04c0-4f42-8b32-e11455601046 tempest-TenantUsagesNegativeTestJSON-790796218 tempest-TenantUsagesNegativeTestJSON-790796218-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:05.680622 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f349e8d3-04c0-4f42-8b32-e11455601046 tempest-TenantUsagesNegativeTestJSON-790796218 tempest-TenantUsagesNegativeTestJSON-790796218-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/c7800a1e0f0e4e23ac26b0096ff895c5?start=2022-10-13T13%3A29%3A04.657169&end=2022-10-11T13%3A29%3A04.657169" status: 400 len: 111 microversion: 2.1 time: 0.040901 Oct 12 13:29:05.682869 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 773/1582] 10.222.0.52 () {58 vars in 1412 bytes} [Wed Oct 12 13:29:05 2022] GET /compute/v2.1/os-simple-tenant-usage/c7800a1e0f0e4e23ac26b0096ff895c5?start=2022-10-13T13%3A29%3A04.657169&end=2022-10-11T13%3A29%3A04.657169 => generated 111 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:29:05.682869 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cbd1395f-173a-4c22-a4f8-11bc86a1e517 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:05.682869 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cbd1395f-173a-4c22-a4f8-11bc86a1e517 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:05.682869 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cbd1395f-173a-4c22-a4f8-11bc86a1e517 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:05.683677 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cbd1395f-173a-4c22-a4f8-11bc86a1e517 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:05.683677 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cbd1395f-173a-4c22-a4f8-11bc86a1e517 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:05.683677 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cbd1395f-173a-4c22-a4f8-11bc86a1e517 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:05.683677 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cbd1395f-173a-4c22-a4f8-11bc86a1e517 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:05.684461 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cbd1395f-173a-4c22-a4f8-11bc86a1e517 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:05.853118 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-cbd1395f-173a-4c22-a4f8-11bc86a1e517 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:05.863017 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cbd1395f-173a-4c22-a4f8-11bc86a1e517 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805" status: 200 len: 1475 microversion: 2.1 time: 0.261727 Oct 12 13:29:05.863604 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 774/1583] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:29:05 2022] GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805 => generated 1475 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:29:06.176744 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-92ff67ee-732b-4018-9efa-5d8b530d5eb0 tempest-TenantUsagesNegativeTestJSON-1568264847 tempest-TenantUsagesNegativeTestJSON-1568264847-project] Calling method '.version_select at 0x7f8a9b672040>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:06.190477 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-92ff67ee-732b-4018-9efa-5d8b530d5eb0 tempest-TenantUsagesNegativeTestJSON-1568264847 tempest-TenantUsagesNegativeTestJSON-1568264847-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '780e652ec8e648f39f1a71acdd3b688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7800a1e0f0e4e23ac26b0096ff895c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:06.200543 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7c438d91-c8ac-4395-90e5-644470497022 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:06.204483 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-92ff67ee-732b-4018-9efa-5d8b530d5eb0 tempest-TenantUsagesNegativeTestJSON-1568264847 tempest-TenantUsagesNegativeTestJSON-1568264847-project] Request method failure captured: Oct 12 13:29:06.204483 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-11T13%3A29%3A04.657169&end=2022-10-13T13%3A29%3A04.657169&detailed=1 HTTP/1.1 Oct 12 13:29:06.204483 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:06.204483 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:06.204483 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:06.204483 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:29:06.204483 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:06.204483 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:06.204483 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:06.204483 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:06.204483 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsEeHWqpjCTyn5QnNIbYv8QFLKIOWH_G71jUbxXHtjrsw9YvhWeUTuOZaWIpl5B7CXYUNSqA7yZL0AY2CJm2Xpe-fPhinaj2laZX15mB871ItobwwiczEVYzrrE4ken7kapYcyUs_MXRhc-uWC6Zbq1S_Kp01idWVFdEPISECfvIPlY Oct 12 13:29:06.204483 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:06.204483 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:06.204483 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:06.204483 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:06.204483 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:06.204483 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:06.204483 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: c7800a1e0f0e4e23ac26b0096ff895c5 Oct 12 13:29:06.204483 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1568264847 Oct 12 13:29:06.204483 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:29:06.204483 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:29:06.205546 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c7800a1e0f0e4e23ac26b0096ff895c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c7800a1e0f0e4e23ac26b0096ff895c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7800a1e0f0e4e23ac26b0096ff895c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7800a1e0f0e4e23ac26b0096ff895c5"}]}] Oct 12 13:29:06.205546 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1568264847 Oct 12 13:29:06.205546 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: c7800a1e0f0e4e23ac26b0096ff895c5 Oct 12 13:29:06.205546 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1568264847 Oct 12 13:29:06.205546 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-TenantUsagesNegativeTestJSON-1568264847-project Oct 12 13:29:06.205546 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:06.205546 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:06.205546 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 780e652ec8e648f39f1a71acdd3b688b Oct 12 13:29:06.205546 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1568264847-project Oct 12 13:29:06.205546 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:29:06.205546 n-d-861076-2 devstack@n-api.service[120932]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 12 13:29:06.205546 n-d-861076-2 devstack@n-api.service[120932]: action_args: {} Oct 12 13:29:06.205546 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:06.206183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:06.206183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:06.206183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:06.206183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:06.206183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:06.206183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:29:06.206183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:29:06.206183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 13:29:06.206183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:06.206183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:06.206183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:06.206183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 12 13:29:06.206183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 12 13:29:06.206183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 12 13:29:06.206183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 12 13:29:06.206183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:29:06.206183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:29:06.206183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:29:06.206183 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:29:06.207002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:29:06.207002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:29:06.207002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:29:06.207002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:29:06.207002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:29:06.207002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:29:06.207002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:29:06.207002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:29:06.207002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:29:06.207002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:29:06.207002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 12 13:29:06.207002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:06.207002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:06.207002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:06.207002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:06.207002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:06.207002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:06.207002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:29:06.207002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:29:06.207829 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 12 13:29:06.207829 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:06.207829 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-92ff67ee-732b-4018-9efa-5d8b530d5eb0 tempest-TenantUsagesNegativeTestJSON-1568264847 tempest-TenantUsagesNegativeTestJSON-1568264847-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:06.207829 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-92ff67ee-732b-4018-9efa-5d8b530d5eb0 tempest-TenantUsagesNegativeTestJSON-1568264847 tempest-TenantUsagesNegativeTestJSON-1568264847-project] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-11T13%3A29%3A04.657169&end=2022-10-13T13%3A29%3A04.657169&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.341350 Oct 12 13:29:06.207829 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 775/1584] 10.222.0.52 () {58 vars in 1335 bytes} [Wed Oct 12 13:29:05 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-11T13%3A29%3A04.657169&end=2022-10-13T13%3A29%3A04.657169&detailed=1 => generated 123 bytes in 342 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:29:06.233091 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=16 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:29:06.243240 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7c438d91-c8ac-4395-90e5-644470497022 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:06.245531 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7c438d91-c8ac-4395-90e5-644470497022 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:06.246496 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7c438d91-c8ac-4395-90e5-644470497022 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:06.247532 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7c438d91-c8ac-4395-90e5-644470497022 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:06.248346 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7c438d91-c8ac-4395-90e5-644470497022 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:06.249177 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7c438d91-c8ac-4395-90e5-644470497022 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:06.327428 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:29:06.354846 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-7c438d91-c8ac-4395-90e5-644470497022 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "POST /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad/action" status: 202 len: 1078 microversion: 2.47 time: 1.315664 Oct 12 13:29:06.386291 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c4de1bda-9bdf-4205-a1f1-b71003a70176 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:06.387017 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c4de1bda-9bdf-4205-a1f1-b71003a70176 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:06.390529 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 810/1585] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Oct 12 13:29:05 2022] POST /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad/action => generated 1078 bytes in 1334 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 12 13:29:06.396845 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c4de1bda-9bdf-4205-a1f1-b71003a70176 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:06.397548 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c4de1bda-9bdf-4205-a1f1-b71003a70176 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:06.398258 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c4de1bda-9bdf-4205-a1f1-b71003a70176 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:06.399238 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c4de1bda-9bdf-4205-a1f1-b71003a70176 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:06.399866 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c4de1bda-9bdf-4205-a1f1-b71003a70176 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:06.400861 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c4de1bda-9bdf-4205-a1f1-b71003a70176 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:06.538945 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c4de1bda-9bdf-4205-a1f1-b71003a70176 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:06.555047 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c4de1bda-9bdf-4205-a1f1-b71003a70176 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:06.556518 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c4de1bda-9bdf-4205-a1f1-b71003a70176 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:06.557901 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c4de1bda-9bdf-4205-a1f1-b71003a70176 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1365 microversion: 2.47 time: 0.180992 Oct 12 13:29:06.575470 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 776/1586] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:06 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:06.583450 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-da9be010-a2a4-4228-abc6-a70b5f2a8b50 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:06.584105 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-da9be010-a2a4-4228-abc6-a70b5f2a8b50 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:06.591276 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da9be010-a2a4-4228-abc6-a70b5f2a8b50 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:06.591797 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da9be010-a2a4-4228-abc6-a70b5f2a8b50 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:06.592235 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da9be010-a2a4-4228-abc6-a70b5f2a8b50 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:06.592971 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da9be010-a2a4-4228-abc6-a70b5f2a8b50 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:06.593437 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da9be010-a2a4-4228-abc6-a70b5f2a8b50 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:06.594017 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da9be010-a2a4-4228-abc6-a70b5f2a8b50 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:06.662886 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da9be010-a2a4-4228-abc6-a70b5f2a8b50 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:06.664658 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da9be010-a2a4-4228-abc6-a70b5f2a8b50 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:06.668718 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-da9be010-a2a4-4228-abc6-a70b5f2a8b50 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:06.669400 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-da9be010-a2a4-4228-abc6-a70b5f2a8b50 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lazy-loading 'fault' on Instance uuid 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:29:06.827464 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-da9be010-a2a4-4228-abc6-a70b5f2a8b50 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:06.838314 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-da9be010-a2a4-4228-abc6-a70b5f2a8b50 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:06.840136 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-da9be010-a2a4-4228-abc6-a70b5f2a8b50 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d171ca393964f568d0693923b7b37eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ba65a035db4858b8f0d5660068b8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:06.844099 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-da9be010-a2a4-4228-abc6-a70b5f2a8b50 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 200 len: 1409 microversion: 2.54 time: 0.266779 Oct 12 13:29:06.845148 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 811/1587] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:06 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 1409 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:06.887774 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e2517d1d-0f7e-418a-ae85-1e4c783301dc tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:06.892377 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e2517d1d-0f7e-418a-ae85-1e4c783301dc tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:06.903418 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2517d1d-0f7e-418a-ae85-1e4c783301dc tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:06.904232 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2517d1d-0f7e-418a-ae85-1e4c783301dc tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:06.904953 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2517d1d-0f7e-418a-ae85-1e4c783301dc tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:06.905911 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2517d1d-0f7e-418a-ae85-1e4c783301dc tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:06.907206 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2517d1d-0f7e-418a-ae85-1e4c783301dc tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:06.907920 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2517d1d-0f7e-418a-ae85-1e4c783301dc tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:07.305860 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-e2517d1d-0f7e-418a-ae85-1e4c783301dc tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:07.316794 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e2517d1d-0f7e-418a-ae85-1e4c783301dc tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805" status: 200 len: 1458 microversion: 2.1 time: 0.434077 Oct 12 13:29:07.321928 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 777/1588] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:29:06 2022] GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805 => generated 1458 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:29:07.349794 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-568b217a-2996-4a08-8f7d-e242bb184d33 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:07.351665 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-568b217a-2996-4a08-8f7d-e242bb184d33 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:07.369608 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-568b217a-2996-4a08-8f7d-e242bb184d33 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:07.370106 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-568b217a-2996-4a08-8f7d-e242bb184d33 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:07.370546 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-568b217a-2996-4a08-8f7d-e242bb184d33 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:07.371260 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-568b217a-2996-4a08-8f7d-e242bb184d33 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:07.371715 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-568b217a-2996-4a08-8f7d-e242bb184d33 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:07.372141 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-568b217a-2996-4a08-8f7d-e242bb184d33 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:07.590898 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1c2ea795-b4bb-4b26-aaa9-605adcfd9093 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:07.591735 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1c2ea795-b4bb-4b26-aaa9-605adcfd9093 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:07.607246 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=16 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:29:07.608880 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c2ea795-b4bb-4b26-aaa9-605adcfd9093 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:07.609548 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c2ea795-b4bb-4b26-aaa9-605adcfd9093 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:07.609989 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c2ea795-b4bb-4b26-aaa9-605adcfd9093 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:07.610704 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c2ea795-b4bb-4b26-aaa9-605adcfd9093 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:07.611275 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c2ea795-b4bb-4b26-aaa9-605adcfd9093 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:07.612279 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c2ea795-b4bb-4b26-aaa9-605adcfd9093 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:07.845764 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-1c2ea795-b4bb-4b26-aaa9-605adcfd9093 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:07.858873 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-1c2ea795-b4bb-4b26-aaa9-605adcfd9093 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:07.861270 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-1c2ea795-b4bb-4b26-aaa9-605adcfd9093 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:07.869543 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1c2ea795-b4bb-4b26-aaa9-605adcfd9093 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1365 microversion: 2.47 time: 0.279395 Oct 12 13:29:07.884936 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 778/1589] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:07 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1365 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:07.884936 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-79c0d75d-d012-485f-806a-82ce7ce99b92 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:07.884936 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-79c0d75d-d012-485f-806a-82ce7ce99b92 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] [instance: 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:07.893338 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79c0d75d-d012-485f-806a-82ce7ce99b92 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:07.894690 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79c0d75d-d012-485f-806a-82ce7ce99b92 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:07.895279 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79c0d75d-d012-485f-806a-82ce7ce99b92 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:07.896698 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79c0d75d-d012-485f-806a-82ce7ce99b92 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:07.899577 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79c0d75d-d012-485f-806a-82ce7ce99b92 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:07.900246 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79c0d75d-d012-485f-806a-82ce7ce99b92 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:07.922235 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-79c0d75d-d012-485f-806a-82ce7ce99b92 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] HTTP exception thrown: Instance 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f could not be found. Oct 12 13:29:07.923998 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-79c0d75d-d012-485f-806a-82ce7ce99b92 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Request method failure captured: Oct 12 13:29:07.923998 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f HTTP/1.1 Oct 12 13:29:07.923998 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:07.923998 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:07.923998 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:07.923998 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:29:07.923998 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:07.923998 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:07.923998 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:07.923998 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:07.923998 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsDvrfVjfzY_FULYA-jPLdfsrZDNHPMh_zIzST8cECcFWi255-mbbiMPAiPX8Mr2wQPX1Ir22Tip1nlVwf31u0HlmqJ2XllwGyfqamz4As9fi97iqo1utveDzIB6dC0MTzFlP8EvqPUDXduGElr54LdbOhaUAdPkVdlulBd2ZLCNo_4 Oct 12 13:29:07.923998 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:07.923998 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:07.923998 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:07.923998 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:07.923998 n-d-861076-2 devstack@n-api.service[120932]: X-Openstack-Nova-Api-Version: 2.54 Oct 12 13:29:07.923998 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:07.923998 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:07.923998 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: b4ba65a035db4858b8f0d5660068b8c0 Oct 12 13:29:07.923998 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServerShowV254Test-1281113686 Oct 12 13:29:07.923998 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:29:07.923998 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:29:07.925334 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b4ba65a035db4858b8f0d5660068b8c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b4ba65a035db4858b8f0d5660068b8c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b4ba65a035db4858b8f0d5660068b8c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b4ba65a035db4858b8f0d5660068b8c0"}]}] Oct 12 13:29:07.925334 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServerShowV254Test-1281113686 Oct 12 13:29:07.925334 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: b4ba65a035db4858b8f0d5660068b8c0 Oct 12 13:29:07.925334 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServerShowV254Test-1281113686 Oct 12 13:29:07.925334 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServerShowV254Test-1281113686-project Oct 12 13:29:07.925334 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:07.925334 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:07.925334 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 7d171ca393964f568d0693923b7b37eb Oct 12 13:29:07.925334 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServerShowV254Test-1281113686-project Oct 12 13:29:07.925334 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:29:07.925334 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f could not be found. Oct 12 13:29:07.925334 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '091b9d1a-9f0f-44f7-bd6f-1caa70a1110f'} Oct 12 13:29:07.925892 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:07.925892 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:07.925892 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:29:07.925892 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:29:07.925892 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:29:07.925892 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:29:07.925892 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:29:07.925892 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:29:07.925892 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:29:07.925892 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:29:07.925892 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f could not be found. Oct 12 13:29:07.925892 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:07.925892 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:07.925892 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:07.925892 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:07.925892 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:07.925892 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:07.925892 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:07.925892 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:07.925892 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:07.927055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:07.927055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:29:07.927055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:29:07.927055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:29:07.927055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:29:07.927055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:29:07.927055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:29:07.927055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f could not be found. Oct 12 13:29:07.927055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:07.927055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:07.927055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:07.927055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:07.927055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:07.927055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:07.927055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:07.927055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:07.927055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f could not be found. Oct 12 13:29:07.927055 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:07.927858 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-79c0d75d-d012-485f-806a-82ce7ce99b92 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] Returning 404 to user: Instance 091b9d1a-9f0f-44f7-bd6f-1caa70a1110f could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:07.927858 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-79c0d75d-d012-485f-806a-82ce7ce99b92 tempest-ServerShowV254Test-1281113686 tempest-ServerShowV254Test-1281113686-project] 10.222.0.52 "GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f" status: 404 len: 111 microversion: 2.54 time: 0.051242 Oct 12 13:29:07.930697 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 779/1590] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:07 2022] GET /compute/v2.1/servers/091b9d1a-9f0f-44f7-bd6f-1caa70a1110f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:29:08.463532 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-568b217a-2996-4a08-8f7d-e242bb184d33 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805" status: 200 len: 1609 microversion: 2.1 time: 1.120665 Oct 12 13:29:08.466453 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 812/1591] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:29:07 2022] GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805 => generated 1609 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:29:08.488719 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-af6d1a30-68ee-43a2-a811-c768fd25c9dc tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:08.495064 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-af6d1a30-68ee-43a2-a811-c768fd25c9dc tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:08.495064 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-af6d1a30-68ee-43a2-a811-c768fd25c9dc tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:08.495064 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-af6d1a30-68ee-43a2-a811-c768fd25c9dc tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:08.495064 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-af6d1a30-68ee-43a2-a811-c768fd25c9dc tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:08.495305 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-af6d1a30-68ee-43a2-a811-c768fd25c9dc tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:08.495446 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-af6d1a30-68ee-43a2-a811-c768fd25c9dc tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:08.561304 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-af6d1a30-68ee-43a2-a811-c768fd25c9dc tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.077127 Oct 12 13:29:08.562908 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 780/1592] 10.222.0.52 () {58 vars in 1176 bytes} [Wed Oct 12 13:29:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:29:08.575261 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ec7752b0-9031-4339-b1b0-8cd0bb2087a6 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-861076-2", "block_migration": true, "disk_over_commit": false}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:08.578554 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-ec7752b0-9031-4339-b1b0-8cd0bb2087a6 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:08.585791 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ec7752b0-9031-4339-b1b0-8cd0bb2087a6 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:08.586691 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ec7752b0-9031-4339-b1b0-8cd0bb2087a6 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:08.587434 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ec7752b0-9031-4339-b1b0-8cd0bb2087a6 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:08.588435 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ec7752b0-9031-4339-b1b0-8cd0bb2087a6 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:08.589076 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ec7752b0-9031-4339-b1b0-8cd0bb2087a6 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:08.590462 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ec7752b0-9031-4339-b1b0-8cd0bb2087a6 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:08.791173 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-ec7752b0-9031-4339-b1b0-8cd0bb2087a6 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bec1f619-6adf-4e07-852d-58e3768f0e07) Oct 12 13:29:08.791173 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:08.791173 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:08.791173 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:08.791173 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:08.791173 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:08.791173 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:08.791173 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:08.791173 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:08.791173 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:08.791173 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 13:29:08.791173 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 12 13:29:08.791173 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 12 13:29:08.791173 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 12 13:29:08.791173 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 12 13:29:08.792074 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 12 13:29:08.792074 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 12 13:29:08.792074 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:29:08.792074 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:29:08.792074 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:29:08.792074 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:29:08.792074 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:29:08.792074 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:29:08.792074 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:08.792074 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:08.792074 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:29:08.792074 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:29:08.792074 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:08.792074 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:08.792074 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:29:08.792074 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:29:08.792074 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:08.792074 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:08.793075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:29:08.793075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:29:08.793075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:08.793075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:08.793075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:29:08.793075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:29:08.793075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:29:08.793075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:29:08.793075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:29:08.793075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:29:08.793075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:29:08.793075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:29:08.793075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:29:08.793075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:29:08.793075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:29:08.793075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:29:08.793075 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:29:08.793957 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:29:08.793957 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:29:08.793957 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:29:08.793957 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:29:08.793957 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:29:08.793957 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:29:08.793957 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:29:08.793957 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:29:08.793957 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:29:08.793957 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:29:08.793957 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:29:08.793957 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:29:08.793957 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:29:08.793957 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bec1f619-6adf-4e07-852d-58e3768f0e07) Oct 12 13:29:08.793957 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:08.794694 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-ec7752b0-9031-4339-b1b0-8cd0bb2087a6 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:08.794694 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:08.794694 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ec7752b0-9031-4339-b1b0-8cd0bb2087a6 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Request method failure captured: Oct 12 13:29:08.794694 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805/action HTTP/1.1 Oct 12 13:29:08.794694 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:29:08.794694 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:29:08.794694 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:29:08.794694 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 97 Oct 12 13:29:08.794694 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:29:08.794694 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:29:08.794694 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:29:08.794694 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:08.794694 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsDnnHaB9GdGLbDReR7sXESZtFUtw6v50yh695Jyw81nU8BwEhkbWBMBZeI987khI19G2G2oEQHiJ1MiYXvdeSuOAzeS0uy7qR6TDB2aQMOzdmxUAkb6iyP-bKY3cWUwaejg3axuswlRCBbtETeEzz_Yx3s91A_PPfYcsYV3O625sKA Oct 12 13:29:08.794694 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:29:08.794694 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:29:08.794694 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:29:08.794694 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:29:08.794694 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:29:08.794694 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:29:08.794694 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: f803180ee6d64af6a1c4dde0eef17857 Oct 12 13:29:08.794694 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-LiveMigrationNegativeTest-1084821230 Oct 12 13:29:08.794694 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:29:08.794694 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:29:08.795750 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f803180ee6d64af6a1c4dde0eef17857"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f803180ee6d64af6a1c4dde0eef17857"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f803180ee6d64af6a1c4dde0eef17857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f803180ee6d64af6a1c4dde0eef17857"}]}] Oct 12 13:29:08.795750 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-LiveMigrationNegativeTest-1084821230 Oct 12 13:29:08.795750 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: f803180ee6d64af6a1c4dde0eef17857 Oct 12 13:29:08.795750 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1084821230 Oct 12 13:29:08.795750 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-LiveMigrationNegativeTest-1084821230-project-admin Oct 12 13:29:08.795750 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:29:08.795750 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:29:08.795750 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 7343fb18a1354c169dfc2a002f3054b0 Oct 12 13:29:08.795750 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-LiveMigrationNegativeTest-1084821230-project-admin Oct 12 13:29:08.795750 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:08.795750 n-d-861076-2 devstack@n-api.service[120933]: {"os-migrateLive": {"host": "n-h2-861076-2", "block_migration": true, "disk_over_commit": false}} Oct 12 13:29:08.795750 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:29:08.796324 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:08.796324 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:08.796324 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '9922a424-28b3-4f9c-a13a-7a5fa11fa805', 'body': {'os-migrateLive': {'host': 'n-h2-861076-2', 'block_migration': True, 'disk_over_commit': False}}} Oct 12 13:29:08.796324 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:08.796324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:08.796324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:08.796324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:08.796324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:08.796324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:08.796324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:08.796324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:08.796324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:08.796324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:08.796324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 13:29:08.796324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 12 13:29:08.796324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 12 13:29:08.796324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 12 13:29:08.796324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 12 13:29:08.796324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 12 13:29:08.803458 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 12 13:29:08.803458 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:29:08.803458 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:29:08.803458 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:29:08.803458 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:29:08.803458 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:29:08.803458 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:29:08.803458 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:08.803458 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:08.803458 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:29:08.803458 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:29:08.803458 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:08.803458 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:08.803458 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:29:08.803458 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:29:08.803458 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:08.803458 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:08.803458 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:29:08.805829 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:29:08.805829 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:08.805829 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:08.805829 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:29:08.805829 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:29:08.805829 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:29:08.805829 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:29:08.805829 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:29:08.805829 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:29:08.805829 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:29:08.805829 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:29:08.805829 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:29:08.805829 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:29:08.805829 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:29:08.805829 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:29:08.805829 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:29:08.805829 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:29:08.807005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:29:08.807005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:29:08.807005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:29:08.807005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:29:08.807005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:29:08.807005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:29:08.807005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:29:08.807005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:29:08.807005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:29:08.807005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:29:08.807005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:29:08.807005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:29:08.807005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bec1f619-6adf-4e07-852d-58e3768f0e07) Oct 12 13:29:08.807005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:08.807005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:08.807005 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:08.807955 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:08.807955 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:08.807955 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:08.807955 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:08.807955 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:08.807955 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:29:08.807955 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:29:08.807955 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:08.807955 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:08.807955 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:08.807955 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:08.807955 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:08.807955 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:08.807955 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:08.807955 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:08.807955 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:08.807955 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:08.807955 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:08.807955 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:08.807955 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:08.808951 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ec7752b0-9031-4339-b1b0-8cd0bb2087a6 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:08.808951 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:08.808951 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ec7752b0-9031-4339-b1b0-8cd0bb2087a6 tempest-LiveMigrationNegativeTest-1084821230 tempest-LiveMigrationNegativeTest-1084821230-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805/action" status: 500 len: 214 microversion: 2.1 time: 0.224537 Oct 12 13:29:08.808951 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 813/1593] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:29:08 2022] POST /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805/action => generated 214 bytes in 227 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:29:08.816520 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cda4e0fc-ac69-4a14-895a-4f48fd3e6b0f tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:08.817290 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cda4e0fc-ac69-4a14-895a-4f48fd3e6b0f tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:08.837558 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cda4e0fc-ac69-4a14-895a-4f48fd3e6b0f tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:08.837558 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cda4e0fc-ac69-4a14-895a-4f48fd3e6b0f tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:08.837558 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cda4e0fc-ac69-4a14-895a-4f48fd3e6b0f tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:08.837558 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cda4e0fc-ac69-4a14-895a-4f48fd3e6b0f tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:08.843644 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cda4e0fc-ac69-4a14-895a-4f48fd3e6b0f tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:08.844241 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cda4e0fc-ac69-4a14-895a-4f48fd3e6b0f tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:08.903468 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cda4e0fc-ac69-4a14-895a-4f48fd3e6b0f tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:29:08.906348 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-54066e58-b138-46c0-8c18-7dd980f29d22 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:08.906348 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-54066e58-b138-46c0-8c18-7dd980f29d22 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:08.918022 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-54066e58-b138-46c0-8c18-7dd980f29d22 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:08.919301 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-54066e58-b138-46c0-8c18-7dd980f29d22 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:08.919955 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-54066e58-b138-46c0-8c18-7dd980f29d22 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:08.920965 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-54066e58-b138-46c0-8c18-7dd980f29d22 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:08.921780 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-54066e58-b138-46c0-8c18-7dd980f29d22 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:08.922601 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-54066e58-b138-46c0-8c18-7dd980f29d22 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:09.058456 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-54066e58-b138-46c0-8c18-7dd980f29d22 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:09.066096 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-54066e58-b138-46c0-8c18-7dd980f29d22 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:09.067658 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-54066e58-b138-46c0-8c18-7dd980f29d22 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:09.069280 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-54066e58-b138-46c0-8c18-7dd980f29d22 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1365 microversion: 2.47 time: 0.170399 Oct 12 13:29:09.070555 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 814/1594] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:08 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:29:09.118781 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:29:09.345084 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cda4e0fc-ac69-4a14-895a-4f48fd3e6b0f tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805" status: 204 len: 0 microversion: 2.1 time: 0.533363 Oct 12 13:29:09.346610 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 781/1595] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:29:08 2022] DELETE /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:29:09.359031 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-dcee2529-a7a2-4cf5-b9c8-7d857f1daa4e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:09.359646 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-dcee2529-a7a2-4cf5-b9c8-7d857f1daa4e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:09.372531 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dcee2529-a7a2-4cf5-b9c8-7d857f1daa4e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:09.375122 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dcee2529-a7a2-4cf5-b9c8-7d857f1daa4e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:09.377434 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dcee2529-a7a2-4cf5-b9c8-7d857f1daa4e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:09.381077 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dcee2529-a7a2-4cf5-b9c8-7d857f1daa4e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:09.381592 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dcee2529-a7a2-4cf5-b9c8-7d857f1daa4e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:09.383580 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dcee2529-a7a2-4cf5-b9c8-7d857f1daa4e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:09.855840 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-dcee2529-a7a2-4cf5-b9c8-7d857f1daa4e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:09.872395 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-dcee2529-a7a2-4cf5-b9c8-7d857f1daa4e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805" status: 200 len: 1464 microversion: 2.1 time: 0.518686 Oct 12 13:29:09.876354 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 815/1596] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:29:09 2022] GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805 => generated 1464 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:29:10.098832 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-22602b65-5572-4119-adfb-d357cb2f319a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:10.101188 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-22602b65-5572-4119-adfb-d357cb2f319a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:10.121418 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22602b65-5572-4119-adfb-d357cb2f319a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:10.123714 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22602b65-5572-4119-adfb-d357cb2f319a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:10.126107 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22602b65-5572-4119-adfb-d357cb2f319a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:10.127758 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22602b65-5572-4119-adfb-d357cb2f319a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:10.128470 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22602b65-5572-4119-adfb-d357cb2f319a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:10.130656 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22602b65-5572-4119-adfb-d357cb2f319a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:10.284948 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-22602b65-5572-4119-adfb-d357cb2f319a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:10.296873 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-22602b65-5572-4119-adfb-d357cb2f319a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:10.306798 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-22602b65-5572-4119-adfb-d357cb2f319a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:10.311058 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-22602b65-5572-4119-adfb-d357cb2f319a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1365 microversion: 2.47 time: 0.214696 Oct 12 13:29:10.316500 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 782/1597] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:10 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:10.901874 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d16401e4-a8b0-470d-a264-2844db4c422e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:10.902503 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-d16401e4-a8b0-470d-a264-2844db4c422e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:10.909266 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d16401e4-a8b0-470d-a264-2844db4c422e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:10.911162 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d16401e4-a8b0-470d-a264-2844db4c422e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:10.912835 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d16401e4-a8b0-470d-a264-2844db4c422e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:10.913895 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d16401e4-a8b0-470d-a264-2844db4c422e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:10.917503 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d16401e4-a8b0-470d-a264-2844db4c422e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:10.918182 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d16401e4-a8b0-470d-a264-2844db4c422e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:11.343612 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1e6041d1-fa5f-4023-8dd4-91c7c63b9f83 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:11.344316 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1e6041d1-fa5f-4023-8dd4-91c7c63b9f83 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:11.354485 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d16401e4-a8b0-470d-a264-2844db4c422e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:11.357067 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e6041d1-fa5f-4023-8dd4-91c7c63b9f83 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:11.358389 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e6041d1-fa5f-4023-8dd4-91c7c63b9f83 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:11.360458 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e6041d1-fa5f-4023-8dd4-91c7c63b9f83 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:11.363654 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e6041d1-fa5f-4023-8dd4-91c7c63b9f83 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:11.366225 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e6041d1-fa5f-4023-8dd4-91c7c63b9f83 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:11.366808 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e6041d1-fa5f-4023-8dd4-91c7c63b9f83 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:11.386591 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d16401e4-a8b0-470d-a264-2844db4c422e tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805" status: 200 len: 1464 microversion: 2.1 time: 0.476655 Oct 12 13:29:11.386591 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 816/1598] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:29:10 2022] GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805 => generated 1464 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:29:11.606050 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-1e6041d1-fa5f-4023-8dd4-91c7c63b9f83 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:11.627063 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-1e6041d1-fa5f-4023-8dd4-91c7c63b9f83 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:11.646520 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-1e6041d1-fa5f-4023-8dd4-91c7c63b9f83 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:11.649113 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1e6041d1-fa5f-4023-8dd4-91c7c63b9f83 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1365 microversion: 2.47 time: 0.310003 Oct 12 13:29:11.650294 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 783/1599] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:11 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1365 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:29:12.404475 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e00b6af5-217a-4702-82b3-4d4057f6fd1d tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:12.406927 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-e00b6af5-217a-4702-82b3-4d4057f6fd1d tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:12.418660 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e00b6af5-217a-4702-82b3-4d4057f6fd1d tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:12.419161 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e00b6af5-217a-4702-82b3-4d4057f6fd1d tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:12.423123 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e00b6af5-217a-4702-82b3-4d4057f6fd1d tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:12.426290 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e00b6af5-217a-4702-82b3-4d4057f6fd1d tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:12.428322 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e00b6af5-217a-4702-82b3-4d4057f6fd1d tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:12.428953 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e00b6af5-217a-4702-82b3-4d4057f6fd1d tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:12.685652 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5f4d625a-0242-43ea-8f1e-372686de8522 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:12.686833 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5f4d625a-0242-43ea-8f1e-372686de8522 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:12.703947 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f4d625a-0242-43ea-8f1e-372686de8522 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:12.706979 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f4d625a-0242-43ea-8f1e-372686de8522 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:12.709685 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f4d625a-0242-43ea-8f1e-372686de8522 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:12.712371 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f4d625a-0242-43ea-8f1e-372686de8522 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:12.713048 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f4d625a-0242-43ea-8f1e-372686de8522 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:12.714140 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f4d625a-0242-43ea-8f1e-372686de8522 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:13.149906 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-5f4d625a-0242-43ea-8f1e-372686de8522 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:13.162444 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-5f4d625a-0242-43ea-8f1e-372686de8522 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:13.193419 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-5f4d625a-0242-43ea-8f1e-372686de8522 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:13.193419 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5f4d625a-0242-43ea-8f1e-372686de8522 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1365 microversion: 2.47 time: 0.499380 Oct 12 13:29:13.204481 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 784/1600] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:12 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1365 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:29:13.279462 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e00b6af5-217a-4702-82b3-4d4057f6fd1d tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:13.301251 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e00b6af5-217a-4702-82b3-4d4057f6fd1d tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805" status: 200 len: 1464 microversion: 2.1 time: 0.892042 Oct 12 13:29:13.301251 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 817/1601] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:29:12 2022] GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805 => generated 1464 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:29:13.440084 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-a11c2976-b80b-4182-aace-38e6cff9aa00 req-a233f79c-f9bc-4660-8610-16ce0ea1774f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9922a424-28b3-4f9c-a13a-7a5fa11fa805", "name": "network-vif-deleted", "tag": "69c1a565-df7e-4919-ab81-f1d086f1349e"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:13.464887 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-a11c2976-b80b-4182-aace-38e6cff9aa00 req-a233f79c-f9bc-4660-8610-16ce0ea1774f service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:13.466271 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-a11c2976-b80b-4182-aace-38e6cff9aa00 req-a233f79c-f9bc-4660-8610-16ce0ea1774f service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:13.467086 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-a11c2976-b80b-4182-aace-38e6cff9aa00 req-a233f79c-f9bc-4660-8610-16ce0ea1774f service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:13.495974 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-a11c2976-b80b-4182-aace-38e6cff9aa00 req-a233f79c-f9bc-4660-8610-16ce0ea1774f service nova] Creating event network-vif-deleted:69c1a565-df7e-4919-ab81-f1d086f1349e for instance 9922a424-28b3-4f9c-a13a-7a5fa11fa805 on n-h1-861076-2 Oct 12 13:29:13.509372 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-a11c2976-b80b-4182-aace-38e6cff9aa00 req-a233f79c-f9bc-4660-8610-16ce0ea1774f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073777 Oct 12 13:29:13.512487 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 818/1602] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:29:13.652284 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-269a098a-4071-4c43-acd2-55d19e1a30a9 tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] Action: 'create', calling method: .version_select at 0x7f8a9b672040>, body: {"keypair": {"name": "tempest-keypair-1844765580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9pNUO0FLTkjtebcOcvSubOtoUR4hK95LWYXzeYT+warkRANOgej68ymX43D81fQlXae8X09A0O4UcRzpb89nzOxOL9yBxVfqdASlChpjDknFrpBdoW9GoBEoJMTSeCLw=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:13.714561 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-269a098a-4071-4c43-acd2-55d19e1a30a9 tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] Getting quotas for project e885993d2014482b96097e5a9d46437d. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:29:13.727976 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-269a098a-4071-4c43-acd2-55d19e1a30a9 tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] Getting quotas for user 9db7d5929e0f4639837edf7fefa3d4f8 and project e885993d2014482b96097e5a9d46437d. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:29:13.892680 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-269a098a-4071-4c43-acd2-55d19e1a30a9 tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.522034 Oct 12 13:29:13.894129 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 785/1603] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Oct 12 13:29:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 524 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 13:29:14.213239 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-bb22e502-6dc8-4a1e-aa3c-d39ef9cf86b2 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:14.214043 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-bb22e502-6dc8-4a1e-aa3c-d39ef9cf86b2 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:14.231393 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bb22e502-6dc8-4a1e-aa3c-d39ef9cf86b2 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:14.231393 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bb22e502-6dc8-4a1e-aa3c-d39ef9cf86b2 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:14.231393 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bb22e502-6dc8-4a1e-aa3c-d39ef9cf86b2 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:14.231393 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bb22e502-6dc8-4a1e-aa3c-d39ef9cf86b2 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:14.232792 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bb22e502-6dc8-4a1e-aa3c-d39ef9cf86b2 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:14.233888 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-bb22e502-6dc8-4a1e-aa3c-d39ef9cf86b2 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:14.321346 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d5f2bc3d-389e-43d9-a255-c997a37a28da tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:14.322774 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d5f2bc3d-389e-43d9-a255-c997a37a28da tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:14.331745 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d5f2bc3d-389e-43d9-a255-c997a37a28da tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:14.332293 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d5f2bc3d-389e-43d9-a255-c997a37a28da tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:14.333233 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d5f2bc3d-389e-43d9-a255-c997a37a28da tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:14.334092 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d5f2bc3d-389e-43d9-a255-c997a37a28da tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:14.334696 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d5f2bc3d-389e-43d9-a255-c997a37a28da tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:14.335295 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d5f2bc3d-389e-43d9-a255-c997a37a28da tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:14.394471 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-bb22e502-6dc8-4a1e-aa3c-d39ef9cf86b2 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:14.412093 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-bb22e502-6dc8-4a1e-aa3c-d39ef9cf86b2 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:14.418350 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-bb22e502-6dc8-4a1e-aa3c-d39ef9cf86b2 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:14.418350 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-bb22e502-6dc8-4a1e-aa3c-d39ef9cf86b2 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1365 microversion: 2.47 time: 0.210354 Oct 12 13:29:14.418350 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 819/1604] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:14 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:14.434250 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d5f2bc3d-389e-43d9-a255-c997a37a28da tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:14.434841 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d5f2bc3d-389e-43d9-a255-c997a37a28da tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:14.435391 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d5f2bc3d-389e-43d9-a255-c997a37a28da tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:14.436178 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-d5f2bc3d-389e-43d9-a255-c997a37a28da tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lazy-loading 'fault' on Instance uuid 9922a424-28b3-4f9c-a13a-7a5fa11fa805 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:29:14.556256 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d5f2bc3d-389e-43d9-a255-c997a37a28da tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:14.572137 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d5f2bc3d-389e-43d9-a255-c997a37a28da tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805" status: 200 len: 1308 microversion: 2.1 time: 0.254712 Oct 12 13:29:14.573488 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 786/1605] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:29:14 2022] GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805 => generated 1308 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:29:15.446145 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5909b77c-bb58-4883-b11f-aa7df2b81c25 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:15.447352 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-5909b77c-bb58-4883-b11f-aa7df2b81c25 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:15.475615 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5909b77c-bb58-4883-b11f-aa7df2b81c25 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:15.476833 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5909b77c-bb58-4883-b11f-aa7df2b81c25 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:15.481574 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5909b77c-bb58-4883-b11f-aa7df2b81c25 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:15.483815 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5909b77c-bb58-4883-b11f-aa7df2b81c25 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:15.485668 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5909b77c-bb58-4883-b11f-aa7df2b81c25 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:15.488807 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5909b77c-bb58-4883-b11f-aa7df2b81c25 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:15.597212 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1b7b7353-68aa-4da2-bdb9-019380470b52 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:15.598588 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1b7b7353-68aa-4da2-bdb9-019380470b52 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: 9922a424-28b3-4f9c-a13a-7a5fa11fa805] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:15.618699 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1b7b7353-68aa-4da2-bdb9-019380470b52 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:15.619248 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1b7b7353-68aa-4da2-bdb9-019380470b52 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:15.619817 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1b7b7353-68aa-4da2-bdb9-019380470b52 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:15.622551 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1b7b7353-68aa-4da2-bdb9-019380470b52 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:15.623035 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1b7b7353-68aa-4da2-bdb9-019380470b52 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:15.624861 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1b7b7353-68aa-4da2-bdb9-019380470b52 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:15.665421 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-1b7b7353-68aa-4da2-bdb9-019380470b52 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] HTTP exception thrown: Instance 9922a424-28b3-4f9c-a13a-7a5fa11fa805 could not be found. Oct 12 13:29:15.669292 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1b7b7353-68aa-4da2-bdb9-019380470b52 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Request method failure captured: Oct 12 13:29:15.669292 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805 HTTP/1.1 Oct 12 13:29:15.669292 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:15.669292 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:15.669292 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:15.669292 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:29:15.669292 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:15.669292 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:15.669292 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:15.669292 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:15.669292 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsDmiI8RqIVb7qsuNC2f65fnic3kuPxsRe_vUTc5kiV3sbWLkIW9mbHr7hrD7Hv8WbOXnjNtkmg_59yEaLs1ANC2WyVKWSlDEq9G3y72JNUzqaFwrjDGwZARwjz-uBJJnyD5Up1FjiMzLJBwq5SHQnLx0B_IY1HTZ-hMIzTOqrutV10 Oct 12 13:29:15.669292 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:15.669292 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:15.669292 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:15.669292 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:15.669292 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:15.669292 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:15.669292 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 46912a6dbce642efa054f5fc83b1bbaf Oct 12 13:29:15.669292 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-LiveMigrationNegativeTest-504517717 Oct 12 13:29:15.669292 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:29:15.669292 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:29:15.670618 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/46912a6dbce642efa054f5fc83b1bbaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_46912a6dbce642efa054f5fc83b1bbaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46912a6dbce642efa054f5fc83b1bbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46912a6dbce642efa054f5fc83b1bbaf"}]}] Oct 12 13:29:15.670618 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-LiveMigrationNegativeTest-504517717 Oct 12 13:29:15.670618 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 46912a6dbce642efa054f5fc83b1bbaf Oct 12 13:29:15.670618 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-504517717 Oct 12 13:29:15.670618 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-LiveMigrationNegativeTest-504517717-project Oct 12 13:29:15.670618 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:15.670618 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:15.670618 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: ace4b2fa8c4c4198a7215456e7f52fe9 Oct 12 13:29:15.670618 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-LiveMigrationNegativeTest-504517717-project Oct 12 13:29:15.670618 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:29:15.670618 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance 9922a424-28b3-4f9c-a13a-7a5fa11fa805 could not be found. Oct 12 13:29:15.670618 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '9922a424-28b3-4f9c-a13a-7a5fa11fa805'} Oct 12 13:29:15.671354 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:15.671354 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:15.671354 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:29:15.671354 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:29:15.671354 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:29:15.671354 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:29:15.671354 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:29:15.671354 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:29:15.671354 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:29:15.671354 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:29:15.671354 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9922a424-28b3-4f9c-a13a-7a5fa11fa805 could not be found. Oct 12 13:29:15.671354 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:15.671354 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:15.671354 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:15.671354 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:15.671354 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:15.671354 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:15.671354 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:15.671354 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:15.671354 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:15.672694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:15.672694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:29:15.672694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:29:15.672694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:29:15.672694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:29:15.672694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:29:15.672694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:29:15.672694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9922a424-28b3-4f9c-a13a-7a5fa11fa805 could not be found. Oct 12 13:29:15.672694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:15.672694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:15.672694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:15.672694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:15.672694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:15.672694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:15.672694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:15.672694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:15.672694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9922a424-28b3-4f9c-a13a-7a5fa11fa805 could not be found. Oct 12 13:29:15.672694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:15.676580 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1b7b7353-68aa-4da2-bdb9-019380470b52 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Returning 404 to user: Instance 9922a424-28b3-4f9c-a13a-7a5fa11fa805 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:15.679865 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1b7b7353-68aa-4da2-bdb9-019380470b52 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805" status: 404 len: 111 microversion: 2.1 time: 0.087912 Oct 12 13:29:15.680600 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 787/1606] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:29:15 2022] GET /compute/v2.1/servers/9922a424-28b3-4f9c-a13a-7a5fa11fa805 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 13:29:15.693530 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d8a79bb8-e4e0-4827-853b-2f735081af8a tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:15.696237 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d8a79bb8-e4e0-4827-853b-2f735081af8a tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:15.709225 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8a79bb8-e4e0-4827-853b-2f735081af8a tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:15.709942 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8a79bb8-e4e0-4827-853b-2f735081af8a tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:15.710655 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8a79bb8-e4e0-4827-853b-2f735081af8a tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:15.711540 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8a79bb8-e4e0-4827-853b-2f735081af8a tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:15.712184 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8a79bb8-e4e0-4827-853b-2f735081af8a tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:15.712759 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8a79bb8-e4e0-4827-853b-2f735081af8a tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:15.745912 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d8a79bb8-e4e0-4827-853b-2f735081af8a tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:29:15.954663 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-5909b77c-bb58-4883-b11f-aa7df2b81c25 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:15.981103 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-5909b77c-bb58-4883-b11f-aa7df2b81c25 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:15.986594 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-5909b77c-bb58-4883-b11f-aa7df2b81c25 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:15.988968 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5909b77c-bb58-4883-b11f-aa7df2b81c25 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1365 microversion: 2.47 time: 0.547542 Oct 12 13:29:15.989970 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 820/1607] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:15 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1365 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:16.178487 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d8a79bb8-e4e0-4827-853b-2f735081af8a tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 204 len: 0 microversion: 2.1 time: 0.492084 Oct 12 13:29:16.182464 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 788/1608] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:29:15 2022] DELETE /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:29:16.187715 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a761f4dd-73fa-4bdf-ac1e-3d2506dd5349 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:16.188430 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a761f4dd-73fa-4bdf-ac1e-3d2506dd5349 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:16.195574 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a761f4dd-73fa-4bdf-ac1e-3d2506dd5349 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:16.201990 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a761f4dd-73fa-4bdf-ac1e-3d2506dd5349 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:16.203915 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a761f4dd-73fa-4bdf-ac1e-3d2506dd5349 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:16.204712 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a761f4dd-73fa-4bdf-ac1e-3d2506dd5349 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:16.205307 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a761f4dd-73fa-4bdf-ac1e-3d2506dd5349 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:16.206879 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a761f4dd-73fa-4bdf-ac1e-3d2506dd5349 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:16.543107 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a761f4dd-73fa-4bdf-ac1e-3d2506dd5349 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:16.555446 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a761f4dd-73fa-4bdf-ac1e-3d2506dd5349 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 200 len: 1474 microversion: 2.1 time: 0.371628 Oct 12 13:29:16.573918 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 821/1609] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:29:16 2022] GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 1474 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:29:17.023747 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9e9c2c5a-d34f-420a-95a4-4c84145f2b8a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:17.025962 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9e9c2c5a-d34f-420a-95a4-4c84145f2b8a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:17.033990 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9e9c2c5a-d34f-420a-95a4-4c84145f2b8a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:17.035169 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9e9c2c5a-d34f-420a-95a4-4c84145f2b8a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:17.036449 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9e9c2c5a-d34f-420a-95a4-4c84145f2b8a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:17.037370 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9e9c2c5a-d34f-420a-95a4-4c84145f2b8a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:17.037992 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9e9c2c5a-d34f-420a-95a4-4c84145f2b8a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:17.038566 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9e9c2c5a-d34f-420a-95a4-4c84145f2b8a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:17.147154 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-9e9c2c5a-d34f-420a-95a4-4c84145f2b8a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:17.164573 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-9e9c2c5a-d34f-420a-95a4-4c84145f2b8a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:17.170677 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-9e9c2c5a-d34f-420a-95a4-4c84145f2b8a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:17.172534 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9e9c2c5a-d34f-420a-95a4-4c84145f2b8a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1365 microversion: 2.47 time: 0.155417 Oct 12 13:29:17.173350 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 789/1610] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:17 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:17.592438 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-df8b8c07-3f09-487d-8f4d-cf89c09a9566 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:17.595044 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-df8b8c07-3f09-487d-8f4d-cf89c09a9566 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:17.615414 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-df8b8c07-3f09-487d-8f4d-cf89c09a9566 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:17.616878 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-df8b8c07-3f09-487d-8f4d-cf89c09a9566 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:17.623312 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-df8b8c07-3f09-487d-8f4d-cf89c09a9566 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:17.624081 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-df8b8c07-3f09-487d-8f4d-cf89c09a9566 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:17.624549 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-df8b8c07-3f09-487d-8f4d-cf89c09a9566 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:17.627105 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-df8b8c07-3f09-487d-8f4d-cf89c09a9566 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:18.068182 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-df8b8c07-3f09-487d-8f4d-cf89c09a9566 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:18.081486 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-df8b8c07-3f09-487d-8f4d-cf89c09a9566 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 200 len: 1474 microversion: 2.1 time: 0.498519 Oct 12 13:29:18.099329 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 822/1611] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:29:17 2022] GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 1474 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:29:18.204311 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c26985c2-191c-4da5-b394-828ac7098763 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:18.205907 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c26985c2-191c-4da5-b394-828ac7098763 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:18.217130 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c26985c2-191c-4da5-b394-828ac7098763 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:18.217894 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c26985c2-191c-4da5-b394-828ac7098763 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:18.218478 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c26985c2-191c-4da5-b394-828ac7098763 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:18.220041 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c26985c2-191c-4da5-b394-828ac7098763 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:18.220645 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c26985c2-191c-4da5-b394-828ac7098763 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:18.222163 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c26985c2-191c-4da5-b394-828ac7098763 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:18.523704 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:29:18.915140 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c26985c2-191c-4da5-b394-828ac7098763 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:18.936844 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c26985c2-191c-4da5-b394-828ac7098763 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:18.942057 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c26985c2-191c-4da5-b394-828ac7098763 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:18.946899 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c26985c2-191c-4da5-b394-828ac7098763 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1365 microversion: 2.47 time: 0.748621 Oct 12 13:29:18.950192 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 790/1612] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:18 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1365 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:19.114194 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-30392769-a197-4815-94e5-1fec21010c12 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:19.119780 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-30392769-a197-4815-94e5-1fec21010c12 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:19.157202 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-30392769-a197-4815-94e5-1fec21010c12 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:19.157202 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-30392769-a197-4815-94e5-1fec21010c12 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:19.157202 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-30392769-a197-4815-94e5-1fec21010c12 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:19.157202 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-30392769-a197-4815-94e5-1fec21010c12 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:19.158010 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-30392769-a197-4815-94e5-1fec21010c12 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:19.158624 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-30392769-a197-4815-94e5-1fec21010c12 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:19.704638 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3791c55a-e764-49b4-895e-7af0d511d6a4 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Action: 'create', calling method: .version_select at 0x7f8a9ba05e50>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADoRsc5BCoPY0BbALTNiyEpPILgmPwyDes0FMtxIxt5q/QrtGVuBXU8swVaOA+jHAinBPLI5A9Jpn0XZOpnlwwtK4FhaVcREpfGIWqTsqdTlt7ypI3Yj/T/+beCtq4vUw=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:19.709255 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3791c55a-e764-49b4-895e-7af0d511d6a4 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Request method failure captured: Oct 12 13:29:19.709255 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 13:29:19.709255 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:19.709255 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:19.709255 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:19.709255 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 257 Oct 12 13:29:19.709255 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:19.709255 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:19.709255 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:19.709255 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:19.709255 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsEvn6UxJM_cuTcPku1lhfbFJAgkmEMGFiUrcePpFsys3dIyjYlNBPQk5DzlkNEc1I8Agy6-KPCpYpuq0S2VIWCcJ6JQ50NHL8XpaudgO-ZR-0ZCESQoO9PJKy6f4eS0TZ7X9KDhyiHmeTi3dpef0FvwAugXwh44YOO-yXlPWtW4hBo Oct 12 13:29:19.709255 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:19.709255 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:19.709255 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:19.709255 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:19.709255 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:19.709255 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:19.709255 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 2178153ce06f40909274dc8c4dccd163 Oct 12 13:29:19.709255 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:19.709255 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:29:19.709255 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:29:19.710328 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2178153ce06f40909274dc8c4dccd163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2178153ce06f40909274dc8c4dccd163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2178153ce06f40909274dc8c4dccd163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2178153ce06f40909274dc8c4dccd163"}]}] Oct 12 13:29:19.710328 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:19.710328 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 2178153ce06f40909274dc8c4dccd163 Oct 12 13:29:19.710328 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:19.710328 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-KeyPairsNegativeTestJSON-1726303944-project Oct 12 13:29:19.710328 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:19.710328 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:19.710328 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: b5798b2efeb64d36ae412d5a4b83d64a Oct 12 13:29:19.710328 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1726303944-project Oct 12 13:29:19.710328 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:29:19.710328 n-d-861076-2 devstack@n-api.service[120932]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADoRsc5BCoPY0BbALTNiyEpPILgmPwyDes0FMtxIxt5q/QrtGVuBXU8swVaOA+jHAinBPLI5A9Jpn0XZOpnlwwtK4FhaVcREpfGIWqTsqdTlt7ypI3Yj/T/+beCtq4vUw=="}} Oct 12 13:29:19.710881 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:29:19.710881 n-d-861076-2 devstack@n-api.service[120932]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 12 13:29:19.710881 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADoRsc5BCoPY0BbALTNiyEpPILgmPwyDes0FMtxIxt5q/QrtGVuBXU8swVaOA+jHAinBPLI5A9Jpn0XZOpnlwwtK4FhaVcREpfGIWqTsqdTlt7ypI3Yj/T/+beCtq4vUw=='}}} Oct 12 13:29:19.710881 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:19.710881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:19.710881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 12 13:29:19.710881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 12 13:29:19.710881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 12 13:29:19.710881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 12 13:29:19.710881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 12 13:29:19.710881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 12 13:29:19.710881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 12 13:29:19.710881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:19.710881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 12 13:29:19.710881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:19.710881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:19.710881 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 13:29:19.712466 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 13:29:19.712466 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 13:29:19.712466 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise error Oct 12 13:29:19.712466 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 12 13:29:19.712466 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:19.712466 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 12 13:29:19.712466 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 12 13:29:19.712466 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 12 13:29:19.712466 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 12 13:29:19.712466 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 12 13:29:19.712466 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:19.712466 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 12 13:29:19.712466 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 12 13:29:19.712466 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:19.712466 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:19.712466 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:19.712466 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:19.712466 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:19.712466 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:19.712466 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:19.712466 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:19.712466 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:29:19.712466 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:29:19.713580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:19.713580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:19.713580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:19.713580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:19.713580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 13:29:19.713580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 13:29:19.713580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 13:29:19.713580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 13:29:19.713580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 13:29:19.713580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 13:29:19.713580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 12 13:29:19.713580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:19.713580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:19.713580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:19.713580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:19.713580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:19.713580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:19.713580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 13:29:19.713580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 13:29:19.714475 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 12 13:29:19.714475 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:19.714475 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3791c55a-e764-49b4-895e-7af0d511d6a4 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:19.714475 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3791c55a-e764-49b4-895e-7af0d511d6a4 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.193716 Oct 12 13:29:19.714475 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 791/1613] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:29:19 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 196 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:29:19.729774 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-85189a54-8639-4b5a-8841-93464cb68668 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Action: 'create', calling method: .version_select at 0x7f8a9ba51550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-683982822", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:19.797677 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-85189a54-8639-4b5a-8841-93464cb68668 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Getting quotas for project 2178153ce06f40909274dc8c4dccd163. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:29:19.815668 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-85189a54-8639-4b5a-8841-93464cb68668 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Getting quotas for user b5798b2efeb64d36ae412d5a4b83d64a and project 2178153ce06f40909274dc8c4dccd163. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:29:19.857676 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-85189a54-8639-4b5a-8841-93464cb68668 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-85189a54-8639-4b5a-8841-93464cb68668 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Request method failure captured: Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 2166 Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsEvn6UxJM_cuTcPku1lhfbFJAgkmEMGFiUrcePpFsys3dIyjYlNBPQk5DzlkNEc1I8Agy6-KPCpYpuq0S2VIWCcJ6JQ50NHL8XpaudgO-ZR-0ZCESQoO9PJKy6f4eS0TZ7X9KDhyiHmeTi3dpef0FvwAugXwh44YOO-yXlPWtW4hBo Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 2178153ce06f40909274dc8c4dccd163 Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2178153ce06f40909274dc8c4dccd163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2178153ce06f40909274dc8c4dccd163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2178153ce06f40909274dc8c4dccd163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2178153ce06f40909274dc8c4dccd163"}]}] Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 2178153ce06f40909274dc8c4dccd163 Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-KeyPairsNegativeTestJSON-1726303944-project Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: b5798b2efeb64d36ae412d5a4b83d64a Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1726303944-project Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-683982822", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:29:19.890754 n-d-861076-2 devstack@n-api.service[120932]: exception: Keypair data is invalid: failed to generate fingerprint Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-683982822', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:19.892589 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:19.895831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:19.895831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:19.895831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:19.895831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:19.895831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 12 13:29:19.895831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 12 13:29:19.895831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 12 13:29:19.895831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 12 13:29:19.895831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 12 13:29:19.895831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:19.895831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:19.895831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:19.895831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:19.895831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:19.895831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:19.895831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:19.895831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:19.895831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 12 13:29:19.895831 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:19.895831 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-85189a54-8639-4b5a-8841-93464cb68668 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:19.895831 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-85189a54-8639-4b5a-8841-93464cb68668 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.175238 Oct 12 13:29:19.895831 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 792/1614] 10.222.0.52 () {60 vars in 1160 bytes} [Wed Oct 12 13:29:19 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 177 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 13:29:19.908309 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a933e70e-ea8c-4a30-bcad-47c1f55359f5 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Action: 'create', calling method: .version_select at 0x7f8a9b9b6c10>, body: {"keypair": {"name": "tempest-keypair-368451543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNeM0UyTv1sH/7/lIAkBLPS0+Q2keC3mrDeBVEmrrEN/AzuU2FQKTfczTatsm+ODXDHP8+wumCkxltHzdQeUyqkvTANv527ElbNtJsQAa61OVXgxjs8ZHievvil5iT18Q=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:19.951375 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-a933e70e-ea8c-4a30-bcad-47c1f55359f5 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Getting quotas for project 2178153ce06f40909274dc8c4dccd163. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:29:19.962624 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-a933e70e-ea8c-4a30-bcad-47c1f55359f5 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Getting quotas for user b5798b2efeb64d36ae412d5a4b83d64a and project 2178153ce06f40909274dc8c4dccd163. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:29:20.053439 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-30392769-a197-4815-94e5-1fec21010c12 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:20.067440 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-30392769-a197-4815-94e5-1fec21010c12 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 200 len: 1474 microversion: 2.1 time: 0.962733 Oct 12 13:29:20.069472 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 823/1615] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:29:19 2022] GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 1474 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:29:20.078504 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a933e70e-ea8c-4a30-bcad-47c1f55359f5 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.176208 Oct 12 13:29:20.079127 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 793/1616] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:29:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:29:20.082107 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-701d469f-67ef-41ac-bca9-2a599cbb2bc8 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:20.087962 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-701d469f-67ef-41ac-bca9-2a599cbb2bc8 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:20.088128 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-1a93b973-5762-48a6-a8b3-c2d8d89ec8bf req-0e19f608-8928-479b-9232-a2b6e17c30b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed6ad20-8975-4ce5-b6b6-da604e6de75a", "name": "network-vif-deleted", "tag": "d7975bf0-8638-44b5-8a0a-5ee6ef6227ef"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:20.114636 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-1a93b973-5762-48a6-a8b3-c2d8d89ec8bf req-0e19f608-8928-479b-9232-a2b6e17c30b8 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:20.115129 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-1a93b973-5762-48a6-a8b3-c2d8d89ec8bf req-0e19f608-8928-479b-9232-a2b6e17c30b8 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:20.115568 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-1a93b973-5762-48a6-a8b3-c2d8d89ec8bf req-0e19f608-8928-479b-9232-a2b6e17c30b8 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:20.123166 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-701d469f-67ef-41ac-bca9-2a599cbb2bc8 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:20.134382 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-701d469f-67ef-41ac-bca9-2a599cbb2bc8 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:20.135592 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-701d469f-67ef-41ac-bca9-2a599cbb2bc8 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:20.139400 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-701d469f-67ef-41ac-bca9-2a599cbb2bc8 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:20.139400 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-701d469f-67ef-41ac-bca9-2a599cbb2bc8 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:20.139400 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-701d469f-67ef-41ac-bca9-2a599cbb2bc8 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:20.154948 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-1a93b973-5762-48a6-a8b3-c2d8d89ec8bf req-0e19f608-8928-479b-9232-a2b6e17c30b8 service nova] Creating event network-vif-deleted:d7975bf0-8638-44b5-8a0a-5ee6ef6227ef for instance bed6ad20-8975-4ce5-b6b6-da604e6de75a on n-h2-861076-2 Oct 12 13:29:20.171239 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-1a93b973-5762-48a6-a8b3-c2d8d89ec8bf req-0e19f608-8928-479b-9232-a2b6e17c30b8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087303 Oct 12 13:29:20.173584 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 794/1617] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:29:20.185003 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a5aeab19-1c4e-4e6c-b3fd-ed52f18562de tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Action: 'create', calling method: .version_select at 0x7f8a9b9bcb80>, body: {"keypair": {"name": "tempest-keypair-368451543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFupTu0P6rs1iiA/o1TE8LZvj5Hi3QVHFuvjO3Vm7et8K1p2O7k9OASpk8eMYYPPOqwn69P6ZpVnHkV/gLgBfe7ERItbFiPyt7I8znWxSMu7ym8orbO/9Uq0u3yzbvw77A=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:20.239498 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-a5aeab19-1c4e-4e6c-b3fd-ed52f18562de tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Getting quotas for project 2178153ce06f40909274dc8c4dccd163. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:29:20.252098 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-a5aeab19-1c4e-4e6c-b3fd-ed52f18562de tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Getting quotas for user b5798b2efeb64d36ae412d5a4b83d64a and project 2178153ce06f40909274dc8c4dccd163. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:29:20.313237 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-701d469f-67ef-41ac-bca9-2a599cbb2bc8 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:20.340847 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-701d469f-67ef-41ac-bca9-2a599cbb2bc8 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:20.347498 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-701d469f-67ef-41ac-bca9-2a599cbb2bc8 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:20.361648 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-701d469f-67ef-41ac-bca9-2a599cbb2bc8 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1365 microversion: 2.47 time: 0.290541 Oct 12 13:29:20.364800 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 824/1618] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:20 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1365 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:20.409334 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-a5aeab19-1c4e-4e6c-b3fd-ed52f18562de tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] HTTP exception thrown: Key pair 'tempest-keypair-368451543' already exists. Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a5aeab19-1c4e-4e6c-b3fd-ed52f18562de tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Request method failure captured: Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 272 Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsEvn6UxJM_cuTcPku1lhfbFJAgkmEMGFiUrcePpFsys3dIyjYlNBPQk5DzlkNEc1I8Agy6-KPCpYpuq0S2VIWCcJ6JQ50NHL8XpaudgO-ZR-0ZCESQoO9PJKy6f4eS0TZ7X9KDhyiHmeTi3dpef0FvwAugXwh44YOO-yXlPWtW4hBo Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 2178153ce06f40909274dc8c4dccd163 Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2178153ce06f40909274dc8c4dccd163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2178153ce06f40909274dc8c4dccd163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2178153ce06f40909274dc8c4dccd163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2178153ce06f40909274dc8c4dccd163"}]}] Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 2178153ce06f40909274dc8c4dccd163 Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-KeyPairsNegativeTestJSON-1726303944-project Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: b5798b2efeb64d36ae412d5a4b83d64a Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1726303944-project Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: {"keypair": {"name": "tempest-keypair-368451543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFupTu0P6rs1iiA/o1TE8LZvj5Hi3QVHFuvjO3Vm7et8K1p2O7k9OASpk8eMYYPPOqwn69P6ZpVnHkV/gLgBfe7ERItbFiPyt7I8znWxSMu7ym8orbO/9Uq0u3yzbvw77A=="}} Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: exception: Key pair 'tempest-keypair-368451543' already exists. Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-368451543', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFupTu0P6rs1iiA/o1TE8LZvj5Hi3QVHFuvjO3Vm7et8K1p2O7k9OASpk8eMYYPPOqwn69P6ZpVnHkV/gLgBfe7ERItbFiPyt7I8znWxSMu7ym8orbO/9Uq0u3yzbvw77A=='}}} Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result.read() Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'b5798b2efeb64d36ae412d5a4b83d64a-tempest-keypair-368451543' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 12 13:29:20.416675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi session.flush() Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result.read() Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 13:29:20.420318 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'b5798b2efeb64d36ae412d5a4b83d64a-tempest-keypair-368451543' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 12, 13, 29, 20, 302538), 'updated_at': None, 'name': 'tempest-keypair-368451543', 'user_id': 'b5798b2efeb64d36ae412d5a4b83d64a', 'fingerprint': '03:ae:1e:2b:f7:70:d4:3d:ae:f0:4a:65:36:16:07:e9', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFupTu0P6rs1iiA/o1TE8LZvj5Hi3QVHFuvjO3Vm7et8K1p2O7k9OASpk8eMYYPPOqwn69P6ZpVnHkV/gLgBfe7ERItbFiPyt7I8znWxSMu7ym8orbO/9Uq0u3yzbvw77A==', 'type': 'ssh'}] Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keypair.create() Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._create() Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-368451543' already exists. Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 12 13:29:20.427834 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-368451543' already exists. Oct 12 13:29:20.431416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.431416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:20.431416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.431416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:20.431416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:20.431416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:20.431416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:20.431416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:20.431416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-368451543' already exists. Oct 12 13:29:20.431416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.431416 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a5aeab19-1c4e-4e6c-b3fd-ed52f18562de tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Returning 409 to user: Key pair 'tempest-keypair-368451543' already exists. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:20.431416 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a5aeab19-1c4e-4e6c-b3fd-ed52f18562de tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.246633 Oct 12 13:29:20.431416 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 795/1619] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:29:20 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 250 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:29:20.437222 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2ef1a119-3a9e-4a13-8757-06e0ee04202f tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Calling method '.version_select at 0x7f8a9baf25e0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:20.557568 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2ef1a119-3a9e-4a13-8757-06e0ee04202f tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-368451543" status: 202 len: 0 microversion: 2.1 time: 0.126261 Oct 12 13:29:20.558460 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 825/1620] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Oct 12 13:29:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-368451543 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:29:20.590382 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a4c2bed2-bdd1-40cc-a0bd-e1c5408d2a16 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Action: 'create', calling method: .version_select at 0x7f8aa01faaf0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJEraCv8QWc3NNNZUQrFeETQqP8zgYA3TYUPn/7hI8h9FyUTmNfM7qjMfzD1jXeMNq3WTOyxOsUQ/EAG3/dqdWW0vE9YSwLX57PM6Sr9qhnxVWqqtWj1HLn8iGU0y9vMg=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a4c2bed2-bdd1-40cc-a0bd-e1c5408d2a16 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Request method failure captured: Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 247 Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsEvn6UxJM_cuTcPku1lhfbFJAgkmEMGFiUrcePpFsys3dIyjYlNBPQk5DzlkNEc1I8Agy6-KPCpYpuq0S2VIWCcJ6JQ50NHL8XpaudgO-ZR-0ZCESQoO9PJKy6f4eS0TZ7X9KDhyiHmeTi3dpef0FvwAugXwh44YOO-yXlPWtW4hBo Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 2178153ce06f40909274dc8c4dccd163 Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2178153ce06f40909274dc8c4dccd163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2178153ce06f40909274dc8c4dccd163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2178153ce06f40909274dc8c4dccd163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2178153ce06f40909274dc8c4dccd163"}]}] Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 2178153ce06f40909274dc8c4dccd163 Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-KeyPairsNegativeTestJSON-1726303944-project Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: b5798b2efeb64d36ae412d5a4b83d64a Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1726303944-project Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJEraCv8QWc3NNNZUQrFeETQqP8zgYA3TYUPn/7hI8h9FyUTmNfM7qjMfzD1jXeMNq3WTOyxOsUQ/EAG3/dqdWW0vE9YSwLX57PM6Sr9qhnxVWqqtWj1HLn8iGU0y9vMg=="}} Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJEraCv8QWc3NNNZUQrFeETQqP8zgYA3TYUPn/7hI8h9FyUTmNfM7qjMfzD1jXeMNq3WTOyxOsUQ/EAG3/dqdWW0vE9YSwLX57PM6Sr9qhnxVWqqtWj1HLn8iGU0y9vMg=='}}} Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise error Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi '' Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 13:29:20.599986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 13:29:20.605773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 13:29:20.605773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 13:29:20.605773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 13:29:20.605773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 13:29:20.605773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 12 13:29:20.605773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.605773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:20.605773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.605773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:20.605773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:20.605773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:20.605773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 13:29:20.605773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 13:29:20.605773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 12 13:29:20.605773 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.609002 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a4c2bed2-bdd1-40cc-a0bd-e1c5408d2a16 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:20.612460 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a4c2bed2-bdd1-40cc-a0bd-e1c5408d2a16 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.039850 Oct 12 13:29:20.613611 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 796/1621] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:29:20 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:29:20.624586 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-08ea1bab-daa2-410d-bc91-4fc2cccdc459 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Action: 'create', calling method: .version_select at 0x7f8a9b9b69d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-232216351", "public_key": " "}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:20.633549 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:29:20.648023 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-08ea1bab-daa2-410d-bc91-4fc2cccdc459 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Getting quotas for project 2178153ce06f40909274dc8c4dccd163. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:29:20.655817 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-08ea1bab-daa2-410d-bc91-4fc2cccdc459 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Getting quotas for user b5798b2efeb64d36ae412d5a4b83d64a and project 2178153ce06f40909274dc8c4dccd163. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:29:20.677904 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-08ea1bab-daa2-410d-bc91-4fc2cccdc459 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-08ea1bab-daa2-410d-bc91-4fc2cccdc459 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Request method failure captured: Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 94 Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsEvn6UxJM_cuTcPku1lhfbFJAgkmEMGFiUrcePpFsys3dIyjYlNBPQk5DzlkNEc1I8Agy6-KPCpYpuq0S2VIWCcJ6JQ50NHL8XpaudgO-ZR-0ZCESQoO9PJKy6f4eS0TZ7X9KDhyiHmeTi3dpef0FvwAugXwh44YOO-yXlPWtW4hBo Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 2178153ce06f40909274dc8c4dccd163 Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2178153ce06f40909274dc8c4dccd163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2178153ce06f40909274dc8c4dccd163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2178153ce06f40909274dc8c4dccd163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2178153ce06f40909274dc8c4dccd163"}]}] Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 2178153ce06f40909274dc8c4dccd163 Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-KeyPairsNegativeTestJSON-1726303944-project Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: b5798b2efeb64d36ae412d5a4b83d64a Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1726303944-project Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-232216351", "public_key": " "}} Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: exception: Keypair data is invalid: failed to generate fingerprint Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-232216351', 'public_key': ' '}}} Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:20.680652 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 12 13:29:20.684962 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.693151 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-08ea1bab-daa2-410d-bc91-4fc2cccdc459 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:20.693151 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-08ea1bab-daa2-410d-bc91-4fc2cccdc459 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.067668 Oct 12 13:29:20.693151 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 797/1622] 10.222.0.52 () {60 vars in 1158 bytes} [Wed Oct 12 13:29:20 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 13:29:20.700661 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-38dd30b0-8dd9-43aa-8ecc-8b953a6df9c2 tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Action: 'create', calling method: .version_select at 0x7f8a9ba07280>, body: {"keypair": {"name": "tempest-keypair-550757681", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1M8JX5mzdzhfEgJ8GLCGEEnEUMW+EOZIFPzJ/GnB1olK9kpwjT+lvwnxkzqFfU/O1s9v3yB/ABcIuCu8I2hGmgIAdmBvhj3Q6ia7q4IVRHiG/ZrXpZSVmEnpK93jqduQ=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:20.707439 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bfa9cc01-bbbe-4699-91e3-ee3f0b9d64a0 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Action: 'create', calling method: .version_select at 0x7f8aa0247310>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLW2KBJ++Q2N3zvkuSf90uNbdhfSADOPPI9lHbWa5BPECC5delyDRW49jXL12LxQlu0GucazCI8c/30Ny0y9eUvMmYz7fKsGpsY1aV7w6L1ZJr4zRVn3LWOdTd3uxi5hHQ=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bfa9cc01-bbbe-4699-91e3-ee3f0b9d64a0 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Request method failure captured: Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 507 Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsEvn6UxJM_cuTcPku1lhfbFJAgkmEMGFiUrcePpFsys3dIyjYlNBPQk5DzlkNEc1I8Agy6-KPCpYpuq0S2VIWCcJ6JQ50NHL8XpaudgO-ZR-0ZCESQoO9PJKy6f4eS0TZ7X9KDhyiHmeTi3dpef0FvwAugXwh44YOO-yXlPWtW4hBo Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 2178153ce06f40909274dc8c4dccd163 Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2178153ce06f40909274dc8c4dccd163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2178153ce06f40909274dc8c4dccd163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2178153ce06f40909274dc8c4dccd163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2178153ce06f40909274dc8c4dccd163"}]}] Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 2178153ce06f40909274dc8c4dccd163 Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-KeyPairsNegativeTestJSON-1726303944-project Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: b5798b2efeb64d36ae412d5a4b83d64a Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1726303944-project Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLW2KBJ++Q2N3zvkuSf90uNbdhfSADOPPI9lHbWa5BPECC5delyDRW49jXL12LxQlu0GucazCI8c/30Ny0y9eUvMmYz7fKsGpsY1aV7w6L1ZJr4zRVn3LWOdTd3uxi5hHQ=="}} Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLW2KBJ++Q2N3zvkuSf90uNbdhfSADOPPI9lHbWa5BPECC5delyDRW49jXL12LxQlu0GucazCI8c/30Ny0y9eUvMmYz7fKsGpsY1aV7w6L1ZJr4zRVn3LWOdTd3uxi5hHQ=='}}} Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise error Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 12 13:29:20.713172 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.715795 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bfa9cc01-bbbe-4699-91e3-ee3f0b9d64a0 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:20.717498 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bfa9cc01-bbbe-4699-91e3-ee3f0b9d64a0 tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.017834 Oct 12 13:29:20.717498 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 798/1623] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:29:20 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:29:20.726839 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-687014da-db7b-498c-8f10-737ffbfd88ab tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Action: 'create', calling method: .version_select at 0x7f8a9ba058b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1707134248", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:20.730411 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-38dd30b0-8dd9-43aa-8ecc-8b953a6df9c2 tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Getting quotas for project 81c9366135cf42f096ef6e0d748fa283. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:29:20.738121 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-38dd30b0-8dd9-43aa-8ecc-8b953a6df9c2 tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Getting quotas for user 67f1b44834f84be9915554e881195cc2 and project 81c9366135cf42f096ef6e0d748fa283. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:29:20.771662 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-687014da-db7b-498c-8f10-737ffbfd88ab tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Getting quotas for project 2178153ce06f40909274dc8c4dccd163. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:29:20.781901 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-687014da-db7b-498c-8f10-737ffbfd88ab tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Getting quotas for user b5798b2efeb64d36ae412d5a4b83d64a and project 2178153ce06f40909274dc8c4dccd163. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:29:20.812148 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-687014da-db7b-498c-8f10-737ffbfd88ab tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-687014da-db7b-498c-8f10-737ffbfd88ab tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Request method failure captured: Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 118 Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsEvn6UxJM_cuTcPku1lhfbFJAgkmEMGFiUrcePpFsys3dIyjYlNBPQk5DzlkNEc1I8Agy6-KPCpYpuq0S2VIWCcJ6JQ50NHL8XpaudgO-ZR-0ZCESQoO9PJKy6f4eS0TZ7X9KDhyiHmeTi3dpef0FvwAugXwh44YOO-yXlPWtW4hBo Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 2178153ce06f40909274dc8c4dccd163 Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2178153ce06f40909274dc8c4dccd163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2178153ce06f40909274dc8c4dccd163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2178153ce06f40909274dc8c4dccd163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2178153ce06f40909274dc8c4dccd163"}]}] Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 2178153ce06f40909274dc8c4dccd163 Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-KeyPairsNegativeTestJSON-1726303944-project Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: b5798b2efeb64d36ae412d5a4b83d64a Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1726303944-project Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1707134248", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: exception: Keypair data is invalid: failed to generate fingerprint Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1707134248', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 12 13:29:20.814104 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-687014da-db7b-498c-8f10-737ffbfd88ab tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-687014da-db7b-498c-8f10-737ffbfd88ab tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.093682 Oct 12 13:29:20.818378 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 799/1624] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:29:20 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 12 13:29:20.829388 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7668e92b-b138-4190-b902-c99ae62630df tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Calling method '.version_select at 0x7f8a9bc98430>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:20.832290 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-38dd30b0-8dd9-43aa-8ecc-8b953a6df9c2 tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.253528 Oct 12 13:29:20.833358 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 826/1625] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:29:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:29:20.857511 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-7668e92b-b138-4190-b902-c99ae62630df tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1733621438 not found for user b5798b2efeb64d36ae412d5a4b83d64a Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7668e92b-b138-4190-b902-c99ae62630df tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Request method failure captured: Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1733621438 HTTP/1.1 Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsEvn6UxJM_cuTcPku1lhfbFJAgkmEMGFiUrcePpFsys3dIyjYlNBPQk5DzlkNEc1I8Agy6-KPCpYpuq0S2VIWCcJ6JQ50NHL8XpaudgO-ZR-0ZCESQoO9PJKy6f4eS0TZ7X9KDhyiHmeTi3dpef0FvwAugXwh44YOO-yXlPWtW4hBo Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 2178153ce06f40909274dc8c4dccd163 Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2178153ce06f40909274dc8c4dccd163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2178153ce06f40909274dc8c4dccd163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2178153ce06f40909274dc8c4dccd163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2178153ce06f40909274dc8c4dccd163"}]}] Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 2178153ce06f40909274dc8c4dccd163 Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1726303944 Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-KeyPairsNegativeTestJSON-1726303944-project Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: b5798b2efeb64d36ae412d5a4b83d64a Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1726303944-project Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: exception: Keypair tempest-keypair-non-existent-1733621438 not found for user b5798b2efeb64d36ae412d5a4b83d64a Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'tempest-keypair-non-existent-1733621438'} Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1733621438 not found for user b5798b2efeb64d36ae412d5a4b83d64a Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.859713 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1733621438 not found for user b5798b2efeb64d36ae412d5a4b83d64a Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1733621438 not found for user b5798b2efeb64d36ae412d5a4b83d64a Oct 12 13:29:20.863563 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:20.866162 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7668e92b-b138-4190-b902-c99ae62630df tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1733621438 not found for user b5798b2efeb64d36ae412d5a4b83d64a {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:20.867173 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7668e92b-b138-4190-b902-c99ae62630df tempest-KeyPairsNegativeTestJSON-1726303944 tempest-KeyPairsNegativeTestJSON-1726303944-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1733621438" status: 404 len: 145 microversion: 2.1 time: 0.042284 Oct 12 13:29:20.868257 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 800/1626] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 12 13:29:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1733621438 => generated 145 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:29:21.109052 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9612a562-20e7-4dab-88fb-3f8cd1264327 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:21.110162 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-9612a562-20e7-4dab-88fb-3f8cd1264327 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:21.125969 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9612a562-20e7-4dab-88fb-3f8cd1264327 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:21.128368 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9612a562-20e7-4dab-88fb-3f8cd1264327 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:21.129230 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9612a562-20e7-4dab-88fb-3f8cd1264327 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:21.131647 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9612a562-20e7-4dab-88fb-3f8cd1264327 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:21.132432 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9612a562-20e7-4dab-88fb-3f8cd1264327 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:21.133123 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9612a562-20e7-4dab-88fb-3f8cd1264327 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:21.188888 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9612a562-20e7-4dab-88fb-3f8cd1264327 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:21.195884 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9612a562-20e7-4dab-88fb-3f8cd1264327 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:21.195884 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9612a562-20e7-4dab-88fb-3f8cd1264327 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:21.195884 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-9612a562-20e7-4dab-88fb-3f8cd1264327 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lazy-loading 'fault' on Instance uuid bed6ad20-8975-4ce5-b6b6-da604e6de75a {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:29:21.261006 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9612a562-20e7-4dab-88fb-3f8cd1264327 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace4b2fa8c4c4198a7215456e7f52fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46912a6dbce642efa054f5fc83b1bbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:21.291249 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9612a562-20e7-4dab-88fb-3f8cd1264327 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 200 len: 1308 microversion: 2.1 time: 0.191941 Oct 12 13:29:21.310650 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 827/1627] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:29:21 2022] GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 1308 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:29:21.393784 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-768509c6-0429-4c1d-8cc2-51beba7e4671 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:21.394460 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-768509c6-0429-4c1d-8cc2-51beba7e4671 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:21.415884 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-768509c6-0429-4c1d-8cc2-51beba7e4671 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:21.416609 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-768509c6-0429-4c1d-8cc2-51beba7e4671 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:21.417268 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-768509c6-0429-4c1d-8cc2-51beba7e4671 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:21.418197 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-768509c6-0429-4c1d-8cc2-51beba7e4671 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:21.418861 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-768509c6-0429-4c1d-8cc2-51beba7e4671 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:21.419485 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-768509c6-0429-4c1d-8cc2-51beba7e4671 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:21.518714 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-768509c6-0429-4c1d-8cc2-51beba7e4671 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:21.534659 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-768509c6-0429-4c1d-8cc2-51beba7e4671 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:21.539765 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-768509c6-0429-4c1d-8cc2-51beba7e4671 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:21.543078 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-768509c6-0429-4c1d-8cc2-51beba7e4671 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1365 microversion: 2.47 time: 0.153391 Oct 12 13:29:21.564398 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 801/1628] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:21 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:22.225429 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a18a7356-33f0-4458-beb9-a2794eda1796 tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-577043892", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4bbab782-32a6-4260-b03a-514efd8c81ff"}], "security_groups": [{"name": "tempest-securitygroup--1170659239"}], "key_name": "tempest-keypair-1844765580", "user_data": "}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:22.325702 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fa663764-94d9-465c-a28b-2043b59bcc40 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:22.328632 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fa663764-94d9-465c-a28b-2043b59bcc40 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] [instance: bed6ad20-8975-4ce5-b6b6-da604e6de75a] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:22.348226 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa663764-94d9-465c-a28b-2043b59bcc40 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:22.348737 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa663764-94d9-465c-a28b-2043b59bcc40 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:22.351027 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa663764-94d9-465c-a28b-2043b59bcc40 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:22.352202 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa663764-94d9-465c-a28b-2043b59bcc40 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:22.352676 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa663764-94d9-465c-a28b-2043b59bcc40 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:22.353148 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa663764-94d9-465c-a28b-2043b59bcc40 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:22.416215 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-fa663764-94d9-465c-a28b-2043b59bcc40 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] HTTP exception thrown: Instance bed6ad20-8975-4ce5-b6b6-da604e6de75a could not be found. Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fa663764-94d9-465c-a28b-2043b59bcc40 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Request method failure captured: Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a HTTP/1.1 Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsDmiI8RqIVb7qsuNC2f65fnic3kuPxsRe_vUTc5kiV3sbWLkIW9mbHr7hrD7Hv8WbOXnjNtkmg_59yEaLs1ANC2WyVKWSlDEq9G3y72JNUzqaFwrjDGwZARwjz-uBJJnyD5Up1FjiMzLJBwq5SHQnLx0B_IY1HTZ-hMIzTOqrutV10 Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 46912a6dbce642efa054f5fc83b1bbaf Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-LiveMigrationNegativeTest-504517717 Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/46912a6dbce642efa054f5fc83b1bbaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_46912a6dbce642efa054f5fc83b1bbaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46912a6dbce642efa054f5fc83b1bbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46912a6dbce642efa054f5fc83b1bbaf"}]}] Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-LiveMigrationNegativeTest-504517717 Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 46912a6dbce642efa054f5fc83b1bbaf Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-504517717 Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-LiveMigrationNegativeTest-504517717-project Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: ace4b2fa8c4c4198a7215456e7f52fe9 Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-LiveMigrationNegativeTest-504517717-project Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance bed6ad20-8975-4ce5-b6b6-da604e6de75a could not be found. Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'bed6ad20-8975-4ce5-b6b6-da604e6de75a'} Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed6ad20-8975-4ce5-b6b6-da604e6de75a could not be found. Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed6ad20-8975-4ce5-b6b6-da604e6de75a could not be found. Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:22.431878 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:22.435897 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:22.435897 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:22.435897 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:22.435897 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:22.435897 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:22.435897 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed6ad20-8975-4ce5-b6b6-da604e6de75a could not be found. Oct 12 13:29:22.435897 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:22.435897 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fa663764-94d9-465c-a28b-2043b59bcc40 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] Returning 404 to user: Instance bed6ad20-8975-4ce5-b6b6-da604e6de75a could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:22.437417 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fa663764-94d9-465c-a28b-2043b59bcc40 tempest-LiveMigrationNegativeTest-504517717 tempest-LiveMigrationNegativeTest-504517717-project] 10.222.0.52 "GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a" status: 404 len: 111 microversion: 2.1 time: 0.117567 Oct 12 13:29:22.440846 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 802/1629] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:29:22 2022] GET /compute/v2.1/servers/bed6ad20-8975-4ce5-b6b6-da604e6de75a => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:29:22.537042 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-a18a7356-33f0-4458-beb9-a2794eda1796 tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] validate_networks() for [('4bbab782-32a6-4260-b03a-514efd8c81ff', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:29:22.579515 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8a480b24-f35e-41c0-882f-d15cc951795d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:22.580398 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8a480b24-f35e-41c0-882f-d15cc951795d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:22.598112 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a480b24-f35e-41c0-882f-d15cc951795d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:22.599499 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a480b24-f35e-41c0-882f-d15cc951795d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:22.600951 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a480b24-f35e-41c0-882f-d15cc951795d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:22.605239 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a480b24-f35e-41c0-882f-d15cc951795d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:22.606155 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a480b24-f35e-41c0-882f-d15cc951795d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:22.607571 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a480b24-f35e-41c0-882f-d15cc951795d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:22.844450 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8a480b24-f35e-41c0-882f-d15cc951795d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:22.861786 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8a480b24-f35e-41c0-882f-d15cc951795d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:22.866121 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8a480b24-f35e-41c0-882f-d15cc951795d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:22.869639 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8a480b24-f35e-41c0-882f-d15cc951795d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1365 microversion: 2.47 time: 0.294692 Oct 12 13:29:22.874798 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 803/1630] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:22 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1365 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-a18a7356-33f0-4458-beb9-a2794eda1796 tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7fb13e2a-7d16-44f9-b614-334adf9aac12) Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:29:23.128804 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:29:23.131695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:29:23.131695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:29:23.131695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:29:23.131695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:29:23.131695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:29:23.131695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:29:23.131695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:29:23.131695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:29:23.131695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:29:23.131695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:29:23.131695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:29:23.131695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:29:23.131695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:29:23.131695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:29:23.131695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:29:23.131695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7fb13e2a-7d16-44f9-b614-334adf9aac12) Oct 12 13:29:23.131695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:23.131695 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-a18a7356-33f0-4458-beb9-a2794eda1796 tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:23.131695 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a18a7356-33f0-4458-beb9-a2794eda1796 tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] Request method failure captured: Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 491 Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsEpYjLWnsszdowjwTcI3o1NPZqrabsv-QzFhSkwmNJmICBoJoXd8NOokXt7vBgDxv6AS1qT8S63R0KYoKnxRo5kFAPKt8kn8-biv2R-yxDwHf86Hcgn9K6rhbbSUaviqI73Xpe1muRRC3lE8lGTb8X2GiyszbNYNONbg7rzrUpR17A Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: e885993d2014482b96097e5a9d46437d Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-58097819 Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e885993d2014482b96097e5a9d46437d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e885993d2014482b96097e5a9d46437d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e885993d2014482b96097e5a9d46437d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e885993d2014482b96097e5a9d46437d"}]}] Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AttachVolumeShelveTestJSON-58097819 Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: e885993d2014482b96097e5a9d46437d Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-58097819 Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AttachVolumeShelveTestJSON-58097819-project Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 9db7d5929e0f4639837edf7fefa3d4f8 Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AttachVolumeShelveTestJSON-58097819-project Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-577043892", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "4bbab782-32a6-4260-b03a-514efd8c81ff"}], "security_groups": [{"name": "tempest-securitygroup--1170659239"}], "key_name": "tempest-keypair-1844765580", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeShelveTestJSON-server-577043892', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': '4bbab782-32a6-4260-b03a-514efd8c81ff'}], 'security_groups': [{'name': 'tempest-securitygroup--1170659239'}], 'key_name': 'tempest-keypair-1844765580', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:29:23.132647 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7fb13e2a-7d16-44f9-b614-334adf9aac12) Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:23.137800 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:23.147166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:23.147166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:23.147166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:23.147166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:29:23.147166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:29:23.147166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:23.147166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:23.147166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:23.147166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:23.147166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:23.147166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:23.147166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:23.147166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:23.147166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:23.147166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:23.147166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:23.147166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:23.147166 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:23.147166 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a18a7356-33f0-4458-beb9-a2794eda1796 tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:23.147166 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:23.147166 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a18a7356-33f0-4458-beb9-a2794eda1796 tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.20 time: 0.912914 Oct 12 13:29:23.147166 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 828/1631] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 12 13:29:22 2022] POST /compute/v2.1/servers => generated 214 bytes in 917 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Oct 12 13:29:23.154104 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e43e82a0-9e38-4abf-9e29-68dae250d394 tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] Calling method '.version_select at 0x7f8a9bcf5b80>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:23.295400 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e43e82a0-9e38-4abf-9e29-68dae250d394 tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1844765580" status: 204 len: 0 microversion: 2.20 time: 0.153519 Oct 12 13:29:23.295832 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 804/1632] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 12 13:29:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1844765580 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 13:29:23.903851 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d58da5d1-d7d7-4831-a190-717dd54d1cda tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:23.905262 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-d58da5d1-d7d7-4831-a190-717dd54d1cda tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:23.929922 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:29:23.936068 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d58da5d1-d7d7-4831-a190-717dd54d1cda tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:23.937483 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d58da5d1-d7d7-4831-a190-717dd54d1cda tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:23.938140 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d58da5d1-d7d7-4831-a190-717dd54d1cda tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:23.940448 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d58da5d1-d7d7-4831-a190-717dd54d1cda tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:23.943267 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d58da5d1-d7d7-4831-a190-717dd54d1cda tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:23.944721 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d58da5d1-d7d7-4831-a190-717dd54d1cda tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:24.091689 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d58da5d1-d7d7-4831-a190-717dd54d1cda tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:24.109322 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d58da5d1-d7d7-4831-a190-717dd54d1cda tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:24.111274 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d58da5d1-d7d7-4831-a190-717dd54d1cda tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:24.122442 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d58da5d1-d7d7-4831-a190-717dd54d1cda tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1365 microversion: 2.47 time: 0.222664 Oct 12 13:29:24.123559 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 829/1633] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:23 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:25.041016 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3b8d478b-b537-440a-a029-9d9c8953d81b tempest-AbsoluteLimitsNegativeTestJSON-831604807 tempest-AbsoluteLimitsNegativeTestJSON-831604807-project] Calling method '.version_select at 0x7f8a9b92d0d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:25.066902 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b8d478b-b537-440a-a029-9d9c8953d81b tempest-AbsoluteLimitsNegativeTestJSON-831604807 tempest-AbsoluteLimitsNegativeTestJSON-831604807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:25.071902 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b8d478b-b537-440a-a029-9d9c8953d81b tempest-AbsoluteLimitsNegativeTestJSON-831604807 tempest-AbsoluteLimitsNegativeTestJSON-831604807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:25.075466 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b8d478b-b537-440a-a029-9d9c8953d81b tempest-AbsoluteLimitsNegativeTestJSON-831604807 tempest-AbsoluteLimitsNegativeTestJSON-831604807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:25.076380 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b8d478b-b537-440a-a029-9d9c8953d81b tempest-AbsoluteLimitsNegativeTestJSON-831604807 tempest-AbsoluteLimitsNegativeTestJSON-831604807-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:25.077069 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b8d478b-b537-440a-a029-9d9c8953d81b tempest-AbsoluteLimitsNegativeTestJSON-831604807 tempest-AbsoluteLimitsNegativeTestJSON-831604807-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:25.079632 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b8d478b-b537-440a-a029-9d9c8953d81b tempest-AbsoluteLimitsNegativeTestJSON-831604807 tempest-AbsoluteLimitsNegativeTestJSON-831604807-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:25.149599 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3cfabed0-a57e-4aec-b21a-500c60183c2a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:25.153075 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-3cfabed0-a57e-4aec-b21a-500c60183c2a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:25.165856 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3cfabed0-a57e-4aec-b21a-500c60183c2a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:25.169477 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3cfabed0-a57e-4aec-b21a-500c60183c2a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:25.172526 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3cfabed0-a57e-4aec-b21a-500c60183c2a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:25.173393 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3b8d478b-b537-440a-a029-9d9c8953d81b tempest-AbsoluteLimitsNegativeTestJSON-831604807 tempest-AbsoluteLimitsNegativeTestJSON-831604807-project] 10.222.0.52 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.690831 Oct 12 13:29:25.174348 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3cfabed0-a57e-4aec-b21a-500c60183c2a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:25.176169 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3cfabed0-a57e-4aec-b21a-500c60183c2a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:25.176405 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 805/1634] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Oct 12 13:29:24 2022] GET /compute/v2.1/limits => generated 511 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:29:25.177680 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3cfabed0-a57e-4aec-b21a-500c60183c2a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:25.301237 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f725ba5a-42eb-44e1-8032-c7027c92931a tempest-AbsoluteLimitsNegativeTestJSON-831604807 tempest-AbsoluteLimitsNegativeTestJSON-831604807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-288388335", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:25.430276 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-f725ba5a-42eb-44e1-8032-c7027c92931a tempest-AbsoluteLimitsNegativeTestJSON-831604807 tempest-AbsoluteLimitsNegativeTestJSON-831604807-project] validate_networks() for None {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:29:25.571005 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-3cfabed0-a57e-4aec-b21a-500c60183c2a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:25.573384 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=100 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:29:25.588829 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-3cfabed0-a57e-4aec-b21a-500c60183c2a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:25.590293 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-3cfabed0-a57e-4aec-b21a-500c60183c2a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:25.591471 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3cfabed0-a57e-4aec-b21a-500c60183c2a tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1365 microversion: 2.47 time: 0.445880 Oct 12 13:29:25.592042 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 830/1635] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:25 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1365 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:26.166352 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-996c3c2c-a9c8-4268-bb9e-27b9a6660d4d tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1192764592", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc8ada29-6985-4172-9880-e15344e4c066"}], "security_groups": [{"name": "tempest-securitygroup--2020266818"}], "key_name": "tempest-keypair-550757681", "user_data": "}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:26.439539 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-996c3c2c-a9c8-4268-bb9e-27b9a6660d4d tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] validate_networks() for [('dc8ada29-6985-4172-9880-e15344e4c066', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:29:26.963657 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-f725ba5a-42eb-44e1-8032-c7027c92931a tempest-AbsoluteLimitsNegativeTestJSON-831604807 tempest-AbsoluteLimitsNegativeTestJSON-831604807-project] Getting quotas for project 636362b25ef843a480be55923104ce3c. Resources: dict_keys(['metadata_items']) {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:29:26.973130 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-f725ba5a-42eb-44e1-8032-c7027c92931a tempest-AbsoluteLimitsNegativeTestJSON-831604807 tempest-AbsoluteLimitsNegativeTestJSON-831604807-project] Getting quotas for user 944564b747ab45d7a38a311cd7c1ae02 and project 636362b25ef843a480be55923104ce3c. Resources: dict_keys(['metadata_items']) {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:29:26.998603 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-f725ba5a-42eb-44e1-8032-c7027c92931a tempest-AbsoluteLimitsNegativeTestJSON-831604807 tempest-AbsoluteLimitsNegativeTestJSON-831604807-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f725ba5a-42eb-44e1-8032-c7027c92931a tempest-AbsoluteLimitsNegativeTestJSON-831604807 tempest-AbsoluteLimitsNegativeTestJSON-831604807-project] Request method failure captured: Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 1751 Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsE0hf-hUJjBooNhxgz0HdLxHrsFiXu78pA5w5zi-EZCDPLxUtDi3UsUBlLD_6eVBulCT5xwoZlUpSRKMX0poFZv28ptjDL-pyC4_JzSHh3rd2ItkymQpp18GmwbUPo1e-ZdwqQkUy3R5LVqwSJRBoJSu_jG5BWMlEPL1mgfa7EXHng Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 636362b25ef843a480be55923104ce3c Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-831604807 Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/636362b25ef843a480be55923104ce3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_636362b25ef843a480be55923104ce3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/636362b25ef843a480be55923104ce3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/636362b25ef843a480be55923104ce3c"}]}] Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-831604807 Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 636362b25ef843a480be55923104ce3c Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-831604807 Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-831604807-project Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 944564b747ab45d7a38a311cd7c1ae02 Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-831604807-project Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-288388335", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:29:27.023611 n-d-861076-2 devstack@n-api.service[120932]: exception: Maximum number of metadata items exceeds 128 Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-288388335', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:27.025799 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:27.028103 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:27.028103 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:29:27.028103 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 12 13:29:27.028103 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 12 13:29:27.028103 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 12 13:29:27.028103 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:27.028103 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:27.028103 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:27.028103 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:27.028103 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:27.028103 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:27.028103 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:27.028103 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:27.028103 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 12 13:29:27.028103 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:27.031943 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f725ba5a-42eb-44e1-8032-c7027c92931a tempest-AbsoluteLimitsNegativeTestJSON-831604807 tempest-AbsoluteLimitsNegativeTestJSON-831604807-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:27.033058 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f725ba5a-42eb-44e1-8032-c7027c92931a tempest-AbsoluteLimitsNegativeTestJSON-831604807 tempest-AbsoluteLimitsNegativeTestJSON-831604807-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.736011 Oct 12 13:29:27.034206 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 806/1636] 10.222.0.52 () {60 vars in 1148 bytes} [Wed Oct 12 13:29:25 2022] POST /compute/v2.1/servers => generated 87 bytes in 1738 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Oct 12 13:29:27.049173 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6db3ff1c-fcc2-4662-9d4b-67b974df5656 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:27.051254 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6db3ff1c-fcc2-4662-9d4b-67b974df5656 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:27.071533 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6db3ff1c-fcc2-4662-9d4b-67b974df5656 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:27.077738 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6db3ff1c-fcc2-4662-9d4b-67b974df5656 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:27.079349 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6db3ff1c-fcc2-4662-9d4b-67b974df5656 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:27.080333 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6db3ff1c-fcc2-4662-9d4b-67b974df5656 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:27.081604 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6db3ff1c-fcc2-4662-9d4b-67b974df5656 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:27.085064 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6db3ff1c-fcc2-4662-9d4b-67b974df5656 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:27.728045 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-6db3ff1c-fcc2-4662-9d4b-67b974df5656 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:27.747856 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-6db3ff1c-fcc2-4662-9d4b-67b974df5656 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:27.751903 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-6db3ff1c-fcc2-4662-9d4b-67b974df5656 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:27.753481 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6db3ff1c-fcc2-4662-9d4b-67b974df5656 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1365 microversion: 2.47 time: 0.718121 Oct 12 13:29:27.754244 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 807/1637] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:27 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1365 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-996c3c2c-a9c8-4268-bb9e-27b9a6660d4d tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-835612eb-e703-4640-96c4-05aca0fd3dde) Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:29:28.387206 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:29:28.396578 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:29:28.396578 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:29:28.396578 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:29:28.396578 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:29:28.396578 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:29:28.396578 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:29:28.396578 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:29:28.396578 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:29:28.396578 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:29:28.396578 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:29:28.396578 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:29:28.396578 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:29:28.396578 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:29:28.396578 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:29:28.396578 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:29:28.396578 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-835612eb-e703-4640-96c4-05aca0fd3dde) Oct 12 13:29:28.396578 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:28.396578 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-996c3c2c-a9c8-4268-bb9e-27b9a6660d4d tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:28.396578 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-996c3c2c-a9c8-4268-bb9e-27b9a6660d4d tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Request method failure captured: Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 489 Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsEwOeu7ksivSH2Ia4uk6eiitfE2rxVwume2XDO9f67bgMuDMRLUEcJHLLqoLfJE3O3e2ccAdYEavhU8AsmWwxFHv3zDi0c3lfYHAeJ8N437irnufxIoITRe-KpBBkHx9kV4PQOmQrTirMyNhgycn8bLqIFbrJyUzVBhxRpJBrZxcNQ Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 81c9366135cf42f096ef6e0d748fa283 Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AttachVolumeNegativeTest-144784080 Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/81c9366135cf42f096ef6e0d748fa283"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_81c9366135cf42f096ef6e0d748fa283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/81c9366135cf42f096ef6e0d748fa283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/81c9366135cf42f096ef6e0d748fa283"}]}] Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AttachVolumeNegativeTest-144784080 Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 81c9366135cf42f096ef6e0d748fa283 Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-144784080 Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AttachVolumeNegativeTest-144784080-project Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 67f1b44834f84be9915554e881195cc2 Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AttachVolumeNegativeTest-144784080-project Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1192764592", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "dc8ada29-6985-4172-9880-e15344e4c066"}], "security_groups": [{"name": "tempest-securitygroup--2020266818"}], "key_name": "tempest-keypair-550757681", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeNegativeTest-server-1192764592', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': 'dc8ada29-6985-4172-9880-e15344e4c066'}], 'security_groups': [{'name': 'tempest-securitygroup--2020266818'}], 'key_name': 'tempest-keypair-550757681', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:29:28.398668 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-835612eb-e703-4640-96c4-05aca0fd3dde) Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:28.405831 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:28.414349 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:28.414349 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:28.414349 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:28.414349 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:29:28.414349 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:29:28.414349 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:28.414349 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:28.414349 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:28.414349 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:28.414349 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:28.414349 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:28.414349 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:28.414349 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:28.414349 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:28.414349 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:28.414349 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:28.414349 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:28.414349 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:28.414349 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-996c3c2c-a9c8-4268-bb9e-27b9a6660d4d tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:28.414349 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:28.414349 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-996c3c2c-a9c8-4268-bb9e-27b9a6660d4d tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.238433 Oct 12 13:29:28.414349 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 831/1638] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:29:26 2022] POST /compute/v2.1/servers => generated 214 bytes in 2240 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 12 13:29:28.417014 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-02451cc1-983a-4c48-80bd-afae08fcd68d tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Calling method '.version_select at 0x7f8a9bc98670>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:28.499860 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e8aa50d5-de0f-41be-895f-12f89ae7da2d tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] Action: 'create', calling method: .version_select at 0x7f8a9ba68c10>, body: {"keypair": {"name": "tempest-keypair-1237988575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7Hr7iOWmVQ7/JZdRGNT+3gSv4V/6tqQmUYCziDcFTWPiyQwIKRuswIXa8GqrWwULq0/JrFGtAVBXATflaehMkvWFuZZOOzHl7OPMbOCAU5Ui7c0NjRpetE3IfznBUzRw=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:28.512273 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-02451cc1-983a-4c48-80bd-afae08fcd68d tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-550757681" status: 202 len: 0 microversion: 2.1 time: 0.104386 Oct 12 13:29:28.512986 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 808/1639] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Oct 12 13:29:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-550757681 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:29:28.546282 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-e8aa50d5-de0f-41be-895f-12f89ae7da2d tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] Getting quotas for project e885993d2014482b96097e5a9d46437d. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:29:28.561839 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-e8aa50d5-de0f-41be-895f-12f89ae7da2d tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] Getting quotas for user 9db7d5929e0f4639837edf7fefa3d4f8 and project e885993d2014482b96097e5a9d46437d. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:29:28.715896 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e8aa50d5-de0f-41be-895f-12f89ae7da2d tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.219920 Oct 12 13:29:28.716440 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 832/1640] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Oct 12 13:29:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 221 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 12 13:29:28.779627 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d4ac3541-bba5-489b-b505-8aabe8e3e693 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:28.780250 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d4ac3541-bba5-489b-b505-8aabe8e3e693 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:28.796497 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d4ac3541-bba5-489b-b505-8aabe8e3e693 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:28.796497 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d4ac3541-bba5-489b-b505-8aabe8e3e693 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:28.796497 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d4ac3541-bba5-489b-b505-8aabe8e3e693 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:28.796497 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d4ac3541-bba5-489b-b505-8aabe8e3e693 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:28.796497 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d4ac3541-bba5-489b-b505-8aabe8e3e693 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:28.796497 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d4ac3541-bba5-489b-b505-8aabe8e3e693 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:29.049273 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d4ac3541-bba5-489b-b505-8aabe8e3e693 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:29.058432 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d4ac3541-bba5-489b-b505-8aabe8e3e693 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:29.064442 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d4ac3541-bba5-489b-b505-8aabe8e3e693 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:29.068926 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d4ac3541-bba5-489b-b505-8aabe8e3e693 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1365 microversion: 2.47 time: 0.293067 Oct 12 13:29:29.071508 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 809/1641] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:28 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:30.102947 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f797908e-5634-4cf3-b273-78409de58bff tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:30.102947 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f797908e-5634-4cf3-b273-78409de58bff tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:30.112772 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f797908e-5634-4cf3-b273-78409de58bff tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:30.113716 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f797908e-5634-4cf3-b273-78409de58bff tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:30.114511 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f797908e-5634-4cf3-b273-78409de58bff tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:30.115676 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f797908e-5634-4cf3-b273-78409de58bff tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:30.116314 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f797908e-5634-4cf3-b273-78409de58bff tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:30.116926 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f797908e-5634-4cf3-b273-78409de58bff tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:30.379111 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f797908e-5634-4cf3-b273-78409de58bff tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:30.381415 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f797908e-5634-4cf3-b273-78409de58bff tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:30.390336 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f797908e-5634-4cf3-b273-78409de58bff tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:30.391919 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f797908e-5634-4cf3-b273-78409de58bff tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1365 microversion: 2.47 time: 0.297220 Oct 12 13:29:30.392816 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 833/1642] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:30 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1365 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:31.197181 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9d83318b-c0dd-4fb8-9267-67a74442c905 tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Calling method '.version_select at 0x7f8a9ba5fd30>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:31.297618 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9d83318b-c0dd-4fb8-9267-67a74442c905 tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/78b0c47228514cd898a3261636a8bd55" status: 200 len: 371 microversion: 2.1 time: 0.290746 Oct 12 13:29:31.299247 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 810/1643] 10.222.0.52 () {58 vars in 1242 bytes} [Wed Oct 12 13:29:31 2022] GET /compute/v2.1/os-quota-sets/78b0c47228514cd898a3261636a8bd55 => generated 371 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:29:31.313824 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1f016ae9-2ace-4c09-823d-a8ccf67d496f tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Action: 'update', calling method: .version_select at 0x7f8a9ba074c0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:31.418683 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1f016ae9-2ace-4c09-823d-a8ccf67d496f tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:31.426423 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1f016ae9-2ace-4c09-823d-a8ccf67d496f tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:31.426423 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1f016ae9-2ace-4c09-823d-a8ccf67d496f tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:31.426423 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1f016ae9-2ace-4c09-823d-a8ccf67d496f tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:31.426423 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1f016ae9-2ace-4c09-823d-a8ccf67d496f tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:31.426423 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1f016ae9-2ace-4c09-823d-a8ccf67d496f tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:31.426949 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c91097af-98a9-4e07-ac0b-9f0720f372b9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:31.427906 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c91097af-98a9-4e07-ac0b-9f0720f372b9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:31.440850 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c91097af-98a9-4e07-ac0b-9f0720f372b9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:31.441412 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c91097af-98a9-4e07-ac0b-9f0720f372b9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:31.441850 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c91097af-98a9-4e07-ac0b-9f0720f372b9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:31.457508 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c91097af-98a9-4e07-ac0b-9f0720f372b9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:31.459173 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c91097af-98a9-4e07-ac0b-9f0720f372b9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:31.461939 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c91097af-98a9-4e07-ac0b-9f0720f372b9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:31.590531 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1f016ae9-2ace-4c09-823d-a8ccf67d496f tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/78b0c47228514cd898a3261636a8bd55" status: 200 len: 328 microversion: 2.1 time: 0.280885 Oct 12 13:29:31.591664 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 834/1644] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 12 13:29:31 2022] PUT /compute/v2.1/os-quota-sets/78b0c47228514cd898a3261636a8bd55 => generated 328 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:29:31.820977 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c91097af-98a9-4e07-ac0b-9f0720f372b9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:31.830725 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-418e1934-74c8-4fbd-affb-4c9ef466996b tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-199981133", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:31.832242 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c91097af-98a9-4e07-ac0b-9f0720f372b9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:31.845823 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-c91097af-98a9-4e07-ac0b-9f0720f372b9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:31.845823 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c91097af-98a9-4e07-ac0b-9f0720f372b9 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1365 microversion: 2.47 time: 0.414232 Oct 12 13:29:31.863881 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 811/1645] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:31 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1365 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:31.872330 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bee64759-1192-429c-93c4-8491d79e352b tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Action: 'create', calling method: .version_select at 0x7f8a9bc98d30>, body: {"keypair": {"name": "tempest-keypair-313321026", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxHEwSF0IqWJaRVUJIbMEiQrfM4Ombqh9Ml8oqX7b2amgcVGzwolr66agdoRF0cm0M2yxzqV0l8tEQGPpSq0JVuMIUmJY07MLBq3My9W/BqVUkgXSJEyb0KHHJHnkClbQ=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:31.909928 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-bee64759-1192-429c-93c4-8491d79e352b tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Getting quotas for project 81c9366135cf42f096ef6e0d748fa283. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:29:31.924882 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-bee64759-1192-429c-93c4-8491d79e352b tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Getting quotas for user 67f1b44834f84be9915554e881195cc2 and project 81c9366135cf42f096ef6e0d748fa283. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:29:31.932008 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-418e1934-74c8-4fbd-affb-4c9ef466996b tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] validate_networks() for None {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:29:32.065931 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bee64759-1192-429c-93c4-8491d79e352b tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.199926 Oct 12 13:29:32.067158 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 812/1646] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:29:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:29:32.347910 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-418e1934-74c8-4fbd-affb-4c9ef466996b tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:29:32.349067 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-418e1934-74c8-4fbd-affb-4c9ef466996b tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:29:32.350128 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-418e1934-74c8-4fbd-affb-4c9ef466996b tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:29:32.350676 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-418e1934-74c8-4fbd-affb-4c9ef466996b tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:29:32.351227 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-418e1934-74c8-4fbd-affb-4c9ef466996b tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:29:32.362440 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-418e1934-74c8-4fbd-affb-4c9ef466996b tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:32.363677 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-418e1934-74c8-4fbd-affb-4c9ef466996b tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:32.365203 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-418e1934-74c8-4fbd-affb-4c9ef466996b tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:32.366711 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-418e1934-74c8-4fbd-affb-4c9ef466996b tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:32.367549 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-418e1934-74c8-4fbd-affb-4c9ef466996b tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:32.368910 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-418e1934-74c8-4fbd-affb-4c9ef466996b tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:32.428974 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-418e1934-74c8-4fbd-affb-4c9ef466996b tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Getting quotas for project 78b0c47228514cd898a3261636a8bd55. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:29:32.428974 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-418e1934-74c8-4fbd-affb-4c9ef466996b tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Getting quotas for user 26e1b604e8b54d23b2e04a29b29665d8 and project 78b0c47228514cd898a3261636a8bd55. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:29:32.450349 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.utils [None req-418e1934-74c8-4fbd-affb-4c9ef466996b tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] cores quota exceeded for 78b0c47228514cd898a3261636a8bd55, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120933) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 12 13:29:32.451535 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-418e1934-74c8-4fbd-affb-4c9ef466996b tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-418e1934-74c8-4fbd-affb-4c9ef466996b tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Request method failure captured: Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 144 Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsE5DvYfnoC8Q3hKoUJPz7XR90GZiohj5Ji31DUHOBxw03-DX8SbAJCHlYzUisuzX6kLAmn5UwhwV9fkbHXlEqgzUmIMXNYUX7trRskIQWQ7VLSRNxG8180aK7tPwNMyLjoeXTAgUbDBCnaDjUp6LwBLY1mLTCm6rlaW61X-TkBg4e8 Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 78b0c47228514cd898a3261636a8bd55 Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-QuotasAdminNegativeTest-1320456965 Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/78b0c47228514cd898a3261636a8bd55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_78b0c47228514cd898a3261636a8bd55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/78b0c47228514cd898a3261636a8bd55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/78b0c47228514cd898a3261636a8bd55"}]}] Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-QuotasAdminNegativeTest-1320456965 Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 78b0c47228514cd898a3261636a8bd55 Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1320456965 Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-QuotasAdminNegativeTest-1320456965-project Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 26e1b604e8b54d23b2e04a29b29665d8 Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-QuotasAdminNegativeTest-1320456965-project Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-199981133", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-199981133', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452'}}} Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:29:32.465248 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-418e1934-74c8-4fbd-affb-4c9ef466996b tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-418e1934-74c8-4fbd-affb-4c9ef466996b tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.716640 Oct 12 13:29:32.472156 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 835/1647] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:29:31 2022] POST /compute/v2.1/servers => generated 111 bytes in 718 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:29:32.475956 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-611d3734-1abf-43ab-b790-5da415bfe93f tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Action: 'update', calling method: .version_select at 0x7f8a9bf845e0>, body: {"quota_set": {"cores": 20}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:32.872931 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-73eb3400-20f6-4f95-bd85-63829f5d74b3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:32.874339 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-73eb3400-20f6-4f95-bd85-63829f5d74b3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:32.892365 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-73eb3400-20f6-4f95-bd85-63829f5d74b3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:32.893486 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-73eb3400-20f6-4f95-bd85-63829f5d74b3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:32.894254 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-73eb3400-20f6-4f95-bd85-63829f5d74b3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:32.896586 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-73eb3400-20f6-4f95-bd85-63829f5d74b3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:32.897295 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-73eb3400-20f6-4f95-bd85-63829f5d74b3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:32.897948 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-73eb3400-20f6-4f95-bd85-63829f5d74b3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:33.149507 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-73eb3400-20f6-4f95-bd85-63829f5d74b3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:33.177906 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-73eb3400-20f6-4f95-bd85-63829f5d74b3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:33.184129 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-73eb3400-20f6-4f95-bd85-63829f5d74b3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:33.186897 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-73eb3400-20f6-4f95-bd85-63829f5d74b3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1365 microversion: 2.47 time: 0.320837 Oct 12 13:29:33.192101 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 836/1648] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:32 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1365 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:33.479099 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-611d3734-1abf-43ab-b790-5da415bfe93f tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:33.479583 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-611d3734-1abf-43ab-b790-5da415bfe93f tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:33.489639 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-611d3734-1abf-43ab-b790-5da415bfe93f tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:33.490503 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-611d3734-1abf-43ab-b790-5da415bfe93f tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:33.490980 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-611d3734-1abf-43ab-b790-5da415bfe93f tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:33.491454 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-611d3734-1abf-43ab-b790-5da415bfe93f tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:33.803540 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-611d3734-1abf-43ab-b790-5da415bfe93f tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/78b0c47228514cd898a3261636a8bd55" status: 200 len: 329 microversion: 2.1 time: 1.330392 Oct 12 13:29:33.814999 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 813/1649] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 12 13:29:32 2022] PUT /compute/v2.1/os-quota-sets/78b0c47228514cd898a3261636a8bd55 => generated 329 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:29:33.819818 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2dabcfb5-09d6-4319-afdd-9a600987f9e1 tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Calling method '.version_select at 0x7f8a9b9d3790>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:34.217134 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-871aa222-a91f-49a3-9c60-a25091535d8c tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:34.218130 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-871aa222-a91f-49a3-9c60-a25091535d8c tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:34.239043 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-871aa222-a91f-49a3-9c60-a25091535d8c tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:34.239719 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-871aa222-a91f-49a3-9c60-a25091535d8c tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:34.240180 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-871aa222-a91f-49a3-9c60-a25091535d8c tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:34.248998 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-871aa222-a91f-49a3-9c60-a25091535d8c tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:34.249755 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-871aa222-a91f-49a3-9c60-a25091535d8c tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:34.255021 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-871aa222-a91f-49a3-9c60-a25091535d8c tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:34.570969 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-871aa222-a91f-49a3-9c60-a25091535d8c tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:34.586539 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:29:34.599994 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-871aa222-a91f-49a3-9c60-a25091535d8c tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:34.605370 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-871aa222-a91f-49a3-9c60-a25091535d8c tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:34.615661 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-871aa222-a91f-49a3-9c60-a25091535d8c tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1371 microversion: 2.47 time: 0.401405 Oct 12 13:29:34.617712 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 814/1650] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:34 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1371 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:29:34.774599 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2dabcfb5-09d6-4319-afdd-9a600987f9e1 tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/78b0c47228514cd898a3261636a8bd55" status: 200 len: 371 microversion: 2.1 time: 0.961100 Oct 12 13:29:34.776611 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 837/1651] 10.222.0.52 () {58 vars in 1242 bytes} [Wed Oct 12 13:29:33 2022] GET /compute/v2.1/os-quota-sets/78b0c47228514cd898a3261636a8bd55 => generated 371 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:29:34.789586 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-816df667-5263-4fea-851c-f67363ffbd1d tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Action: 'update', calling method: .version_select at 0x7f8aa026fee0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:35.076881 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-816df667-5263-4fea-851c-f67363ffbd1d tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:35.081779 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-816df667-5263-4fea-851c-f67363ffbd1d tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:35.082567 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-816df667-5263-4fea-851c-f67363ffbd1d tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:35.083514 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-816df667-5263-4fea-851c-f67363ffbd1d tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:35.084382 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-816df667-5263-4fea-851c-f67363ffbd1d tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:35.084878 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-816df667-5263-4fea-851c-f67363ffbd1d tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:35.127458 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:29:35.247800 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-816df667-5263-4fea-851c-f67363ffbd1d tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/78b0c47228514cd898a3261636a8bd55" status: 200 len: 328 microversion: 2.1 time: 0.463519 Oct 12 13:29:35.260450 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 815/1652] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 12 13:29:34 2022] PUT /compute/v2.1/os-quota-sets/78b0c47228514cd898a3261636a8bd55 => generated 328 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:29:35.525499 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2100e5b0-b7d4-48dd-b647-b9667c796ff4 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-361101087", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:35.536662 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bd3991c3-b306-479f-abe2-ee9e85312788 tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-997847153", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4bbab782-32a6-4260-b03a-514efd8c81ff"}], "security_groups": [{"name": "tempest-securitygroup--2039501296"}], "key_name": "tempest-keypair-1237988575", "user_data": "}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:35.633755 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-2100e5b0-b7d4-48dd-b647-b9667c796ff4 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] validate_networks() for None {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:29:35.827920 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-bd3991c3-b306-479f-abe2-ee9e85312788 tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] validate_networks() for [('4bbab782-32a6-4260-b03a-514efd8c81ff', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:29:36.794611 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-2100e5b0-b7d4-48dd-b647-b9667c796ff4 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:29:36.795089 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-2100e5b0-b7d4-48dd-b647-b9667c796ff4 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-bd3991c3-b306-479f-abe2-ee9e85312788 tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-85412e5d-fa58-419e-89c5-80ddfbf39810) Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:29:36.800849 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:29:36.804557 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:29:36.804557 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:29:36.804557 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:29:36.804557 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:29:36.804557 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:29:36.804557 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:29:36.804557 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:29:36.804557 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:29:36.804557 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:29:36.804557 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:29:36.804557 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:29:36.804557 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:29:36.804557 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:29:36.804557 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:29:36.804557 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:29:36.804557 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-85412e5d-fa58-419e-89c5-80ddfbf39810) Oct 12 13:29:36.804557 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:36.805935 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-2100e5b0-b7d4-48dd-b647-b9667c796ff4 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:29:36.805935 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-2100e5b0-b7d4-48dd-b647-b9667c796ff4 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:29:36.805935 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-2100e5b0-b7d4-48dd-b647-b9667c796ff4 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:29:36.806981 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-bd3991c3-b306-479f-abe2-ee9e85312788 tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:36.806981 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bd3991c3-b306-479f-abe2-ee9e85312788 tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] Request method failure captured: Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 491 Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsEpYjLWnsszdowjwTcI3o1NPZqrabsv-QzFhSkwmNJmICBoJoXd8NOokXt7vBgDxv6AS1qT8S63R0KYoKnxRo5kFAPKt8kn8-biv2R-yxDwHf86Hcgn9K6rhbbSUaviqI73Xpe1muRRC3lE8lGTb8X2GiyszbNYNONbg7rzrUpR17A Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: e885993d2014482b96097e5a9d46437d Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-58097819 Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e885993d2014482b96097e5a9d46437d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e885993d2014482b96097e5a9d46437d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e885993d2014482b96097e5a9d46437d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e885993d2014482b96097e5a9d46437d"}]}] Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-AttachVolumeShelveTestJSON-58097819 Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: e885993d2014482b96097e5a9d46437d Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-58097819 Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-AttachVolumeShelveTestJSON-58097819-project Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 9db7d5929e0f4639837edf7fefa3d4f8 Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-AttachVolumeShelveTestJSON-58097819-project Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-997847153", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "4bbab782-32a6-4260-b03a-514efd8c81ff"}], "security_groups": [{"name": "tempest-securitygroup--2039501296"}], "key_name": "tempest-keypair-1237988575", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeShelveTestJSON-server-997847153', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': '4bbab782-32a6-4260-b03a-514efd8c81ff'}], 'security_groups': [{'name': 'tempest-securitygroup--2039501296'}], 'key_name': 'tempest-keypair-1237988575', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:29:36.810390 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-85412e5d-fa58-419e-89c5-80ddfbf39810) Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:36.820504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:36.823613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:36.823613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:36.823613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:36.823613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:29:36.823613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:29:36.823613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:36.823613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:36.823613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:36.823613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:36.823613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:36.823613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:36.823613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:36.823613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:36.823613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:36.823613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:36.823613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:36.823613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:36.823613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:36.823613 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bd3991c3-b306-479f-abe2-ee9e85312788 tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:36.823613 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:36.823613 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bd3991c3-b306-479f-abe2-ee9e85312788 tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.20 time: 1.286100 Oct 12 13:29:36.823613 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 816/1653] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 12 13:29:35 2022] POST /compute/v2.1/servers => generated 214 bytes in 1287 msecs (HTTP/1.1 500) 9 headers in 393 bytes (2 switches on core 0) Oct 12 13:29:36.832788 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2100e5b0-b7d4-48dd-b647-b9667c796ff4 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:36.833936 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2100e5b0-b7d4-48dd-b647-b9667c796ff4 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:36.834421 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2100e5b0-b7d4-48dd-b647-b9667c796ff4 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:36.838667 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2100e5b0-b7d4-48dd-b647-b9667c796ff4 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:36.842988 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2100e5b0-b7d4-48dd-b647-b9667c796ff4 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:36.847683 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2100e5b0-b7d4-48dd-b647-b9667c796ff4 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:36.942832 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-2100e5b0-b7d4-48dd-b647-b9667c796ff4 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Getting quotas for project 78b0c47228514cd898a3261636a8bd55. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:29:36.952239 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-2100e5b0-b7d4-48dd-b647-b9667c796ff4 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Getting quotas for user 26e1b604e8b54d23b2e04a29b29665d8 and project 78b0c47228514cd898a3261636a8bd55. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:29:36.970949 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.utils [None req-2100e5b0-b7d4-48dd-b647-b9667c796ff4 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] instances quota exceeded for 78b0c47228514cd898a3261636a8bd55, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120933) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 12 13:29:36.973431 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-2100e5b0-b7d4-48dd-b647-b9667c796ff4 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2100e5b0-b7d4-48dd-b647-b9667c796ff4 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Request method failure captured: Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 144 Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsE5DvYfnoC8Q3hKoUJPz7XR90GZiohj5Ji31DUHOBxw03-DX8SbAJCHlYzUisuzX6kLAmn5UwhwV9fkbHXlEqgzUmIMXNYUX7trRskIQWQ7VLSRNxG8180aK7tPwNMyLjoeXTAgUbDBCnaDjUp6LwBLY1mLTCm6rlaW61X-TkBg4e8 Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 78b0c47228514cd898a3261636a8bd55 Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-QuotasAdminNegativeTest-1320456965 Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/78b0c47228514cd898a3261636a8bd55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_78b0c47228514cd898a3261636a8bd55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/78b0c47228514cd898a3261636a8bd55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/78b0c47228514cd898a3261636a8bd55"}]}] Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-QuotasAdminNegativeTest-1320456965 Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 78b0c47228514cd898a3261636a8bd55 Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1320456965 Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-QuotasAdminNegativeTest-1320456965-project Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 26e1b604e8b54d23b2e04a29b29665d8 Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-QuotasAdminNegativeTest-1320456965-project Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-361101087", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-361101087', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452'}}} Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:29:36.976234 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 12 13:29:36.980519 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:36.984775 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2100e5b0-b7d4-48dd-b647-b9667c796ff4 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:36.986438 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2100e5b0-b7d4-48dd-b647-b9667c796ff4 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.464888 Oct 12 13:29:36.988147 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 838/1654] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:29:35 2022] POST /compute/v2.1/servers => generated 119 bytes in 1467 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:29:36.999080 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7e1cc5ac-8a80-429c-a76e-10cfbf431271 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:37.000481 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7e1cc5ac-8a80-429c-a76e-10cfbf431271 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:37.002425 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-951d55d1-7f03-47fe-b2e9-d8f502e63a4c tempest-MultipleCreateNegativeTestJSON-273583863 tempest-MultipleCreateNegativeTestJSON-273583863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-467326415", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:37.005968 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-951d55d1-7f03-47fe-b2e9-d8f502e63a4c tempest-MultipleCreateNegativeTestJSON-273583863 tempest-MultipleCreateNegativeTestJSON-273583863-project] HTTP exception thrown: min_count must be <= max_count Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-951d55d1-7f03-47fe-b2e9-d8f502e63a4c tempest-MultipleCreateNegativeTestJSON-273583863 tempest-MultipleCreateNegativeTestJSON-273583863-project] Request method failure captured: Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 183 Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsE_2Y_jVlPjBW-6RFenWgP6XZFsNgHhhk97VJMH7Vq3CiylBbyiK_v23L_l4IsJDviZfGigN3HIeNzfGzgJIo-pDBcqjdDD0YYjfHp_5D1Mjm6Y6XCwhsMg7L6j4I5whtM7I3Ovq69G4EktlT7bAD_-93Dk-Ygg2KO7mel07MQcDyQ Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 39745c6ae93b4cb29faf6cdb9a334031 Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-273583863 Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/39745c6ae93b4cb29faf6cdb9a334031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_39745c6ae93b4cb29faf6cdb9a334031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/39745c6ae93b4cb29faf6cdb9a334031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/39745c6ae93b4cb29faf6cdb9a334031"}]}] Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-273583863 Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 39745c6ae93b4cb29faf6cdb9a334031 Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-273583863 Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-MultipleCreateNegativeTestJSON-273583863-project Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 4d69a1e620f24f459525f8e6436aa88e Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-273583863-project Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-467326415", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: exception: min_count must be <= max_count Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-467326415', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 12 13:29:37.009707 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:37.028806 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7e1cc5ac-8a80-429c-a76e-10cfbf431271 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:37.028806 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7e1cc5ac-8a80-429c-a76e-10cfbf431271 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:37.028806 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7e1cc5ac-8a80-429c-a76e-10cfbf431271 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:37.028806 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7e1cc5ac-8a80-429c-a76e-10cfbf431271 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:37.031304 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-951d55d1-7f03-47fe-b2e9-d8f502e63a4c tempest-MultipleCreateNegativeTestJSON-273583863 tempest-MultipleCreateNegativeTestJSON-273583863-project] Returning 400 to user: min_count must be <= max_count {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:37.031304 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-951d55d1-7f03-47fe-b2e9-d8f502e63a4c tempest-MultipleCreateNegativeTestJSON-273583863 tempest-MultipleCreateNegativeTestJSON-273583863-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.197593 Oct 12 13:29:37.031442 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7e1cc5ac-8a80-429c-a76e-10cfbf431271 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:37.031519 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 817/1655] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:29:36 2022] POST /compute/v2.1/servers => generated 74 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 13:29:37.031599 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7e1cc5ac-8a80-429c-a76e-10cfbf431271 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:37.039994 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9610562c-d751-4128-8374-7ad5c3ca11dc tempest-ServersTestMultiNic-410166434 tempest-ServersTestMultiNic-410166434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-430173122", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "f73453df-db5d-4424-9539-53a5f313b8cc"}, {"uuid": "3400ee3c-2a18-47eb-88a6-d3b98bad974f"}, {"uuid": "f73453df-db5d-4424-9539-53a5f313b8cc"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:37.179717 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-9610562c-d751-4128-8374-7ad5c3ca11dc tempest-ServersTestMultiNic-410166434 tempest-ServersTestMultiNic-410166434-project] validate_networks() for [('f73453df-db5d-4424-9539-53a5f313b8cc', None, None, None, None, None), ('3400ee3c-2a18-47eb-88a6-d3b98bad974f', None, None, None, None, None), ('f73453df-db5d-4424-9539-53a5f313b8cc', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:29:37.332818 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-7e1cc5ac-8a80-429c-a76e-10cfbf431271 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:37.342811 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-7e1cc5ac-8a80-429c-a76e-10cfbf431271 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:37.344336 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-7e1cc5ac-8a80-429c-a76e-10cfbf431271 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:37.351862 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-7e1cc5ac-8a80-429c-a76e-10cfbf431271 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1371 microversion: 2.47 time: 0.362409 Oct 12 13:29:37.352629 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 839/1656] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:36 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1371 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:37.357391 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-14ab1ab5-1f51-4d93-ac99-39496b91f6f0 tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] Calling method '.version_select at 0x7f8a9b9fdf70>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:37.476855 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-14ab1ab5-1f51-4d93-ac99-39496b91f6f0 tempest-AttachVolumeShelveTestJSON-58097819 tempest-AttachVolumeShelveTestJSON-58097819-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1237988575" status: 204 len: 0 microversion: 2.20 time: 0.123086 Oct 12 13:29:37.477929 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 840/1657] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 12 13:29:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1237988575 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 13:29:37.485091 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8106f1f3-e877-4bfa-a041-4476f2567aef tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Action: 'update', calling method: .version_select at 0x7f8a9baf2f70>, body: {"quota_set": {"instances": 10}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:37.754331 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8106f1f3-e877-4bfa-a041-4476f2567aef tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:37.779952 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8106f1f3-e877-4bfa-a041-4476f2567aef tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:37.779952 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8106f1f3-e877-4bfa-a041-4476f2567aef tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:37.779952 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8106f1f3-e877-4bfa-a041-4476f2567aef tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:37.779952 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8106f1f3-e877-4bfa-a041-4476f2567aef tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:37.779952 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8106f1f3-e877-4bfa-a041-4476f2567aef tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-9610562c-d751-4128-8374-7ad5c3ca11dc tempest-ServersTestMultiNic-410166434 tempest-ServersTestMultiNic-410166434-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-104b96ea-3f4f-40d4-a3ae-9811dc92a738) Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:29:38.203852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-104b96ea-3f4f-40d4-a3ae-9811dc92a738) Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-9610562c-d751-4128-8374-7ad5c3ca11dc tempest-ServersTestMultiNic-410166434 tempest-ServersTestMultiNic-410166434-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9610562c-d751-4128-8374-7ad5c3ca11dc tempest-ServersTestMultiNic-410166434 tempest-ServersTestMultiNic-410166434-project] Request method failure captured: Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 304 Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsE60O42OkJmlOjDFXv6L7X9tonXctyUPsUJTCRWsmDBcdWnM-ccbJ671DfTHHU9_9YtQGbai2XOMet-wkXI-sVFyZwo_R8dm0pSmWrqg9ZwIWRKKKopyF3JMu0YCWhlsM3wclHEg5-svYbRPC2WM9aT73EIlgam4L7-abuVLWW8svM Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: d8809dd2a86042858d174f1af477d593 Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServersTestMultiNic-410166434 Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d8809dd2a86042858d174f1af477d593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d8809dd2a86042858d174f1af477d593"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8809dd2a86042858d174f1af477d593"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8809dd2a86042858d174f1af477d593"}]}] Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServersTestMultiNic-410166434 Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: d8809dd2a86042858d174f1af477d593 Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServersTestMultiNic-410166434 Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServersTestMultiNic-410166434-project Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: d8907362cfac419cba45e154a393fc9c Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServersTestMultiNic-410166434-project Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-ServersTestMultiNic-server-430173122", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "f73453df-db5d-4424-9539-53a5f313b8cc"}, {"uuid": "3400ee3c-2a18-47eb-88a6-d3b98bad974f"}, {"uuid": "f73453df-db5d-4424-9539-53a5f313b8cc"}]}} Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:29:38.214499 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-ServersTestMultiNic-server-430173122', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': 'f73453df-db5d-4424-9539-53a5f313b8cc'}, {'uuid': '3400ee3c-2a18-47eb-88a6-d3b98bad974f'}, {'uuid': 'f73453df-db5d-4424-9539-53a5f313b8cc'}]}}} Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:29:38.227315 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-104b96ea-3f4f-40d4-a3ae-9811dc92a738) Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9610562c-d751-4128-8374-7ad5c3ca11dc tempest-ServersTestMultiNic-410166434 tempest-ServersTestMultiNic-410166434-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9610562c-d751-4128-8374-7ad5c3ca11dc tempest-ServersTestMultiNic-410166434 tempest-ServersTestMultiNic-410166434-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.072405 Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 818/1658] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:29:37 2022] POST /compute/v2.1/servers => generated 214 bytes in 1074 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-377fefa0-f2e4-4787-acae-7c333b2739e2 tempest-MultipleCreateNegativeTestJSON-273583863 tempest-MultipleCreateNegativeTestJSON-273583863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1941335215", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "max_count": 0}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-377fefa0-f2e4-4787-acae-7c333b2739e2 tempest-MultipleCreateNegativeTestJSON-273583863 tempest-MultipleCreateNegativeTestJSON-273583863-project] Request method failure captured: Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 168 Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:38.241958 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsE_2Y_jVlPjBW-6RFenWgP6XZFsNgHhhk97VJMH7Vq3CiylBbyiK_v23L_l4IsJDviZfGigN3HIeNzfGzgJIo-pDBcqjdDD0YYjfHp_5D1Mjm6Y6XCwhsMg7L6j4I5whtM7I3Ovq69G4EktlT7bAD_-93Dk-Ygg2KO7mel07MQcDyQ Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 39745c6ae93b4cb29faf6cdb9a334031 Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-273583863 Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/39745c6ae93b4cb29faf6cdb9a334031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_39745c6ae93b4cb29faf6cdb9a334031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/39745c6ae93b4cb29faf6cdb9a334031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/39745c6ae93b4cb29faf6cdb9a334031"}]}] Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-273583863 Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 39745c6ae93b4cb29faf6cdb9a334031 Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-273583863 Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-MultipleCreateNegativeTestJSON-273583863-project Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 4d69a1e620f24f459525f8e6436aa88e Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-273583863-project Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1941335215", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "max_count": 0}} Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1941335215', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'max_count': 0}}} Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise error Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi 0 Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 12 13:29:38.245935 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.257273 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:38.257273 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.257273 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:38.257273 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:38.257273 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:38.257273 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 13:29:38.257273 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 13:29:38.257273 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 12 13:29:38.257273 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.257273 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-377fefa0-f2e4-4787-acae-7c333b2739e2 tempest-MultipleCreateNegativeTestJSON-273583863 tempest-MultipleCreateNegativeTestJSON-273583863-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:38.257273 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-377fefa0-f2e4-4787-acae-7c333b2739e2 tempest-MultipleCreateNegativeTestJSON-273583863 tempest-MultipleCreateNegativeTestJSON-273583863-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016290 Oct 12 13:29:38.257273 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 819/1659] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:29:38 2022] POST /compute/v2.1/servers => generated 130 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:29:38.286941 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-8106f1f3-e877-4bfa-a041-4476f2567aef tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/78b0c47228514cd898a3261636a8bd55" status: 200 len: 329 microversion: 2.1 time: 0.807676 Oct 12 13:29:38.309675 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 841/1660] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 12 13:29:37 2022] PUT /compute/v2.1/os-quota-sets/78b0c47228514cd898a3261636a8bd55 => generated 329 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:29:38.313220 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b6a4997d-24de-4045-8b66-7a42601d66bd tempest-MultipleCreateNegativeTestJSON-273583863 tempest-MultipleCreateNegativeTestJSON-273583863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-531855264", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "max_count": 2.5}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:38.317787 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-00180f39-a23e-4c89-84a9-c891a71953d0 tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Calling method '.version_select at 0x7f8a9b9d3c10>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b6a4997d-24de-4045-8b66-7a42601d66bd tempest-MultipleCreateNegativeTestJSON-273583863 tempest-MultipleCreateNegativeTestJSON-273583863-project] Request method failure captured: Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 169 Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsE_2Y_jVlPjBW-6RFenWgP6XZFsNgHhhk97VJMH7Vq3CiylBbyiK_v23L_l4IsJDviZfGigN3HIeNzfGzgJIo-pDBcqjdDD0YYjfHp_5D1Mjm6Y6XCwhsMg7L6j4I5whtM7I3Ovq69G4EktlT7bAD_-93Dk-Ygg2KO7mel07MQcDyQ Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 39745c6ae93b4cb29faf6cdb9a334031 Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-273583863 Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/39745c6ae93b4cb29faf6cdb9a334031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_39745c6ae93b4cb29faf6cdb9a334031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/39745c6ae93b4cb29faf6cdb9a334031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/39745c6ae93b4cb29faf6cdb9a334031"}]}] Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-273583863 Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 39745c6ae93b4cb29faf6cdb9a334031 Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-273583863 Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-MultipleCreateNegativeTestJSON-273583863-project Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 4d69a1e620f24f459525f8e6436aa88e Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-273583863-project Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-531855264", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "max_count": 2.5}} Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-531855264', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'max_count': 2.5}}} Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise error Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi 2.5 Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 13:29:38.318815 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 13:29:38.322348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 13:29:38.322348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 13:29:38.322348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 13:29:38.322348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 13:29:38.322348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 13:29:38.322348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.322348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:38.322348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.322348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:38.322348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:38.322348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:38.322348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 13:29:38.322348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 13:29:38.322348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 13:29:38.322348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.336973 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b6a4997d-24de-4045-8b66-7a42601d66bd tempest-MultipleCreateNegativeTestJSON-273583863 tempest-MultipleCreateNegativeTestJSON-273583863-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:38.336973 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b6a4997d-24de-4045-8b66-7a42601d66bd tempest-MultipleCreateNegativeTestJSON-273583863 tempest-MultipleCreateNegativeTestJSON-273583863-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.017222 Oct 12 13:29:38.342121 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 820/1661] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:29:38 2022] POST /compute/v2.1/servers => generated 139 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 12 13:29:38.385808 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fce98769-d0cf-44bf-bbec-37c606c6f84e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:38.386587 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fce98769-d0cf-44bf-bbec-37c606c6f84e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:38.397808 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fce98769-d0cf-44bf-bbec-37c606c6f84e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:38.401417 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fce98769-d0cf-44bf-bbec-37c606c6f84e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:38.401853 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fce98769-d0cf-44bf-bbec-37c606c6f84e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:38.402588 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fce98769-d0cf-44bf-bbec-37c606c6f84e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:38.403048 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fce98769-d0cf-44bf-bbec-37c606c6f84e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:38.403472 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fce98769-d0cf-44bf-bbec-37c606c6f84e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:38.461689 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-00180f39-a23e-4c89-84a9-c891a71953d0 tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/78b0c47228514cd898a3261636a8bd55" status: 200 len: 371 microversion: 2.1 time: 0.138122 Oct 12 13:29:38.462443 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 842/1662] 10.222.0.52 () {58 vars in 1242 bytes} [Wed Oct 12 13:29:38 2022] GET /compute/v2.1/os-quota-sets/78b0c47228514cd898a3261636a8bd55 => generated 371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:29:38.475298 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5c967410-7847-4b26-9c00-012074ea71fb tempest-MultipleCreateNegativeTestJSON-273583863 tempest-MultipleCreateNegativeTestJSON-273583863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-811346465", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "min_count": 0}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5c967410-7847-4b26-9c00-012074ea71fb tempest-MultipleCreateNegativeTestJSON-273583863 tempest-MultipleCreateNegativeTestJSON-273583863-project] Request method failure captured: Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 167 Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsE_2Y_jVlPjBW-6RFenWgP6XZFsNgHhhk97VJMH7Vq3CiylBbyiK_v23L_l4IsJDviZfGigN3HIeNzfGzgJIo-pDBcqjdDD0YYjfHp_5D1Mjm6Y6XCwhsMg7L6j4I5whtM7I3Ovq69G4EktlT7bAD_-93Dk-Ygg2KO7mel07MQcDyQ Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 39745c6ae93b4cb29faf6cdb9a334031 Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-273583863 Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/39745c6ae93b4cb29faf6cdb9a334031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_39745c6ae93b4cb29faf6cdb9a334031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/39745c6ae93b4cb29faf6cdb9a334031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/39745c6ae93b4cb29faf6cdb9a334031"}]}] Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-273583863 Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 39745c6ae93b4cb29faf6cdb9a334031 Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-273583863 Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-MultipleCreateNegativeTestJSON-273583863-project Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 4d69a1e620f24f459525f8e6436aa88e Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-273583863-project Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-811346465", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "min_count": 0}} Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-811346465', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'min_count': 0}}} Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise error Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 0 Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 13:29:38.483645 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 13:29:38.501677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 13:29:38.501677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 13:29:38.501677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 13:29:38.501677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 13:29:38.501677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 12 13:29:38.501677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.501677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:38.501677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.501677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:38.501677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:38.501677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:38.501677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 13:29:38.501677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 13:29:38.501677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 12 13:29:38.501677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.501677 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5c967410-7847-4b26-9c00-012074ea71fb tempest-MultipleCreateNegativeTestJSON-273583863 tempest-MultipleCreateNegativeTestJSON-273583863-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:38.501677 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5c967410-7847-4b26-9c00-012074ea71fb tempest-MultipleCreateNegativeTestJSON-273583863 tempest-MultipleCreateNegativeTestJSON-273583863-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.023161 Oct 12 13:29:38.501677 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 843/1663] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:29:38 2022] POST /compute/v2.1/servers => generated 130 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:29:38.507117 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9efcc608-0a27-4530-af88-23e72bf7da00 tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Action: 'update', calling method: .version_select at 0x7f8a9b9283a0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:38.606203 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9efcc608-0a27-4530-af88-23e72bf7da00 tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:38.606889 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9efcc608-0a27-4530-af88-23e72bf7da00 tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:38.607502 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9efcc608-0a27-4530-af88-23e72bf7da00 tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:38.608371 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9efcc608-0a27-4530-af88-23e72bf7da00 tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:38.608993 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9efcc608-0a27-4530-af88-23e72bf7da00 tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:38.609580 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9efcc608-0a27-4530-af88-23e72bf7da00 tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:38.646312 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:29:38.718139 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-fce98769-d0cf-44bf-bbec-37c606c6f84e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:38.757731 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-fce98769-d0cf-44bf-bbec-37c606c6f84e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:38.759471 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-fce98769-d0cf-44bf-bbec-37c606c6f84e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:38.767168 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9efcc608-0a27-4530-af88-23e72bf7da00 tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/78b0c47228514cd898a3261636a8bd55" status: 200 len: 325 microversion: 2.1 time: 0.270264 Oct 12 13:29:38.773932 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fce98769-d0cf-44bf-bbec-37c606c6f84e tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1356 microversion: 2.47 time: 0.399064 Oct 12 13:29:38.806590 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 844/1664] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 12 13:29:38 2022] PUT /compute/v2.1/os-quota-sets/78b0c47228514cd898a3261636a8bd55 => generated 325 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:29:38.818633 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 821/1665] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:38 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1356 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:38.833050 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d0b574ab-2f52-4975-bdb8-4eac19dcd703 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:38.839439 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-81b51aa0-923c-4168-aae5-c6a79b4c0e6f tempest-MultipleCreateNegativeTestJSON-273583863 tempest-MultipleCreateNegativeTestJSON-273583863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-753289554", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "min_count": 2.5}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-81b51aa0-923c-4168-aae5-c6a79b4c0e6f tempest-MultipleCreateNegativeTestJSON-273583863 tempest-MultipleCreateNegativeTestJSON-273583863-project] Request method failure captured: Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 169 Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsE_2Y_jVlPjBW-6RFenWgP6XZFsNgHhhk97VJMH7Vq3CiylBbyiK_v23L_l4IsJDviZfGigN3HIeNzfGzgJIo-pDBcqjdDD0YYjfHp_5D1Mjm6Y6XCwhsMg7L6j4I5whtM7I3Ovq69G4EktlT7bAD_-93Dk-Ygg2KO7mel07MQcDyQ Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 39745c6ae93b4cb29faf6cdb9a334031 Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-273583863 Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/39745c6ae93b4cb29faf6cdb9a334031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_39745c6ae93b4cb29faf6cdb9a334031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/39745c6ae93b4cb29faf6cdb9a334031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/39745c6ae93b4cb29faf6cdb9a334031"}]}] Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-273583863 Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 39745c6ae93b4cb29faf6cdb9a334031 Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-273583863 Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-MultipleCreateNegativeTestJSON-273583863-project Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 4d69a1e620f24f459525f8e6436aa88e Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-273583863-project Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-753289554", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "min_count": 2.5}} Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-753289554', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'min_count': 2.5}}} Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise error Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi 2.5 Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 13:29:38.853081 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 13:29:38.856498 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 13:29:38.856498 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 13:29:38.856498 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 13:29:38.856498 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 13:29:38.856498 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 13:29:38.856498 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.856498 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:38.856498 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.856498 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:38.856498 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:38.856498 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:38.856498 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 13:29:38.856498 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 13:29:38.856498 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 13:29:38.856498 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:38.856498 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-81b51aa0-923c-4168-aae5-c6a79b4c0e6f tempest-MultipleCreateNegativeTestJSON-273583863 tempest-MultipleCreateNegativeTestJSON-273583863-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:38.856498 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-81b51aa0-923c-4168-aae5-c6a79b4c0e6f tempest-MultipleCreateNegativeTestJSON-273583863 tempest-MultipleCreateNegativeTestJSON-273583863-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.045448 Oct 12 13:29:38.856498 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 845/1666] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:29:38 2022] POST /compute/v2.1/servers => generated 139 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:29:38.874134 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d0b574ab-2f52-4975-bdb8-4eac19dcd703 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:38.879250 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d0b574ab-2f52-4975-bdb8-4eac19dcd703 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Searching by: {'deleted': False, 'project_id': '67eb4b79a11f440db02f09d62b478cc6'} {{(pid=120932) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 13:29:38.897822 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0b574ab-2f52-4975-bdb8-4eac19dcd703 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:38.898509 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0b574ab-2f52-4975-bdb8-4eac19dcd703 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:38.901069 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0b574ab-2f52-4975-bdb8-4eac19dcd703 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:38.902691 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0b574ab-2f52-4975-bdb8-4eac19dcd703 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:38.903369 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0b574ab-2f52-4975-bdb8-4eac19dcd703 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:38.906892 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0b574ab-2f52-4975-bdb8-4eac19dcd703 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:38.929816 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-23c95aae-94a8-4365-9b59-4b29d4be9a37 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1100511610", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:39.042669 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-23c95aae-94a8-4365-9b59-4b29d4be9a37 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] validate_networks() for None {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:29:39.234051 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.multi_cell_list [None req-d0b574ab-2f52-4975-bdb8-4eac19dcd703 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120932) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 13:29:39.365941 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=53 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:29:39.372080 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d0b574ab-2f52-4975-bdb8-4eac19dcd703 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:39.382531 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0b574ab-2f52-4975-bdb8-4eac19dcd703 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:39.383347 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0b574ab-2f52-4975-bdb8-4eac19dcd703 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:39.384679 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0b574ab-2f52-4975-bdb8-4eac19dcd703 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:39.405567 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d0b574ab-2f52-4975-bdb8-4eac19dcd703 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:39.409957 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d0b574ab-2f52-4975-bdb8-4eac19dcd703 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:39.611366 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d0b574ab-2f52-4975-bdb8-4eac19dcd703 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.790579 Oct 12 13:29:39.612350 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 822/1667] 10.222.0.52 () {60 vars in 1187 bytes} [Wed Oct 12 13:29:38 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:39.651792 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2c375a8f-de1a-4d55-80a5-ab6de9d80867 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:39.652298 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2c375a8f-de1a-4d55-80a5-ab6de9d80867 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:39.660516 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c375a8f-de1a-4d55-80a5-ab6de9d80867 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:39.668975 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c375a8f-de1a-4d55-80a5-ab6de9d80867 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:39.669973 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c375a8f-de1a-4d55-80a5-ab6de9d80867 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:39.670843 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c375a8f-de1a-4d55-80a5-ab6de9d80867 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:39.671504 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c375a8f-de1a-4d55-80a5-ab6de9d80867 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:39.671908 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c375a8f-de1a-4d55-80a5-ab6de9d80867 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:39.726841 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2c375a8f-de1a-4d55-80a5-ab6de9d80867 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:29:39.853205 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-23c95aae-94a8-4365-9b59-4b29d4be9a37 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:29:39.855431 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-23c95aae-94a8-4365-9b59-4b29d4be9a37 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:29:39.855431 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-23c95aae-94a8-4365-9b59-4b29d4be9a37 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:29:39.855431 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-23c95aae-94a8-4365-9b59-4b29d4be9a37 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:29:39.856138 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-23c95aae-94a8-4365-9b59-4b29d4be9a37 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:29:39.875952 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-23c95aae-94a8-4365-9b59-4b29d4be9a37 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:39.880954 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-23c95aae-94a8-4365-9b59-4b29d4be9a37 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:39.884045 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-23c95aae-94a8-4365-9b59-4b29d4be9a37 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:39.884045 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-23c95aae-94a8-4365-9b59-4b29d4be9a37 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:39.884045 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-23c95aae-94a8-4365-9b59-4b29d4be9a37 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:39.884045 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-23c95aae-94a8-4365-9b59-4b29d4be9a37 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:39.933653 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-23c95aae-94a8-4365-9b59-4b29d4be9a37 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Getting quotas for project 78b0c47228514cd898a3261636a8bd55. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:29:39.944034 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-23c95aae-94a8-4365-9b59-4b29d4be9a37 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Getting quotas for user 26e1b604e8b54d23b2e04a29b29665d8 and project 78b0c47228514cd898a3261636a8bd55. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:29:39.976882 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.utils [None req-23c95aae-94a8-4365-9b59-4b29d4be9a37 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] ram quota exceeded for 78b0c47228514cd898a3261636a8bd55, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120933) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 12 13:29:39.978860 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-23c95aae-94a8-4365-9b59-4b29d4be9a37 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-23c95aae-94a8-4365-9b59-4b29d4be9a37 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Request method failure captured: Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 145 Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsE5DvYfnoC8Q3hKoUJPz7XR90GZiohj5Ji31DUHOBxw03-DX8SbAJCHlYzUisuzX6kLAmn5UwhwV9fkbHXlEqgzUmIMXNYUX7trRskIQWQ7VLSRNxG8180aK7tPwNMyLjoeXTAgUbDBCnaDjUp6LwBLY1mLTCm6rlaW61X-TkBg4e8 Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 78b0c47228514cd898a3261636a8bd55 Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-QuotasAdminNegativeTest-1320456965 Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/78b0c47228514cd898a3261636a8bd55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_78b0c47228514cd898a3261636a8bd55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/78b0c47228514cd898a3261636a8bd55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/78b0c47228514cd898a3261636a8bd55"}]}] Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-QuotasAdminNegativeTest-1320456965 Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 78b0c47228514cd898a3261636a8bd55 Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1320456965 Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-QuotasAdminNegativeTest-1320456965-project Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 26e1b604e8b54d23b2e04a29b29665d8 Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-QuotasAdminNegativeTest-1320456965-project Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1100511610", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1100511610', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452'}}} Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:29:39.994167 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-23c95aae-94a8-4365-9b59-4b29d4be9a37 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-23c95aae-94a8-4365-9b59-4b29d4be9a37 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.066892 Oct 12 13:29:39.998600 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 846/1668] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:29:38 2022] POST /compute/v2.1/servers => generated 110 bytes in 1070 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 12 13:29:40.020480 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-17ab8930-7863-4e00-affc-1bc033360e9d tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Action: 'update', calling method: .version_select at 0x7f8a9b9d3160>, body: {"quota_set": {"ram": 51200}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:40.143096 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2c375a8f-de1a-4d55-80a5-ab6de9d80867 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "DELETE /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 204 len: 0 microversion: 2.47 time: 0.494998 Oct 12 13:29:40.144533 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 823/1669] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 12 13:29:39 2022] DELETE /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 13:29:40.153378 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7e97b879-724c-4d77-807c-d7a9da300d82 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:40.154091 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7e97b879-724c-4d77-807c-d7a9da300d82 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:40.170528 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e97b879-724c-4d77-807c-d7a9da300d82 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:40.171019 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e97b879-724c-4d77-807c-d7a9da300d82 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:40.171459 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e97b879-724c-4d77-807c-d7a9da300d82 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:40.172170 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e97b879-724c-4d77-807c-d7a9da300d82 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:40.172622 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e97b879-724c-4d77-807c-d7a9da300d82 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:40.173078 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e97b879-724c-4d77-807c-d7a9da300d82 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:40.351465 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-7e97b879-724c-4d77-807c-d7a9da300d82 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:40.360150 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-7e97b879-724c-4d77-807c-d7a9da300d82 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:40.366837 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-7e97b879-724c-4d77-807c-d7a9da300d82 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:40.376056 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7e97b879-724c-4d77-807c-d7a9da300d82 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1362 microversion: 2.47 time: 0.219512 Oct 12 13:29:40.376056 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 824/1670] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:40 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:29:40.412101 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-17ab8930-7863-4e00-affc-1bc033360e9d tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:40.412877 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-17ab8930-7863-4e00-affc-1bc033360e9d tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:40.413718 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-17ab8930-7863-4e00-affc-1bc033360e9d tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:40.414690 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-17ab8930-7863-4e00-affc-1bc033360e9d tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:40.415311 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-17ab8930-7863-4e00-affc-1bc033360e9d tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:40.415897 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-17ab8930-7863-4e00-affc-1bc033360e9d tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:40.602182 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-17ab8930-7863-4e00-affc-1bc033360e9d tempest-QuotasAdminNegativeTest-1601553680 tempest-QuotasAdminNegativeTest-1601553680-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/78b0c47228514cd898a3261636a8bd55" status: 200 len: 329 microversion: 2.1 time: 0.599413 Oct 12 13:29:40.602778 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 847/1671] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 12 13:29:40 2022] PUT /compute/v2.1/os-quota-sets/78b0c47228514cd898a3261636a8bd55 => generated 329 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:29:40.616713 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fd4965ce-9ac2-4939-851e-fc7732fb8f08 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Action: 'update', calling method: .version_select at 0x7f8aa029e040>, body: {"quota_set": {"ram": 0}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:40.624383 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-fd4965ce-9ac2-4939-851e-fc7732fb8f08 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '26e1b604e8b54d23b2e04a29b29665d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b0c47228514cd898a3261636a8bd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fd4965ce-9ac2-4939-851e-fc7732fb8f08 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Request method failure captured: Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: request: PUT /compute/v2.1/os-quota-sets/78b0c47228514cd898a3261636a8bd55 HTTP/1.1 Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 25 Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsE5DvYfnoC8Q3hKoUJPz7XR90GZiohj5Ji31DUHOBxw03-DX8SbAJCHlYzUisuzX6kLAmn5UwhwV9fkbHXlEqgzUmIMXNYUX7trRskIQWQ7VLSRNxG8180aK7tPwNMyLjoeXTAgUbDBCnaDjUp6LwBLY1mLTCm6rlaW61X-TkBg4e8 Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 78b0c47228514cd898a3261636a8bd55 Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-QuotasAdminNegativeTest-1320456965 Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/78b0c47228514cd898a3261636a8bd55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_78b0c47228514cd898a3261636a8bd55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/78b0c47228514cd898a3261636a8bd55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/78b0c47228514cd898a3261636a8bd55"}]}] Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-QuotasAdminNegativeTest-1320456965 Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 78b0c47228514cd898a3261636a8bd55 Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1320456965 Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-QuotasAdminNegativeTest-1320456965-project Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 26e1b604e8b54d23b2e04a29b29665d8 Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-QuotasAdminNegativeTest-1320456965-project Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: {"quota_set": {"ram": 0}} Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '78b0c47228514cd898a3261636a8bd55', 'body': {'quota_set': {'ram': 0}}} Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:29:40.633617 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:29:40.637096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:29:40.637096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:29:40.637096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:29:40.637096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:29:40.637096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:29:40.637096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 12 13:29:40.637096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:40.637096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:40.637096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:40.637096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:40.637096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:40.637096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:40.637096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:29:40.637096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:29:40.637096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 12 13:29:40.637096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:40.639009 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fd4965ce-9ac2-4939-851e-fc7732fb8f08 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:40.640030 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fd4965ce-9ac2-4939-851e-fc7732fb8f08 tempest-QuotasAdminNegativeTest-1320456965 tempest-QuotasAdminNegativeTest-1320456965-project] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/78b0c47228514cd898a3261636a8bd55" status: 403 len: 116 microversion: 2.1 time: 0.027329 Oct 12 13:29:40.641298 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 825/1672] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 12 13:29:40 2022] PUT /compute/v2.1/os-quota-sets/78b0c47228514cd898a3261636a8bd55 => generated 116 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:29:41.051057 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-30a6fb22-958f-4ea9-a0de-eb7f3cfe51d6 tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1769566307", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc8ada29-6985-4172-9880-e15344e4c066"}], "security_groups": [{"name": "tempest-securitygroup--1017211174"}], "key_name": "tempest-keypair-313321026", "user_data": "}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:41.398977 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fa192121-a4e2-4667-91a1-a1c227184c9d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:41.399662 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fa192121-a4e2-4667-91a1-a1c227184c9d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:41.407206 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa192121-a4e2-4667-91a1-a1c227184c9d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:41.407769 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa192121-a4e2-4667-91a1-a1c227184c9d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:41.408208 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa192121-a4e2-4667-91a1-a1c227184c9d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:41.409718 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa192121-a4e2-4667-91a1-a1c227184c9d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:41.410250 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa192121-a4e2-4667-91a1-a1c227184c9d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:41.410768 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa192121-a4e2-4667-91a1-a1c227184c9d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:41.844085 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-30a6fb22-958f-4ea9-a0de-eb7f3cfe51d6 tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] validate_networks() for [('dc8ada29-6985-4172-9880-e15344e4c066', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:29:41.844262 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-fa192121-a4e2-4667-91a1-a1c227184c9d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:41.859226 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-fa192121-a4e2-4667-91a1-a1c227184c9d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:41.864239 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-fa192121-a4e2-4667-91a1-a1c227184c9d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:41.864382 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fa192121-a4e2-4667-91a1-a1c227184c9d tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1362 microversion: 2.47 time: 0.469784 Oct 12 13:29:41.870277 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 826/1673] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:41 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1362 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-30a6fb22-958f-4ea9-a0de-eb7f3cfe51d6 tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-42415737-8440-4350-9b2f-a46a7fde3a49) Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:29:42.536426 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:29:42.539854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:29:42.539854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:29:42.539854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:29:42.539854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:29:42.539854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:29:42.539854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:29:42.539854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:29:42.539854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:29:42.539854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:29:42.539854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:29:42.539854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:29:42.539854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:29:42.539854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:29:42.539854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:29:42.539854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:29:42.539854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-42415737-8440-4350-9b2f-a46a7fde3a49) Oct 12 13:29:42.539854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:42.545806 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-30a6fb22-958f-4ea9-a0de-eb7f3cfe51d6 tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:42.545806 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-30a6fb22-958f-4ea9-a0de-eb7f3cfe51d6 tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Request method failure captured: Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 489 Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsEwOeu7ksivSH2Ia4uk6eiitfE2rxVwume2XDO9f67bgMuDMRLUEcJHLLqoLfJE3O3e2ccAdYEavhU8AsmWwxFHv3zDi0c3lfYHAeJ8N437irnufxIoITRe-KpBBkHx9kV4PQOmQrTirMyNhgycn8bLqIFbrJyUzVBhxRpJBrZxcNQ Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 81c9366135cf42f096ef6e0d748fa283 Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AttachVolumeNegativeTest-144784080 Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/81c9366135cf42f096ef6e0d748fa283"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_81c9366135cf42f096ef6e0d748fa283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/81c9366135cf42f096ef6e0d748fa283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/81c9366135cf42f096ef6e0d748fa283"}]}] Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AttachVolumeNegativeTest-144784080 Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 81c9366135cf42f096ef6e0d748fa283 Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-144784080 Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AttachVolumeNegativeTest-144784080-project Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 67f1b44834f84be9915554e881195cc2 Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AttachVolumeNegativeTest-144784080-project Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1769566307", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "dc8ada29-6985-4172-9880-e15344e4c066"}], "security_groups": [{"name": "tempest-securitygroup--1017211174"}], "key_name": "tempest-keypair-313321026", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeNegativeTest-server-1769566307', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': 'dc8ada29-6985-4172-9880-e15344e4c066'}], 'security_groups': [{'name': 'tempest-securitygroup--1017211174'}], 'key_name': 'tempest-keypair-313321026', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:29:42.548614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-42415737-8440-4350-9b2f-a46a7fde3a49) Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:42.552245 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:42.560785 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:42.560785 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:42.560785 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:42.560785 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:29:42.560785 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:29:42.560785 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:42.560785 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:42.560785 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:42.560785 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:42.560785 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:42.560785 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:42.560785 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:42.560785 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:42.560785 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:42.560785 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:42.560785 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:42.560785 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:42.560785 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:42.573031 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-30a6fb22-958f-4ea9-a0de-eb7f3cfe51d6 tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:42.573031 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:42.573031 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-30a6fb22-958f-4ea9-a0de-eb7f3cfe51d6 tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.527031 Oct 12 13:29:42.573031 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 848/1674] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:29:41 2022] POST /compute/v2.1/servers => generated 214 bytes in 1529 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:29:42.578107 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-dc47d28f-dd17-4653-a95d-2758a92c876b tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Calling method '.version_select at 0x7f8a9be539d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:42.683312 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-dc47d28f-dd17-4653-a95d-2758a92c876b tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-313321026" status: 202 len: 0 microversion: 2.1 time: 0.108942 Oct 12 13:29:42.687812 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 827/1675] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Oct 12 13:29:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-313321026 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:29:42.899470 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4f94bd0c-bc33-42bb-97a5-b48e7e7d09f3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:42.900173 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-4f94bd0c-bc33-42bb-97a5-b48e7e7d09f3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:42.931996 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4f94bd0c-bc33-42bb-97a5-b48e7e7d09f3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:42.937028 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4f94bd0c-bc33-42bb-97a5-b48e7e7d09f3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:42.937629 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4f94bd0c-bc33-42bb-97a5-b48e7e7d09f3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:42.942644 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4f94bd0c-bc33-42bb-97a5-b48e7e7d09f3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:42.942644 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4f94bd0c-bc33-42bb-97a5-b48e7e7d09f3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:42.942644 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4f94bd0c-bc33-42bb-97a5-b48e7e7d09f3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:43.025923 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4f94bd0c-bc33-42bb-97a5-b48e7e7d09f3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:43.025923 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4f94bd0c-bc33-42bb-97a5-b48e7e7d09f3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:43.025923 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4f94bd0c-bc33-42bb-97a5-b48e7e7d09f3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:43.025923 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-4f94bd0c-bc33-42bb-97a5-b48e7e7d09f3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lazy-loading 'fault' on Instance uuid 50b6d503-5a66-4b31-bbef-4813547f72ad {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:29:43.526303 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-4f94bd0c-bc33-42bb-97a5-b48e7e7d09f3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:43.546651 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-4f94bd0c-bc33-42bb-97a5-b48e7e7d09f3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:43.560949 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-4f94bd0c-bc33-42bb-97a5-b48e7e7d09f3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:43.562448 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4f94bd0c-bc33-42bb-97a5-b48e7e7d09f3 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 200 len: 1367 microversion: 2.47 time: 0.667886 Oct 12 13:29:43.570505 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 849/1676] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:42 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 1367 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:44.598292 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ebc470bc-fd9e-450d-859b-e380ad046cf6 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:44.599742 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ebc470bc-fd9e-450d-859b-e380ad046cf6 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 50b6d503-5a66-4b31-bbef-4813547f72ad] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:44.613693 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ebc470bc-fd9e-450d-859b-e380ad046cf6 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:44.617558 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ebc470bc-fd9e-450d-859b-e380ad046cf6 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:44.618287 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ebc470bc-fd9e-450d-859b-e380ad046cf6 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:44.619468 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ebc470bc-fd9e-450d-859b-e380ad046cf6 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:44.620134 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ebc470bc-fd9e-450d-859b-e380ad046cf6 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:44.625491 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ebc470bc-fd9e-450d-859b-e380ad046cf6 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:44.652153 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-ebc470bc-fd9e-450d-859b-e380ad046cf6 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] HTTP exception thrown: Instance 50b6d503-5a66-4b31-bbef-4813547f72ad could not be found. Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ebc470bc-fd9e-450d-859b-e380ad046cf6 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Request method failure captured: Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad HTTP/1.1 Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsEVrXgqe6jhrEJ2U-GIGeffHYtpwDCoBznqTY_nGTAtgfURBn8XOMTJo-nKSR-iWTR2dtGmR_NLff-8blFW6jSDxIfC2WbyUhO1VCD86QR546HZn_Uxj56pbAEwCWkchh0DfqJPamEE4yCinPjGfDPfqUt2Jg9MlfhX_EwVl-WZJx8 Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: X-Openstack-Nova-Api-Version: 2.47 Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 67eb4b79a11f440db02f09d62b478cc6 Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServerShowV247Test-2089277574 Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/67eb4b79a11f440db02f09d62b478cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_67eb4b79a11f440db02f09d62b478cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/67eb4b79a11f440db02f09d62b478cc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/67eb4b79a11f440db02f09d62b478cc6"}]}] Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServerShowV247Test-2089277574 Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 67eb4b79a11f440db02f09d62b478cc6 Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServerShowV247Test-2089277574 Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServerShowV247Test-2089277574-project Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: ea94127c4bb043f9b9b7fbf6de00584c Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServerShowV247Test-2089277574-project Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance 50b6d503-5a66-4b31-bbef-4813547f72ad could not be found. Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '50b6d503-5a66-4b31-bbef-4813547f72ad'} Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50b6d503-5a66-4b31-bbef-4813547f72ad could not be found. Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50b6d503-5a66-4b31-bbef-4813547f72ad could not be found. Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:44.658684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:44.662953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:44.662953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:44.662953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:44.662953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:44.662953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:44.662953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50b6d503-5a66-4b31-bbef-4813547f72ad could not be found. Oct 12 13:29:44.662953 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:44.665839 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ebc470bc-fd9e-450d-859b-e380ad046cf6 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Returning 404 to user: Instance 50b6d503-5a66-4b31-bbef-4813547f72ad could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:44.673919 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ebc470bc-fd9e-450d-859b-e380ad046cf6 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad" status: 404 len: 111 microversion: 2.47 time: 0.080754 Oct 12 13:29:44.677087 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 828/1677] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:44 2022] GET /compute/v2.1/servers/50b6d503-5a66-4b31-bbef-4813547f72ad => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:29:44.686027 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-831ae125-2e1f-4ace-9917-f36fe3256292 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:44.687159 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-831ae125-2e1f-4ace-9917-f36fe3256292 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 62558ce2-7abd-4687-8887-14d341462e99] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:44.696819 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-831ae125-2e1f-4ace-9917-f36fe3256292 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:44.699403 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-831ae125-2e1f-4ace-9917-f36fe3256292 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:44.700065 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-831ae125-2e1f-4ace-9917-f36fe3256292 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:44.702430 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-831ae125-2e1f-4ace-9917-f36fe3256292 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:44.704207 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-831ae125-2e1f-4ace-9917-f36fe3256292 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:44.706995 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-831ae125-2e1f-4ace-9917-f36fe3256292 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:44.809156 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-831ae125-2e1f-4ace-9917-f36fe3256292 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 62558ce2-7abd-4687-8887-14d341462e99] Going to try to terminate instance {{(pid=120933) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:29:45.273150 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-831ae125-2e1f-4ace-9917-f36fe3256292 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "DELETE /compute/v2.1/servers/62558ce2-7abd-4687-8887-14d341462e99" status: 204 len: 0 microversion: 2.47 time: 0.590382 Oct 12 13:29:45.274558 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 850/1678] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 12 13:29:44 2022] DELETE /compute/v2.1/servers/62558ce2-7abd-4687-8887-14d341462e99 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 12 13:29:45.284272 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4fd446aa-f7f8-459a-94eb-c8e3e13ce9bb tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:45.285560 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-4fd446aa-f7f8-459a-94eb-c8e3e13ce9bb tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 62558ce2-7abd-4687-8887-14d341462e99] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:45.300315 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fd446aa-f7f8-459a-94eb-c8e3e13ce9bb tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:45.304374 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fd446aa-f7f8-459a-94eb-c8e3e13ce9bb tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:45.314753 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fd446aa-f7f8-459a-94eb-c8e3e13ce9bb tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:45.314753 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fd446aa-f7f8-459a-94eb-c8e3e13ce9bb tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:45.323844 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fd446aa-f7f8-459a-94eb-c8e3e13ce9bb tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:45.324777 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fd446aa-f7f8-459a-94eb-c8e3e13ce9bb tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:45.575961 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-4fd446aa-f7f8-459a-94eb-c8e3e13ce9bb tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:45.596048 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-4fd446aa-f7f8-459a-94eb-c8e3e13ce9bb tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:45.600757 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-4fd446aa-f7f8-459a-94eb-c8e3e13ce9bb tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:45.616933 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4fd446aa-f7f8-459a-94eb-c8e3e13ce9bb tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/62558ce2-7abd-4687-8887-14d341462e99" status: 200 len: 1362 microversion: 2.47 time: 0.327650 Oct 12 13:29:45.618220 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 829/1679] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:45 2022] GET /compute/v2.1/servers/62558ce2-7abd-4687-8887-14d341462e99 => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:45.926866 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f504a68f-3a50-4095-b015-42c023cc1c07 tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Action: 'create', calling method: .version_select at 0x7f8a9b928d30>, body: {"keypair": {"name": "tempest-keypair-63207398", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKExvC+jAOTILIEwSgZnIbw0tuZMLGP9PpG8O0b5UAF+F1eymGwz72pUcS1aQD36v+K65vrU5z87L2XfAoH/uSfvhQ/Y6yThWavcIWXhjh4Ttjm7AJLJp4kValoX/yokTQ=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:45.989739 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-f504a68f-3a50-4095-b015-42c023cc1c07 tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Getting quotas for project 81c9366135cf42f096ef6e0d748fa283. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:29:46.016646 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-f504a68f-3a50-4095-b015-42c023cc1c07 tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Getting quotas for user 67f1b44834f84be9915554e881195cc2 and project 81c9366135cf42f096ef6e0d748fa283. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:29:46.122959 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f504a68f-3a50-4095-b015-42c023cc1c07 tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.200949 Oct 12 13:29:46.124036 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 851/1680] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:29:45 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:29:46.647610 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bebf12d2-1bc5-4230-aebf-ce87109047d7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:46.648429 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-bebf12d2-1bc5-4230-aebf-ce87109047d7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 62558ce2-7abd-4687-8887-14d341462e99] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:46.666127 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bebf12d2-1bc5-4230-aebf-ce87109047d7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:46.680197 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bebf12d2-1bc5-4230-aebf-ce87109047d7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:46.680197 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bebf12d2-1bc5-4230-aebf-ce87109047d7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:46.680197 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bebf12d2-1bc5-4230-aebf-ce87109047d7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:46.680197 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bebf12d2-1bc5-4230-aebf-ce87109047d7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:46.680197 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bebf12d2-1bc5-4230-aebf-ce87109047d7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:47.031885 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-bebf12d2-1bc5-4230-aebf-ce87109047d7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:47.051189 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-bebf12d2-1bc5-4230-aebf-ce87109047d7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:47.057819 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-bebf12d2-1bc5-4230-aebf-ce87109047d7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:47.065071 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bebf12d2-1bc5-4230-aebf-ce87109047d7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/62558ce2-7abd-4687-8887-14d341462e99" status: 200 len: 1362 microversion: 2.47 time: 0.421922 Oct 12 13:29:47.068804 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 830/1681] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:46 2022] GET /compute/v2.1/servers/62558ce2-7abd-4687-8887-14d341462e99 => generated 1362 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:48.102495 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a0cb784e-eba9-4b5a-8ac0-61a004c8b214 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:48.105432 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a0cb784e-eba9-4b5a-8ac0-61a004c8b214 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 62558ce2-7abd-4687-8887-14d341462e99] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:48.118845 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a0cb784e-eba9-4b5a-8ac0-61a004c8b214 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:48.121101 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a0cb784e-eba9-4b5a-8ac0-61a004c8b214 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:48.121837 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a0cb784e-eba9-4b5a-8ac0-61a004c8b214 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:48.124003 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a0cb784e-eba9-4b5a-8ac0-61a004c8b214 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:48.127306 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a0cb784e-eba9-4b5a-8ac0-61a004c8b214 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:48.131275 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a0cb784e-eba9-4b5a-8ac0-61a004c8b214 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:48.458987 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a0cb784e-eba9-4b5a-8ac0-61a004c8b214 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:48.463168 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a0cb784e-eba9-4b5a-8ac0-61a004c8b214 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:48.473007 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a0cb784e-eba9-4b5a-8ac0-61a004c8b214 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea94127c4bb043f9b9b7fbf6de00584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67eb4b79a11f440db02f09d62b478cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:48.482753 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a0cb784e-eba9-4b5a-8ac0-61a004c8b214 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/62558ce2-7abd-4687-8887-14d341462e99" status: 200 len: 1362 microversion: 2.47 time: 0.390195 Oct 12 13:29:48.484224 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 852/1682] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:48 2022] GET /compute/v2.1/servers/62558ce2-7abd-4687-8887-14d341462e99 => generated 1362 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:49.510058 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5584caa1-9fd0-42b0-8f4f-d5a6f8f004c7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:49.510915 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5584caa1-9fd0-42b0-8f4f-d5a6f8f004c7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] [instance: 62558ce2-7abd-4687-8887-14d341462e99] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:49.524497 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=8 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:29:49.526939 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5584caa1-9fd0-42b0-8f4f-d5a6f8f004c7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:49.527498 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5584caa1-9fd0-42b0-8f4f-d5a6f8f004c7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:49.530101 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5584caa1-9fd0-42b0-8f4f-d5a6f8f004c7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:49.530101 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5584caa1-9fd0-42b0-8f4f-d5a6f8f004c7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:49.530101 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5584caa1-9fd0-42b0-8f4f-d5a6f8f004c7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:49.530101 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5584caa1-9fd0-42b0-8f4f-d5a6f8f004c7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:49.565127 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-5584caa1-9fd0-42b0-8f4f-d5a6f8f004c7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] HTTP exception thrown: Instance 62558ce2-7abd-4687-8887-14d341462e99 could not be found. Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5584caa1-9fd0-42b0-8f4f-d5a6f8f004c7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Request method failure captured: Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/62558ce2-7abd-4687-8887-14d341462e99 HTTP/1.1 Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsEVrXgqe6jhrEJ2U-GIGeffHYtpwDCoBznqTY_nGTAtgfURBn8XOMTJo-nKSR-iWTR2dtGmR_NLff-8blFW6jSDxIfC2WbyUhO1VCD86QR546HZn_Uxj56pbAEwCWkchh0DfqJPamEE4yCinPjGfDPfqUt2Jg9MlfhX_EwVl-WZJx8 Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: X-Openstack-Nova-Api-Version: 2.47 Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 67eb4b79a11f440db02f09d62b478cc6 Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServerShowV247Test-2089277574 Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/67eb4b79a11f440db02f09d62b478cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_67eb4b79a11f440db02f09d62b478cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/67eb4b79a11f440db02f09d62b478cc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/67eb4b79a11f440db02f09d62b478cc6"}]}] Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServerShowV247Test-2089277574 Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 67eb4b79a11f440db02f09d62b478cc6 Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServerShowV247Test-2089277574 Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServerShowV247Test-2089277574-project Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: ea94127c4bb043f9b9b7fbf6de00584c Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServerShowV247Test-2089277574-project Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance 62558ce2-7abd-4687-8887-14d341462e99 could not be found. Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '62558ce2-7abd-4687-8887-14d341462e99'} Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62558ce2-7abd-4687-8887-14d341462e99 could not be found. Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62558ce2-7abd-4687-8887-14d341462e99 could not be found. Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:49.568470 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:49.572061 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:49.572061 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:49.572061 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:49.572061 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:49.572061 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:49.572061 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62558ce2-7abd-4687-8887-14d341462e99 could not be found. Oct 12 13:29:49.572061 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:49.575586 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5584caa1-9fd0-42b0-8f4f-d5a6f8f004c7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] Returning 404 to user: Instance 62558ce2-7abd-4687-8887-14d341462e99 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:49.577081 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5584caa1-9fd0-42b0-8f4f-d5a6f8f004c7 tempest-ServerShowV247Test-2089277574 tempest-ServerShowV247Test-2089277574-project] 10.222.0.52 "GET /compute/v2.1/servers/62558ce2-7abd-4687-8887-14d341462e99" status: 404 len: 111 microversion: 2.47 time: 0.070487 Oct 12 13:29:49.578272 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 831/1683] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:49 2022] GET /compute/v2.1/servers/62558ce2-7abd-4687-8887-14d341462e99 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:29:51.612075 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=14 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:29:52.018532 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-eba59222-7155-4e57-bd42-1f80aaeb0d3b tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Action: 'update', calling method: .version_select at 0x7f8a9b9fd820>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:52.025885 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-eba59222-7155-4e57-bd42-1f80aaeb0d3b tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:52.031615 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-eba59222-7155-4e57-bd42-1f80aaeb0d3b tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:52.033342 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-eba59222-7155-4e57-bd42-1f80aaeb0d3b tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:52.063112 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-eba59222-7155-4e57-bd42-1f80aaeb0d3b tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:52.063986 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-eba59222-7155-4e57-bd42-1f80aaeb0d3b tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:52.064602 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-eba59222-7155-4e57-bd42-1f80aaeb0d3b tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:52.076409 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-eba59222-7155-4e57-bd42-1f80aaeb0d3b tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] HTTP exception thrown: Service 5fe6821e-f758-439e-8af1-3266fc3e4581 could not be found. Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-eba59222-7155-4e57-bd42-1f80aaeb0d3b tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Request method failure captured: Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: request: PUT /compute/v2.1/os-services/5fe6821e-f758-439e-8af1-3266fc3e4581 HTTP/1.1 Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 56 Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsFPLY0U5bFDD9-lPC3NDY8sQrVQfGVKFXm6AAjQiaIODr9hKpOoyeMRHCYRzEUygbio5X5mlWY3dvCteYqQHNiRaerK8a0uWbwrI6SS-O8DLK6Gcp7y-kEBTs3UEkaF9LcZEEllFg5BAdLyo0l10uqh7U_fFon8HYsP1S5ToFeLid4 Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: X-Openstack-Nova-Api-Version: 2.53 Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 8fe62e994a5d444d90f34c19065cbe88 Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2060001125 Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8fe62e994a5d444d90f34c19065cbe88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8fe62e994a5d444d90f34c19065cbe88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8fe62e994a5d444d90f34c19065cbe88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8fe62e994a5d444d90f34c19065cbe88"}]}] Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2060001125 Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 8fe62e994a5d444d90f34c19065cbe88 Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2060001125 Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: e839d00eed80428ba54393bd207d8596 Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: exception: Service 5fe6821e-f758-439e-8af1-3266fc3e4581 could not be found. Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '5fe6821e-f758-439e-8af1-3266fc3e4581', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 5fe6821e-f758-439e-8af1-3266fc3e4581 could not be found. Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:52.080072 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:52.084634 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 12 13:29:52.084634 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:29:52.084634 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 5fe6821e-f758-439e-8af1-3266fc3e4581 could not be found. Oct 12 13:29:52.084634 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:52.084634 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:52.084634 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:52.084634 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:52.084634 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:52.084634 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:52.084634 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:52.084634 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:52.084634 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 5fe6821e-f758-439e-8af1-3266fc3e4581 could not be found. Oct 12 13:29:52.084634 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:52.087030 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-eba59222-7155-4e57-bd42-1f80aaeb0d3b tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Returning 404 to user: Service 5fe6821e-f758-439e-8af1-3266fc3e4581 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:52.088068 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-eba59222-7155-4e57-bd42-1f80aaeb0d3b tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-services/5fe6821e-f758-439e-8af1-3266fc3e4581" status: 404 len: 110 microversion: 2.53 time: 0.481503 Oct 12 13:29:52.091291 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 853/1684] 10.222.0.52 () {62 vars in 1309 bytes} [Wed Oct 12 13:29:51 2022] PUT /compute/v2.1/os-services/5fe6821e-f758-439e-8af1-3266fc3e4581 => generated 110 bytes in 485 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:29:52.101206 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-874f603d-81d3-4acc-b484-4f3d44b69533 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Action: 'update', calling method: .version_select at 0x7f8a9be53310>, body: {"status": "disabled"} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:52.104859 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-874f603d-81d3-4acc-b484-4f3d44b69533 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:52.108930 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-874f603d-81d3-4acc-b484-4f3d44b69533 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:52.109583 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-874f603d-81d3-4acc-b484-4f3d44b69533 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:52.131645 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:29:52.138680 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-874f603d-81d3-4acc-b484-4f3d44b69533 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:52.139375 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-874f603d-81d3-4acc-b484-4f3d44b69533 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:52.139966 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-874f603d-81d3-4acc-b484-4f3d44b69533 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:52.158654 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-874f603d-81d3-4acc-b484-4f3d44b69533 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] HTTP exception thrown: Service 5fe6821e-f758-439e-8af1-3266fc3e4581 could not be found. Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-874f603d-81d3-4acc-b484-4f3d44b69533 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Request method failure captured: Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: request: PUT /compute/v2.1/os-services/5fe6821e-f758-439e-8af1-3266fc3e4581 HTTP/1.1 Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 22 Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsFPLY0U5bFDD9-lPC3NDY8sQrVQfGVKFXm6AAjQiaIODr9hKpOoyeMRHCYRzEUygbio5X5mlWY3dvCteYqQHNiRaerK8a0uWbwrI6SS-O8DLK6Gcp7y-kEBTs3UEkaF9LcZEEllFg5BAdLyo0l10uqh7U_fFon8HYsP1S5ToFeLid4 Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: X-Openstack-Nova-Api-Version: 2.53 Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 8fe62e994a5d444d90f34c19065cbe88 Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2060001125 Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,admin,reader Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,admin,reader Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8fe62e994a5d444d90f34c19065cbe88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8fe62e994a5d444d90f34c19065cbe88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8fe62e994a5d444d90f34c19065cbe88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8fe62e994a5d444d90f34c19065cbe88"}]}] Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2060001125 Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 8fe62e994a5d444d90f34c19065cbe88 Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2060001125 Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: e839d00eed80428ba54393bd207d8596 Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: {"status": "disabled"} Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: exception: Service 5fe6821e-f758-439e-8af1-3266fc3e4581 could not be found. Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '5fe6821e-f758-439e-8af1-3266fc3e4581', 'body': {'status': 'disabled'}} Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 5fe6821e-f758-439e-8af1-3266fc3e4581 could not be found. Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:52.163984 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:52.168292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 12 13:29:52.168292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:29:52.168292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 5fe6821e-f758-439e-8af1-3266fc3e4581 could not be found. Oct 12 13:29:52.168292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:52.168292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:52.168292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:52.168292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:52.168292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:52.168292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:52.168292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:52.168292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:52.168292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 5fe6821e-f758-439e-8af1-3266fc3e4581 could not be found. Oct 12 13:29:52.168292 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:52.171268 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-874f603d-81d3-4acc-b484-4f3d44b69533 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Returning 404 to user: Service 5fe6821e-f758-439e-8af1-3266fc3e4581 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:52.172148 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-874f603d-81d3-4acc-b484-4f3d44b69533 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-services/5fe6821e-f758-439e-8af1-3266fc3e4581" status: 404 len: 110 microversion: 2.53 time: 0.075210 Oct 12 13:29:52.172757 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 832/1685] 10.222.0.52 () {62 vars in 1309 bytes} [Wed Oct 12 13:29:52 2022] PUT /compute/v2.1/os-services/5fe6821e-f758-439e-8af1-3266fc3e4581 => generated 110 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:29:52.184027 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b7a6989d-f854-43fb-8e5a-5c9e8dfc0848 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Action: 'update', calling method: .version_select at 0x7f8a9b9fd940>, body: {"status": "enabled"} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:52.189300 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b7a6989d-f854-43fb-8e5a-5c9e8dfc0848 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:52.192990 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b7a6989d-f854-43fb-8e5a-5c9e8dfc0848 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:52.199826 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b7a6989d-f854-43fb-8e5a-5c9e8dfc0848 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:52.218571 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b7a6989d-f854-43fb-8e5a-5c9e8dfc0848 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:52.221830 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b7a6989d-f854-43fb-8e5a-5c9e8dfc0848 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:52.222509 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b7a6989d-f854-43fb-8e5a-5c9e8dfc0848 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:52.253568 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-b7a6989d-f854-43fb-8e5a-5c9e8dfc0848 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] HTTP exception thrown: Service 5fe6821e-f758-439e-8af1-3266fc3e4581 could not be found. Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b7a6989d-f854-43fb-8e5a-5c9e8dfc0848 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Request method failure captured: Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: request: PUT /compute/v2.1/os-services/5fe6821e-f758-439e-8af1-3266fc3e4581 HTTP/1.1 Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 21 Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsFPLY0U5bFDD9-lPC3NDY8sQrVQfGVKFXm6AAjQiaIODr9hKpOoyeMRHCYRzEUygbio5X5mlWY3dvCteYqQHNiRaerK8a0uWbwrI6SS-O8DLK6Gcp7y-kEBTs3UEkaF9LcZEEllFg5BAdLyo0l10uqh7U_fFon8HYsP1S5ToFeLid4 Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: X-Openstack-Nova-Api-Version: 2.53 Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 8fe62e994a5d444d90f34c19065cbe88 Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2060001125 Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8fe62e994a5d444d90f34c19065cbe88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8fe62e994a5d444d90f34c19065cbe88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8fe62e994a5d444d90f34c19065cbe88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8fe62e994a5d444d90f34c19065cbe88"}]}] Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2060001125 Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 8fe62e994a5d444d90f34c19065cbe88 Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2060001125 Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: e839d00eed80428ba54393bd207d8596 Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: {"status": "enabled"} Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: exception: Service 5fe6821e-f758-439e-8af1-3266fc3e4581 could not be found. Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '5fe6821e-f758-439e-8af1-3266fc3e4581', 'body': {'status': 'enabled'}} Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 5fe6821e-f758-439e-8af1-3266fc3e4581 could not be found. Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:52.258560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:52.262716 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 12 13:29:52.262716 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:29:52.262716 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 5fe6821e-f758-439e-8af1-3266fc3e4581 could not be found. Oct 12 13:29:52.262716 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:52.262716 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:52.262716 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:52.262716 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:52.262716 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:52.262716 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:52.262716 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:52.262716 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:52.262716 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 5fe6821e-f758-439e-8af1-3266fc3e4581 could not be found. Oct 12 13:29:52.262716 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:52.266492 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b7a6989d-f854-43fb-8e5a-5c9e8dfc0848 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Returning 404 to user: Service 5fe6821e-f758-439e-8af1-3266fc3e4581 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:52.267397 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b7a6989d-f854-43fb-8e5a-5c9e8dfc0848 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-services/5fe6821e-f758-439e-8af1-3266fc3e4581" status: 404 len: 110 microversion: 2.53 time: 0.088156 Oct 12 13:29:52.267999 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 854/1686] 10.222.0.52 () {62 vars in 1309 bytes} [Wed Oct 12 13:29:52 2022] PUT /compute/v2.1/os-services/5fe6821e-f758-439e-8af1-3266fc3e4581 => generated 110 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:29:52.278012 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-62d590dc-cb3c-4581-9309-6028977ca374 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:52.281724 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62d590dc-cb3c-4581-9309-6028977ca374 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:52.282211 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62d590dc-cb3c-4581-9309-6028977ca374 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:52.284250 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62d590dc-cb3c-4581-9309-6028977ca374 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:52.285064 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62d590dc-cb3c-4581-9309-6028977ca374 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:52.285526 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62d590dc-cb3c-4581-9309-6028977ca374 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:52.285994 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62d590dc-cb3c-4581-9309-6028977ca374 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:52.358460 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-62d590dc-cb3c-4581-9309-6028977ca374 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.084605 Oct 12 13:29:52.359083 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 833/1687] 10.222.0.52 () {60 vars in 1178 bytes} [Wed Oct 12 13:29:52 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:52.374998 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5cf97554-c5c5-40a4-bda4-6ed80d532db8 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:52.383756 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5cf97554-c5c5-40a4-bda4-6ed80d532db8 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:52.384779 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5cf97554-c5c5-40a4-bda4-6ed80d532db8 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:52.385638 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5cf97554-c5c5-40a4-bda4-6ed80d532db8 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:52.387156 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5cf97554-c5c5-40a4-bda4-6ed80d532db8 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:52.387834 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5cf97554-c5c5-40a4-bda4-6ed80d532db8 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:52.388498 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5cf97554-c5c5-40a4-bda4-6ed80d532db8 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:52.432237 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5cf97554-c5c5-40a4-bda4-6ed80d532db8 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.062943 Oct 12 13:29:52.437035 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 855/1688] 10.222.0.52 () {60 vars in 1211 bytes} [Wed Oct 12 13:29:52 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:52.450774 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d6321d52-472d-4ff0-b392-dfd2e6dc47d2 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:52.456017 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6321d52-472d-4ff0-b392-dfd2e6dc47d2 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:52.456879 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6321d52-472d-4ff0-b392-dfd2e6dc47d2 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:52.457745 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6321d52-472d-4ff0-b392-dfd2e6dc47d2 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:52.458894 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6321d52-472d-4ff0-b392-dfd2e6dc47d2 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:52.459681 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6321d52-472d-4ff0-b392-dfd2e6dc47d2 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:52.460345 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6321d52-472d-4ff0-b392-dfd2e6dc47d2 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:52.517914 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d6321d52-472d-4ff0-b392-dfd2e6dc47d2 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.072496 Oct 12 13:29:52.519132 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 834/1689] 10.222.0.52 () {60 vars in 1178 bytes} [Wed Oct 12 13:29:52 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:52.537097 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-16634147-d050-4804-901f-f0aee59ea018 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:52.545850 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-16634147-d050-4804-901f-f0aee59ea018 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:52.548355 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-16634147-d050-4804-901f-f0aee59ea018 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:52.549110 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-16634147-d050-4804-901f-f0aee59ea018 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:52.550726 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-16634147-d050-4804-901f-f0aee59ea018 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:52.551403 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-16634147-d050-4804-901f-f0aee59ea018 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:52.552377 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-16634147-d050-4804-901f-f0aee59ea018 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:52.625911 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-16634147-d050-4804-901f-f0aee59ea018 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=n-d-861076-2&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.098127 Oct 12 13:29:52.629565 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 856/1690] 10.222.0.52 () {60 vars in 1235 bytes} [Wed Oct 12 13:29:52 2022] GET /compute/v2.1/os-services?host=n-d-861076-2&binary=xxx => generated 16 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:29:52.643327 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7f8d2315-2f8d-4c3d-925d-73b286fe82ac tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:52.652161 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f8d2315-2f8d-4c3d-925d-73b286fe82ac tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:52.653315 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f8d2315-2f8d-4c3d-925d-73b286fe82ac tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:52.653805 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f8d2315-2f8d-4c3d-925d-73b286fe82ac tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:52.656434 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f8d2315-2f8d-4c3d-925d-73b286fe82ac tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:52.658952 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f8d2315-2f8d-4c3d-925d-73b286fe82ac tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:52.662054 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7f8d2315-2f8d-4c3d-925d-73b286fe82ac tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:52.736963 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7f8d2315-2f8d-4c3d-925d-73b286fe82ac tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.094341 Oct 12 13:29:52.736963 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 835/1691] 10.222.0.52 () {60 vars in 1178 bytes} [Wed Oct 12 13:29:52 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:52.749083 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-34e50d01-e743-4c92-92a7-63bc85b66b04 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:52.764136 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-34e50d01-e743-4c92-92a7-63bc85b66b04 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:52.764867 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-34e50d01-e743-4c92-92a7-63bc85b66b04 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:52.765551 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-34e50d01-e743-4c92-92a7-63bc85b66b04 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:52.766604 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-34e50d01-e743-4c92-92a7-63bc85b66b04 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:52.767307 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-34e50d01-e743-4c92-92a7-63bc85b66b04 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:52.768007 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-34e50d01-e743-4c92-92a7-63bc85b66b04 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:52.832171 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-34e50d01-e743-4c92-92a7-63bc85b66b04 tempest-ServicesAdminNegativeV253TestJSON-2060001125 tempest-ServicesAdminNegativeV253TestJSON-2060001125-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.087639 Oct 12 13:29:52.835564 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 857/1692] 10.222.0.52 () {60 vars in 1239 bytes} [Wed Oct 12 13:29:52 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:29:53.087933 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-41ba7a79-9caa-4421-b8e9-5c2b471c6683 tempest-ServicesAdminNegativeV253TestJSON-608721755 tempest-ServicesAdminNegativeV253TestJSON-608721755-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:53.092061 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-41ba7a79-9caa-4421-b8e9-5c2b471c6683 tempest-ServicesAdminNegativeV253TestJSON-608721755 tempest-ServicesAdminNegativeV253TestJSON-608721755-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'dbe9f25ce0234ee882229f542cee79e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e7bbb1e3c143c7a94abad96fb6c752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-41ba7a79-9caa-4421-b8e9-5c2b471c6683 tempest-ServicesAdminNegativeV253TestJSON-608721755 tempest-ServicesAdminNegativeV253TestJSON-608721755-project] Request method failure captured: Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsFNWHozgtQKXsWaK-K1cW0stmRmiVJzcRxHmqRfopv5Xr85oWe5tq03l995HkXFXrHvLoTchtOmzxuO1PXUiM0RcQjRRr_qS4ZpV6H_3VBSpxXQaPxgTj6DfT6OtJ2UcBcFeyl88NXV1ANGv220-C_rLsen2n3W_SYtJTf03zsJQCU Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: X-Openstack-Nova-Api-Version: 2.53 Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 51e7bbb1e3c143c7a94abad96fb6c752 Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-608721755 Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/51e7bbb1e3c143c7a94abad96fb6c752"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_51e7bbb1e3c143c7a94abad96fb6c752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/51e7bbb1e3c143c7a94abad96fb6c752"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/51e7bbb1e3c143c7a94abad96fb6c752"}]}] Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-608721755 Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 51e7bbb1e3c143c7a94abad96fb6c752 Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-608721755 Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServicesAdminNegativeV253TestJSON-608721755-project Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: dbe9f25ce0234ee882229f542cee79e5 Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-608721755-project Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: action_args: {} Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 13:29:53.093729 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 13:29:53.097703 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:53.097703 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:53.097703 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:53.097703 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:53.097703 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:53.097703 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:53.097703 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 13:29:53.097703 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 13:29:53.097703 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 13:29:53.097703 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:53.099335 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-41ba7a79-9caa-4421-b8e9-5c2b471c6683 tempest-ServicesAdminNegativeV253TestJSON-608721755 tempest-ServicesAdminNegativeV253TestJSON-608721755-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:53.100494 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-41ba7a79-9caa-4421-b8e9-5c2b471c6683 tempest-ServicesAdminNegativeV253TestJSON-608721755 tempest-ServicesAdminNegativeV253TestJSON-608721755-project] 10.222.0.52 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.256939 Oct 12 13:29:53.101949 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 836/1693] 10.222.0.52 () {60 vars in 1178 bytes} [Wed Oct 12 13:29:52 2022] GET /compute/v2.1/os-services => generated 112 bytes in 259 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:29:54.621369 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-63e5bd7a-fcf7-4415-95a3-8497d81170a7 tempest-ServersTestMultiNic-410166434 tempest-ServersTestMultiNic-410166434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-326391838", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "c4761d86-3a81-4f30-ab60-bb2b3292c977"}, {"uuid": "e3022d04-8933-4ee7-9cd6-f79932992c7d"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:54.705600 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-63e5bd7a-fcf7-4415-95a3-8497d81170a7 tempest-ServersTestMultiNic-410166434 tempest-ServersTestMultiNic-410166434-project] validate_networks() for [('c4761d86-3a81-4f30-ab60-bb2b3292c977', None, None, None, None, None), ('e3022d04-8933-4ee7-9cd6-f79932992c7d', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:29:54.866612 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d3ead7d7-5510-4ac6-b5f6-d372b400e78c tempest-ServersNegativeTestMultiTenantJSON-1483299553 tempest-ServersNegativeTestMultiTenantJSON-1483299553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-145477025", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "e644ea58-932b-4663-9513-f7b380b50686"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:54.966309 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-d3ead7d7-5510-4ac6-b5f6-d372b400e78c tempest-ServersNegativeTestMultiTenantJSON-1483299553 tempest-ServersNegativeTestMultiTenantJSON-1483299553-project] validate_networks() for [('e644ea58-932b-4663-9513-f7b380b50686', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-63e5bd7a-fcf7-4415-95a3-8497d81170a7 tempest-ServersTestMultiNic-410166434 tempest-ServersTestMultiNic-410166434-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9e58c122-aec8-48d6-850b-ce96d3b6ffa2) Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:29:55.606580 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9e58c122-aec8-48d6-850b-ce96d3b6ffa2) Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-63e5bd7a-fcf7-4415-95a3-8497d81170a7 tempest-ServersTestMultiNic-410166434 tempest-ServersTestMultiNic-410166434-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-63e5bd7a-fcf7-4415-95a3-8497d81170a7 tempest-ServersTestMultiNic-410166434 tempest-ServersTestMultiNic-410166434-project] Request method failure captured: Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 254 Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsE60O42OkJmlOjDFXv6L7X9tonXctyUPsUJTCRWsmDBcdWnM-ccbJ671DfTHHU9_9YtQGbai2XOMet-wkXI-sVFyZwo_R8dm0pSmWrqg9ZwIWRKKKopyF3JMu0YCWhlsM3wclHEg5-svYbRPC2WM9aT73EIlgam4L7-abuVLWW8svM Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: d8809dd2a86042858d174f1af477d593 Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServersTestMultiNic-410166434 Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d8809dd2a86042858d174f1af477d593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d8809dd2a86042858d174f1af477d593"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8809dd2a86042858d174f1af477d593"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8809dd2a86042858d174f1af477d593"}]}] Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServersTestMultiNic-410166434 Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: d8809dd2a86042858d174f1af477d593 Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServersTestMultiNic-410166434 Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServersTestMultiNic-410166434-project Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: d8907362cfac419cba45e154a393fc9c Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServersTestMultiNic-410166434-project Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-ServersTestMultiNic-server-326391838", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "c4761d86-3a81-4f30-ab60-bb2b3292c977"}, {"uuid": "e3022d04-8933-4ee7-9cd6-f79932992c7d"}]}} Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-ServersTestMultiNic-server-326391838', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': 'c4761d86-3a81-4f30-ab60-bb2b3292c977'}, {'uuid': 'e3022d04-8933-4ee7-9cd6-f79932992c7d'}]}}} Oct 12 13:29:55.619986 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:29:55.625898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9e58c122-aec8-48d6-850b-ce96d3b6ffa2) Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-63e5bd7a-fcf7-4415-95a3-8497d81170a7 tempest-ServersTestMultiNic-410166434 tempest-ServersTestMultiNic-410166434-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-63e5bd7a-fcf7-4415-95a3-8497d81170a7 tempest-ServersTestMultiNic-410166434 tempest-ServersTestMultiNic-410166434-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.997440 Oct 12 13:29:55.631747 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 837/1694] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:29:54 2022] POST /compute/v2.1/servers => generated 214 bytes in 1004 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-d3ead7d7-5510-4ac6-b5f6-d372b400e78c tempest-ServersNegativeTestMultiTenantJSON-1483299553 tempest-ServersNegativeTestMultiTenantJSON-1483299553-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5f35507a-43c1-4730-beea-1a474ac97907) Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:29:55.637199 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:29:55.640604 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:29:55.640604 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:29:55.640604 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:29:55.640604 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:29:55.640604 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:29:55.640604 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:29:55.640604 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:29:55.640604 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:29:55.640604 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:29:55.640604 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:29:55.640604 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:29:55.640604 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:29:55.640604 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:29:55.640604 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:29:55.640604 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:29:55.640604 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5f35507a-43c1-4730-beea-1a474ac97907) Oct 12 13:29:55.640604 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:55.640604 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-d3ead7d7-5510-4ac6-b5f6-d372b400e78c tempest-ServersNegativeTestMultiTenantJSON-1483299553 tempest-ServersNegativeTestMultiTenantJSON-1483299553-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:55.640604 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d3ead7d7-5510-4ac6-b5f6-d372b400e78c tempest-ServersNegativeTestMultiTenantJSON-1483299553 tempest-ServersNegativeTestMultiTenantJSON-1483299553-project] Request method failure captured: Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 219 Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsE8eGslTesn0uWUDJjKaV5zB4EQ5AtncCZqk0k2RZoqpFByx23XuK2mbTeEfkshV8sdx6ktmDib9G59M_Df7FjTLd_InRxYXZx6wdWDaIN4CJkB3-yUmfeCEXlbOqAIFYEbWtvvFEZ-XEW6AJ7r37IVXyGoJ86zsH1wccEVLgORWHw Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: a84bfb8cb0fb4d90af1f9d7474850a32 Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1483299553 Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a84bfb8cb0fb4d90af1f9d7474850a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a84bfb8cb0fb4d90af1f9d7474850a32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a84bfb8cb0fb4d90af1f9d7474850a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a84bfb8cb0fb4d90af1f9d7474850a32"}]}] Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1483299553 Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: a84bfb8cb0fb4d90af1f9d7474850a32 Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1483299553 Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1483299553-project Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: f3232221fd3a4d92a1606d91b0c92c06 Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1483299553-project Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-145477025", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "e644ea58-932b-4663-9513-f7b380b50686"}]}} Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestMultiTenantJSON-server-145477025', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': 'e644ea58-932b-4663-9513-f7b380b50686'}]}}} Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:29:55.642126 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5f35507a-43c1-4730-beea-1a474ac97907) Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:29:55.648156 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:29:55.652579 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:29:55.652579 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:55.652579 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:55.652579 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:55.652579 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:29:55.652579 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:55.652579 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:29:55.652579 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:29:55.652579 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:29:55.652579 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:29:55.652579 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:29:55.652579 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:55.652579 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:55.652579 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:29:55.652579 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d3ead7d7-5510-4ac6-b5f6-d372b400e78c tempest-ServersNegativeTestMultiTenantJSON-1483299553 tempest-ServersNegativeTestMultiTenantJSON-1483299553-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:29:55.652579 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:29:55.652579 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d3ead7d7-5510-4ac6-b5f6-d372b400e78c tempest-ServersNegativeTestMultiTenantJSON-1483299553 tempest-ServersNegativeTestMultiTenantJSON-1483299553-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.221867 Oct 12 13:29:55.652579 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 858/1695] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:29:54 2022] POST /compute/v2.1/servers => generated 214 bytes in 1226 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:29:56.921130 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7639e707-93c0-4710-bca7-6ba59fe52fde tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1539102805", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": "none"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:57.076451 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-7639e707-93c0-4710-bca7-6ba59fe52fde tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:29:57.077507 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-7639e707-93c0-4710-bca7-6ba59fe52fde tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:29:57.078425 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-7639e707-93c0-4710-bca7-6ba59fe52fde tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:29:57.079061 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-7639e707-93c0-4710-bca7-6ba59fe52fde tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:29:57.079624 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-7639e707-93c0-4710-bca7-6ba59fe52fde tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:29:57.114690 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7639e707-93c0-4710-bca7-6ba59fe52fde tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:57.124023 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7639e707-93c0-4710-bca7-6ba59fe52fde tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:57.124528 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7639e707-93c0-4710-bca7-6ba59fe52fde tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:57.131612 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7639e707-93c0-4710-bca7-6ba59fe52fde tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:29:57.132148 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7639e707-93c0-4710-bca7-6ba59fe52fde tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:29:57.132595 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7639e707-93c0-4710-bca7-6ba59fe52fde tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:29:57.222321 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-7639e707-93c0-4710-bca7-6ba59fe52fde tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Getting quotas for project 6016c32ac5f048e0a42f1dc200f7fe79. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:29:57.248506 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-7639e707-93c0-4710-bca7-6ba59fe52fde tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Getting quotas for user 00d5ce13c7e64902a3af7af5341b7810 and project 6016c32ac5f048e0a42f1dc200f7fe79. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:29:57.300826 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7639e707-93c0-4710-bca7-6ba59fe52fde tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:29:57.316529 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7639e707-93c0-4710-bca7-6ba59fe52fde tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:29:57.593758 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7639e707-93c0-4710-bca7-6ba59fe52fde tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.016086 Oct 12 13:29:57.597683 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 838/1696] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Oct 12 13:29:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1029 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 13:29:57.604998 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=66 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:29:57.611332 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d014c3c6-4095-46c0-8473-b837a9bdf2a2 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:57.612310 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-d014c3c6-4095-46c0-8473-b837a9bdf2a2 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:57.814514 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d014c3c6-4095-46c0-8473-b837a9bdf2a2 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:57.831157 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d014c3c6-4095-46c0-8473-b837a9bdf2a2 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:57.834327 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d014c3c6-4095-46c0-8473-b837a9bdf2a2 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:57.838013 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d014c3c6-4095-46c0-8473-b837a9bdf2a2 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1278 microversion: 2.57 time: 0.233752 Oct 12 13:29:57.841367 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 859/1697] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:57 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1278 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:58.869368 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2ad08a99-2b8c-4f0d-9d31-0441d8f4b832 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:29:58.870596 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2ad08a99-2b8c-4f0d-9d31-0441d8f4b832 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:29:58.917828 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d725ba97-1311-4573-9478-f05c528998ff tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-701996503", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc8ada29-6985-4172-9880-e15344e4c066"}], "security_groups": [{"name": "tempest-securitygroup--78310438"}], "key_name": "tempest-keypair-63207398", "user_data": "}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:29:59.231210 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-2ad08a99-2b8c-4f0d-9d31-0441d8f4b832 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:59.241172 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-2ad08a99-2b8c-4f0d-9d31-0441d8f4b832 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:59.242614 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-2ad08a99-2b8c-4f0d-9d31-0441d8f4b832 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:29:59.243756 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2ad08a99-2b8c-4f0d-9d31-0441d8f4b832 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1278 microversion: 2.57 time: 0.378786 Oct 12 13:29:59.292027 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 839/1698] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:29:58 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1278 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:29:59.829394 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-d725ba97-1311-4573-9478-f05c528998ff tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] validate_networks() for [('dc8ada29-6985-4172-9880-e15344e4c066', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:30:00.278501 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f78fffa7-ad42-40b0-9765-c3a1912680f9 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:00.279246 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f78fffa7-ad42-40b0-9765-c3a1912680f9 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:00.300843 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f78fffa7-ad42-40b0-9765-c3a1912680f9 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:00.301394 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f78fffa7-ad42-40b0-9765-c3a1912680f9 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:00.305928 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f78fffa7-ad42-40b0-9765-c3a1912680f9 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:00.310112 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f78fffa7-ad42-40b0-9765-c3a1912680f9 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:00.311584 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f78fffa7-ad42-40b0-9765-c3a1912680f9 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:00.314653 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f78fffa7-ad42-40b0-9765-c3a1912680f9 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:00.903994 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f78fffa7-ad42-40b0-9765-c3a1912680f9 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:00.937002 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f78fffa7-ad42-40b0-9765-c3a1912680f9 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:00.938526 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f78fffa7-ad42-40b0-9765-c3a1912680f9 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:00.943308 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f78fffa7-ad42-40b0-9765-c3a1912680f9 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1282 microversion: 2.57 time: 0.669431 Oct 12 13:30:00.945921 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 840/1699] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:00 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1282 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-d725ba97-1311-4573-9478-f05c528998ff tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-db3022a0-97d1-4d2c-9f92-2dee60ca249d) Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:30:01.971396 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:30:01.975599 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:30:01.975599 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:30:01.975599 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:30:01.975599 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:30:01.975599 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:30:01.975599 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:30:01.975599 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:30:01.975599 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:30:01.975599 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:30:01.975599 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:30:01.975599 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:30:01.975599 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:30:01.975599 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:30:01.975599 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:30:01.975599 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:30:01.975599 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-db3022a0-97d1-4d2c-9f92-2dee60ca249d) Oct 12 13:30:01.975599 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:01.975599 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-d725ba97-1311-4573-9478-f05c528998ff tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:30:01.975599 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d725ba97-1311-4573-9478-f05c528998ff tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Request method failure captured: Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 485 Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsEwOeu7ksivSH2Ia4uk6eiitfE2rxVwume2XDO9f67bgMuDMRLUEcJHLLqoLfJE3O3e2ccAdYEavhU8AsmWwxFHv3zDi0c3lfYHAeJ8N437irnufxIoITRe-KpBBkHx9kV4PQOmQrTirMyNhgycn8bLqIFbrJyUzVBhxRpJBrZxcNQ Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 81c9366135cf42f096ef6e0d748fa283 Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AttachVolumeNegativeTest-144784080 Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/81c9366135cf42f096ef6e0d748fa283"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_81c9366135cf42f096ef6e0d748fa283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/81c9366135cf42f096ef6e0d748fa283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/81c9366135cf42f096ef6e0d748fa283"}]}] Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AttachVolumeNegativeTest-144784080 Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 81c9366135cf42f096ef6e0d748fa283 Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-144784080 Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AttachVolumeNegativeTest-144784080-project Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 67f1b44834f84be9915554e881195cc2 Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AttachVolumeNegativeTest-144784080-project Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-701996503", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "dc8ada29-6985-4172-9880-e15344e4c066"}], "security_groups": [{"name": "tempest-securitygroup--78310438"}], "key_name": "tempest-keypair-63207398", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeNegativeTest-server-701996503', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': 'dc8ada29-6985-4172-9880-e15344e4c066'}], 'security_groups': [{'name': 'tempest-securitygroup--78310438'}], 'key_name': 'tempest-keypair-63207398', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:30:01.978428 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-db3022a0-97d1-4d2c-9f92-2dee60ca249d) Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:01.983402 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:01.999324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:01.999324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:30:01.999324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:30:01.999324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:30:01.999324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:30:01.999324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:30:01.999324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:01.999324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:01.999324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:01.999324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:01.999324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:01.999324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:01.999324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:01.999324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:30:01.999324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:30:01.999324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:30:01.999324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:01.999324 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:01.999324 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d725ba97-1311-4573-9478-f05c528998ff tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:30:01.999324 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:30:01.999324 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d725ba97-1311-4573-9478-f05c528998ff tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 3.066246 Oct 12 13:30:02.002115 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f307f6f3-7226-4eba-ac86-16fce518723f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:02.002115 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f307f6f3-7226-4eba-ac86-16fce518723f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:02.002667 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 860/1700] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:29:58 2022] POST /compute/v2.1/servers => generated 214 bytes in 3074 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 12 13:30:02.002667 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-040ee3b2-cc9d-4caa-b966-e2c0d0ac2208 tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] Calling method '.version_select at 0x7f8a9bd019d0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:02.004717 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f307f6f3-7226-4eba-ac86-16fce518723f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:02.007392 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f307f6f3-7226-4eba-ac86-16fce518723f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:02.007877 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f307f6f3-7226-4eba-ac86-16fce518723f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:02.017829 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f307f6f3-7226-4eba-ac86-16fce518723f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:02.018391 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f307f6f3-7226-4eba-ac86-16fce518723f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:02.020012 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f307f6f3-7226-4eba-ac86-16fce518723f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:02.100393 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-040ee3b2-cc9d-4caa-b966-e2c0d0ac2208 tempest-AttachVolumeNegativeTest-144784080 tempest-AttachVolumeNegativeTest-144784080-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-63207398" status: 202 len: 0 microversion: 2.1 time: 0.113496 Oct 12 13:30:02.101268 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 861/1701] 10.222.0.52 () {58 vars in 1215 bytes} [Wed Oct 12 13:30:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-63207398 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:30:02.242636 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f307f6f3-7226-4eba-ac86-16fce518723f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:02.259187 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f307f6f3-7226-4eba-ac86-16fce518723f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:02.261752 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f307f6f3-7226-4eba-ac86-16fce518723f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:02.276308 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f307f6f3-7226-4eba-ac86-16fce518723f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1338 microversion: 2.57 time: 0.292041 Oct 12 13:30:02.282896 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 841/1702] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:01 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1338 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:03.310002 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-865eb2d6-8024-4e9a-88fd-f1266f649019 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:03.311500 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-865eb2d6-8024-4e9a-88fd-f1266f649019 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:03.325411 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=10 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:30:03.329648 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:30:03.365385 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-865eb2d6-8024-4e9a-88fd-f1266f649019 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:03.371164 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-865eb2d6-8024-4e9a-88fd-f1266f649019 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:03.371164 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-865eb2d6-8024-4e9a-88fd-f1266f649019 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:03.374599 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-865eb2d6-8024-4e9a-88fd-f1266f649019 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:03.377493 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-865eb2d6-8024-4e9a-88fd-f1266f649019 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:03.379757 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-865eb2d6-8024-4e9a-88fd-f1266f649019 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:03.749762 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-865eb2d6-8024-4e9a-88fd-f1266f649019 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:03.788011 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-865eb2d6-8024-4e9a-88fd-f1266f649019 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:03.789862 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-865eb2d6-8024-4e9a-88fd-f1266f649019 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:03.791238 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-865eb2d6-8024-4e9a-88fd-f1266f649019 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1336 microversion: 2.57 time: 0.487986 Oct 12 13:30:03.791998 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 862/1703] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:03 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1336 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:04.358524 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-773635eb-acac-434f-aedd-e2d7dff045cb tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] Action: 'create', calling method: .version_select at 0x7f8a9be5fc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-930610621", "metadata": {"Type": "work"}}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:30:04.824667 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-07ad5758-f34d-4863-8a58-3d4fe2b66d25 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:04.826102 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-07ad5758-f34d-4863-8a58-3d4fe2b66d25 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:04.862570 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-07ad5758-f34d-4863-8a58-3d4fe2b66d25 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:04.863079 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-07ad5758-f34d-4863-8a58-3d4fe2b66d25 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:04.867472 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-07ad5758-f34d-4863-8a58-3d4fe2b66d25 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:04.868304 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-07ad5758-f34d-4863-8a58-3d4fe2b66d25 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:04.869506 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-07ad5758-f34d-4863-8a58-3d4fe2b66d25 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:04.869962 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-07ad5758-f34d-4863-8a58-3d4fe2b66d25 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:05.345292 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-07ad5758-f34d-4863-8a58-3d4fe2b66d25 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:05.369337 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-07ad5758-f34d-4863-8a58-3d4fe2b66d25 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:05.377358 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-07ad5758-f34d-4863-8a58-3d4fe2b66d25 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:05.382615 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-07ad5758-f34d-4863-8a58-3d4fe2b66d25 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1336 microversion: 2.57 time: 0.563969 Oct 12 13:30:05.385111 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-773635eb-acac-434f-aedd-e2d7dff045cb tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.384627 Oct 12 13:30:05.388569 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 842/1704] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Oct 12 13:30:03 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1389 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 12 13:30:05.406030 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 863/1705] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:04 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1336 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:05.416712 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-73528a4d-7ed5-4153-bdd8-dc07b2187cb1 tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] Calling method '.version_select at 0x7f8a9b5f5040>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:05.523137 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-73528a4d-7ed5-4153-bdd8-dc07b2187cb1 tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95" status: 200 len: 352 microversion: 2.1 time: 0.116142 Oct 12 13:30:05.524331 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 843/1706] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:30:05 2022] GET /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95 => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:30:06.443293 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-032f6fc0-f7e8-4ed5-a221-95d3a98dd19d tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:06.496512 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-032f6fc0-f7e8-4ed5-a221-95d3a98dd19d tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:06.496512 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-032f6fc0-f7e8-4ed5-a221-95d3a98dd19d tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:06.496512 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-032f6fc0-f7e8-4ed5-a221-95d3a98dd19d tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:06.496512 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-032f6fc0-f7e8-4ed5-a221-95d3a98dd19d tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:06.496512 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-032f6fc0-f7e8-4ed5-a221-95d3a98dd19d tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:06.496512 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-032f6fc0-f7e8-4ed5-a221-95d3a98dd19d tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:06.496512 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-032f6fc0-f7e8-4ed5-a221-95d3a98dd19d tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:06.542933 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-45d881df-e47f-4ae4-bdda-61b5c04f35b2 tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] Calling method '.version_select at 0x7f8a9bdb14c0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:06.755452 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-45d881df-e47f-4ae4-bdda-61b5c04f35b2 tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95" status: 200 len: 352 microversion: 2.1 time: 0.221767 Oct 12 13:30:06.756589 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 844/1707] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:30:06 2022] GET /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95 => generated 352 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:30:06.942513 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-032f6fc0-f7e8-4ed5-a221-95d3a98dd19d tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:06.959669 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-032f6fc0-f7e8-4ed5-a221-95d3a98dd19d tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:06.969622 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-032f6fc0-f7e8-4ed5-a221-95d3a98dd19d tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:06.975010 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-032f6fc0-f7e8-4ed5-a221-95d3a98dd19d tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1336 microversion: 2.57 time: 0.540793 Oct 12 13:30:06.983044 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 864/1708] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:06 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1336 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:07.770333 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f46fda7f-aedd-4447-8eb9-d9211e32f489 tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] Calling method '.version_select at 0x7f8a9bc963a0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:07.812862 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=10 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:30:08.015633 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ab72034b-11d1-4210-a14e-22621c069c35 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:08.016884 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-ab72034b-11d1-4210-a14e-22621c069c35 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:08.037256 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ab72034b-11d1-4210-a14e-22621c069c35 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:08.040574 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ab72034b-11d1-4210-a14e-22621c069c35 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:08.042685 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ab72034b-11d1-4210-a14e-22621c069c35 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:08.045112 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ab72034b-11d1-4210-a14e-22621c069c35 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:08.057551 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ab72034b-11d1-4210-a14e-22621c069c35 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:08.058342 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f46fda7f-aedd-4447-8eb9-d9211e32f489 tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95" status: 200 len: 352 microversion: 2.1 time: 0.292552 Oct 12 13:30:08.059314 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 845/1709] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:30:07 2022] GET /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95 => generated 352 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:30:08.062069 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ab72034b-11d1-4210-a14e-22621c069c35 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:08.598782 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-ab72034b-11d1-4210-a14e-22621c069c35 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:08.650299 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-ab72034b-11d1-4210-a14e-22621c069c35 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:08.650299 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-ab72034b-11d1-4210-a14e-22621c069c35 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:08.676752 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ab72034b-11d1-4210-a14e-22621c069c35 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1357 microversion: 2.57 time: 0.638049 Oct 12 13:30:08.719741 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 865/1710] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:08 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1357 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:08.739313 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3d66dd86-c3f7-47ab-8619-b3ebf568894f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:30:08.742974 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3d66dd86-c3f7-47ab-8619-b3ebf568894f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:08.762161 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:30:08.774416 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d66dd86-c3f7-47ab-8619-b3ebf568894f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:08.774416 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d66dd86-c3f7-47ab-8619-b3ebf568894f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:08.774416 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d66dd86-c3f7-47ab-8619-b3ebf568894f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:08.774416 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d66dd86-c3f7-47ab-8619-b3ebf568894f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:08.779783 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d66dd86-c3f7-47ab-8619-b3ebf568894f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:08.780642 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d66dd86-c3f7-47ab-8619-b3ebf568894f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:08.803220 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:30:09.022128 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-3d66dd86-c3f7-47ab-8619-b3ebf568894f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:30:09.024316 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-3d66dd86-c3f7-47ab-8619-b3ebf568894f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:30:09.025083 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-3d66dd86-c3f7-47ab-8619-b3ebf568894f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:30:09.025936 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-3d66dd86-c3f7-47ab-8619-b3ebf568894f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:30:09.027644 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-3d66dd86-c3f7-47ab-8619-b3ebf568894f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:30:09.086603 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c6f7e547-c8d9-447f-81f7-542d4087ddab tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] Calling method '.version_select at 0x7f8a9b9fd310>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:09.114276 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:30:09.240211 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=8 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:30:09.280827 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c6f7e547-c8d9-447f-81f7-542d4087ddab tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95" status: 200 len: 353 microversion: 2.1 time: 0.204629 Oct 12 13:30:09.293754 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 866/1711] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:30:09 2022] GET /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95 => generated 353 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:30:09.308326 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4f6e4bc5-a2e4-4b06-a93e-94bdfae3abdd tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] Calling method '.version_select at 0x7f8a9ba2d4c0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:09.445356 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3d66dd86-c3f7-47ab-8619-b3ebf568894f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:09.488344 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d66dd86-c3f7-47ab-8619-b3ebf568894f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:09.492207 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d66dd86-c3f7-47ab-8619-b3ebf568894f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:09.495206 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d66dd86-c3f7-47ab-8619-b3ebf568894f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:09.500976 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d66dd86-c3f7-47ab-8619-b3ebf568894f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:09.501498 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d66dd86-c3f7-47ab-8619-b3ebf568894f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:09.502804 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d66dd86-c3f7-47ab-8619-b3ebf568894f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:09.541357 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4f6e4bc5-a2e4-4b06-a93e-94bdfae3abdd tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95" status: 200 len: 353 microversion: 2.1 time: 0.244528 Oct 12 13:30:09.542975 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 867/1712] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:30:09 2022] GET /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95 => generated 353 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:30:09.573291 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0d6cf77a-babf-4b63-80ef-991d97cf6b2b tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] Calling method '.version_select at 0x7f8a9baf24c0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:09.621179 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3d66dd86-c3f7-47ab-8619-b3ebf568894f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "POST /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84/action" status: 202 len: 1138 microversion: 2.57 time: 0.885690 Oct 12 13:30:09.629831 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 846/1713] 10.222.0.52 () {62 vars in 1320 bytes} [Wed Oct 12 13:30:08 2022] POST /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84/action => generated 1138 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 12 13:30:09.665613 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d72544e0-3f85-40d6-ae40-515d16b4ce3a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:09.667042 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d72544e0-3f85-40d6-ae40-515d16b4ce3a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:09.677200 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d72544e0-3f85-40d6-ae40-515d16b4ce3a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:09.677904 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d72544e0-3f85-40d6-ae40-515d16b4ce3a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:09.679249 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d72544e0-3f85-40d6-ae40-515d16b4ce3a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:09.680290 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d72544e0-3f85-40d6-ae40-515d16b4ce3a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:09.680934 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d72544e0-3f85-40d6-ae40-515d16b4ce3a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:09.681505 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d72544e0-3f85-40d6-ae40-515d16b4ce3a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:09.950591 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d72544e0-3f85-40d6-ae40-515d16b4ce3a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:09.951454 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0d6cf77a-babf-4b63-80ef-991d97cf6b2b tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95" status: 202 len: 0 microversion: 2.1 time: 0.391599 Oct 12 13:30:09.952674 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 868/1714] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 12 13:30:09 2022] DELETE /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:30:09.962438 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a2a3a160-9625-4bec-8798-32d557b5b363 tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] Calling method '.version_select at 0x7f8a9ba2d4c0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:09.997641 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d72544e0-3f85-40d6-ae40-515d16b4ce3a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:10.004103 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d72544e0-3f85-40d6-ae40-515d16b4ce3a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:10.011643 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d72544e0-3f85-40d6-ae40-515d16b4ce3a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1366 microversion: 2.57 time: 0.354884 Oct 12 13:30:10.023347 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 847/1715] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:09 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1366 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:10.160212 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a2a3a160-9625-4bec-8798-32d557b5b363 tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95" status: 200 len: 352 microversion: 2.1 time: 0.201957 Oct 12 13:30:10.162440 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 869/1716] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:30:09 2022] GET /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95 => generated 352 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:30:11.053284 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-59ede17d-70b8-4d6e-8e25-8cfd9e926d7a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:11.054951 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-59ede17d-70b8-4d6e-8e25-8cfd9e926d7a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:11.068609 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-59ede17d-70b8-4d6e-8e25-8cfd9e926d7a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:11.069450 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-59ede17d-70b8-4d6e-8e25-8cfd9e926d7a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:11.070063 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-59ede17d-70b8-4d6e-8e25-8cfd9e926d7a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:11.070950 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-59ede17d-70b8-4d6e-8e25-8cfd9e926d7a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:11.071436 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-59ede17d-70b8-4d6e-8e25-8cfd9e926d7a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:11.082440 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-59ede17d-70b8-4d6e-8e25-8cfd9e926d7a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:11.180025 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4a69788a-a325-4787-9f7c-3217acf2291b tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] Calling method '.version_select at 0x7f8a9b9fdf70>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:11.286267 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4a69788a-a325-4787-9f7c-3217acf2291b tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95" status: 200 len: 352 microversion: 2.1 time: 0.110255 Oct 12 13:30:11.286841 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 870/1717] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:30:11 2022] GET /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95 => generated 352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:30:11.377087 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-59ede17d-70b8-4d6e-8e25-8cfd9e926d7a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:11.390022 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-59ede17d-70b8-4d6e-8e25-8cfd9e926d7a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:11.395688 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-59ede17d-70b8-4d6e-8e25-8cfd9e926d7a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:11.395688 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-59ede17d-70b8-4d6e-8e25-8cfd9e926d7a tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1366 microversion: 2.57 time: 0.343238 Oct 12 13:30:11.405512 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 848/1718] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:11 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:12.300703 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b20d52f0-c84e-46a0-998f-090e8858e628 tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] Calling method '.version_select at 0x7f8a9b9fddc0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:12.432642 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-552b4e3a-844c-42f8-a388-8b5dae23487f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:12.433954 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-552b4e3a-844c-42f8-a388-8b5dae23487f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:12.448123 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-552b4e3a-844c-42f8-a388-8b5dae23487f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:12.449373 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-552b4e3a-844c-42f8-a388-8b5dae23487f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:12.455119 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-552b4e3a-844c-42f8-a388-8b5dae23487f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:12.455119 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-552b4e3a-844c-42f8-a388-8b5dae23487f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:12.455119 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-552b4e3a-844c-42f8-a388-8b5dae23487f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:12.455119 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-552b4e3a-844c-42f8-a388-8b5dae23487f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:12.457307 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b20d52f0-c84e-46a0-998f-090e8858e628 tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95" status: 200 len: 352 microversion: 2.1 time: 0.159193 Oct 12 13:30:12.498763 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 871/1719] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:30:12 2022] GET /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95 => generated 352 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:30:12.747846 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-552b4e3a-844c-42f8-a388-8b5dae23487f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:12.762272 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-552b4e3a-844c-42f8-a388-8b5dae23487f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:12.764249 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-552b4e3a-844c-42f8-a388-8b5dae23487f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:12.781689 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-552b4e3a-844c-42f8-a388-8b5dae23487f tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1366 microversion: 2.57 time: 0.342499 Oct 12 13:30:12.781689 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 849/1720] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:12 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:13.498039 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-de0f173f-17cb-4896-b281-404c6e813d05 tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] Calling method '.version_select at 0x7f8a9b9d3ca0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:13.626623 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-de0f173f-17cb-4896-b281-404c6e813d05 tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95" status: 200 len: 352 microversion: 2.1 time: 0.132741 Oct 12 13:30:13.638314 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 872/1721] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:30:13 2022] GET /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95 => generated 352 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:30:13.668785 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8c110af0-6d47-4921-b7e6-cac1dbbfcc5c tempest-ServerPasswordTestJSON-1848813798 tempest-ServerPasswordTestJSON-1848813798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1977382263", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "e5d7bfb1-9a89-4ec9-b0f4-941556ce38cd"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:30:13.778285 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-8c110af0-6d47-4921-b7e6-cac1dbbfcc5c tempest-ServerPasswordTestJSON-1848813798 tempest-ServerPasswordTestJSON-1848813798-project] validate_networks() for [('e5d7bfb1-9a89-4ec9-b0f4-941556ce38cd', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:30:13.802886 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7b527cdf-870f-4cff-837f-4e4f53acfc50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:13.805360 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7b527cdf-870f-4cff-837f-4e4f53acfc50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:13.814913 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=2,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:30:13.826367 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7b527cdf-870f-4cff-837f-4e4f53acfc50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:13.829660 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7b527cdf-870f-4cff-837f-4e4f53acfc50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:13.831950 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7b527cdf-870f-4cff-837f-4e4f53acfc50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:13.835080 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7b527cdf-870f-4cff-837f-4e4f53acfc50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:13.839787 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7b527cdf-870f-4cff-837f-4e4f53acfc50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:13.843196 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7b527cdf-870f-4cff-837f-4e4f53acfc50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:14.139731 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-7b527cdf-870f-4cff-837f-4e4f53acfc50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:14.148688 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-7b527cdf-870f-4cff-837f-4e4f53acfc50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:14.150170 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-7b527cdf-870f-4cff-837f-4e4f53acfc50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:14.156466 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-7b527cdf-870f-4cff-837f-4e4f53acfc50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1366 microversion: 2.57 time: 0.360374 Oct 12 13:30:14.161921 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 873/1722] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:13 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1366 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-8c110af0-6d47-4921-b7e6-cac1dbbfcc5c tempest-ServerPasswordTestJSON-1848813798 tempest-ServerPasswordTestJSON-1848813798-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2289cbeb-779d-404f-9a13-ff52703b96f8) Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:30:14.184483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:30:14.188088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:30:14.188088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:30:14.188088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:30:14.188088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:30:14.188088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:30:14.188088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:30:14.188088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:30:14.188088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:30:14.188088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:30:14.188088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:30:14.188088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:30:14.188088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:30:14.188088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:30:14.188088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:30:14.188088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2289cbeb-779d-404f-9a13-ff52703b96f8) Oct 12 13:30:14.188088 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:14.194076 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-8c110af0-6d47-4921-b7e6-cac1dbbfcc5c tempest-ServerPasswordTestJSON-1848813798 tempest-ServerPasswordTestJSON-1848813798-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:30:14.194076 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8c110af0-6d47-4921-b7e6-cac1dbbfcc5c tempest-ServerPasswordTestJSON-1848813798 tempest-ServerPasswordTestJSON-1848813798-project] Request method failure captured: Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 208 Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsFlacaMWKX8PRIE0xHqbcpb6e_uYOTUwo3PvVivRYpEtf0sJOptca4n8m5MY5YjfUfx40SOk9wTI3gzMAoQMEeqFPluN5Rfu9dLESIfSz1X_uK35j4-oTIXP1b2BCp_-U95k9HfkkmAnP2yhueQUH1dqW8HAmaIgQcbye_Xpb6juEE Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: dd7971a5f687458fa119ae13473c65cc Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServerPasswordTestJSON-1848813798 Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dd7971a5f687458fa119ae13473c65cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dd7971a5f687458fa119ae13473c65cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dd7971a5f687458fa119ae13473c65cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dd7971a5f687458fa119ae13473c65cc"}]}] Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServerPasswordTestJSON-1848813798 Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: dd7971a5f687458fa119ae13473c65cc Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1848813798 Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServerPasswordTestJSON-1848813798-project Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 9c28268a2b904bb4a6aca507edd3eb43 Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServerPasswordTestJSON-1848813798-project Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1977382263", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "e5d7bfb1-9a89-4ec9-b0f4-941556ce38cd"}]}} Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-ServerPasswordTestJSON-server-1977382263', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': 'e5d7bfb1-9a89-4ec9-b0f4-941556ce38cd'}]}}} Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:30:14.200251 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2289cbeb-779d-404f-9a13-ff52703b96f8) Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:30:14.204313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:30:14.208261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:30:14.208261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:14.208261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:14.208261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:14.208261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:14.208261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:14.208261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:14.208261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:14.208261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:30:14.208261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:30:14.208261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:30:14.208261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:14.208261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:14.211555 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8c110af0-6d47-4921-b7e6-cac1dbbfcc5c tempest-ServerPasswordTestJSON-1848813798 tempest-ServerPasswordTestJSON-1848813798-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:30:14.211555 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:30:14.213214 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8c110af0-6d47-4921-b7e6-cac1dbbfcc5c tempest-ServerPasswordTestJSON-1848813798 tempest-ServerPasswordTestJSON-1848813798-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.685863 Oct 12 13:30:14.217995 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 850/1723] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:30:13 2022] POST /compute/v2.1/servers => generated 214 bytes in 691 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:30:14.642240 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5595d87e-d2eb-4d48-b451-09fc80e57719 tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] Calling method '.version_select at 0x7f8a9bd019d0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:14.766341 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5595d87e-d2eb-4d48-b451-09fc80e57719 tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95" status: 200 len: 352 microversion: 2.1 time: 0.124708 Oct 12 13:30:14.766341 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 874/1724] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:30:14 2022] GET /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95 => generated 352 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:30:15.191781 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3d5fe5a9-8503-4785-a29c-18029ce67677 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:15.192392 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3d5fe5a9-8503-4785-a29c-18029ce67677 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:15.216668 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d5fe5a9-8503-4785-a29c-18029ce67677 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:15.217502 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d5fe5a9-8503-4785-a29c-18029ce67677 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:15.219945 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d5fe5a9-8503-4785-a29c-18029ce67677 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:15.220742 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d5fe5a9-8503-4785-a29c-18029ce67677 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:15.221237 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d5fe5a9-8503-4785-a29c-18029ce67677 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:15.241203 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d5fe5a9-8503-4785-a29c-18029ce67677 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:15.778002 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c29bc0d9-9aae-4ed0-b524-1049202c8bb8 tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] Calling method '.version_select at 0x7f8a9b9fd3a0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:15.830690 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-c29bc0d9-9aae-4ed0-b524-1049202c8bb8 tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] HTTP exception thrown: Volume b555542c-64f6-4ad6-83dd-d62f7294ea95 could not be found. Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c29bc0d9-9aae-4ed0-b524-1049202c8bb8 tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] Request method failure captured: Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95 HTTP/1.1 Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsFbYYR-GXuPDXFeYVJsizKZlpvDV4i3zu77vAZ_1vZW4Z-X7CT_UgOUTBmdJBi1VoIrwXGhZ4b4ej-OYOZwOiFLqS4rOflM7n8cSLwu4eDJwMSvXH7nvi3LHjcV01ESdl0p5r0EygqpH4sM_KDe3AJ-8Zf6Wbv3pxYPBNJCDDsnnME Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 3da0759edc284cc6af95e3d232556482 Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-VolumesGetTestJSON-1155844381 Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3da0759edc284cc6af95e3d232556482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3da0759edc284cc6af95e3d232556482"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3da0759edc284cc6af95e3d232556482"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3da0759edc284cc6af95e3d232556482"}]}] Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-VolumesGetTestJSON-1155844381 Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 3da0759edc284cc6af95e3d232556482 Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-VolumesGetTestJSON-1155844381 Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-VolumesGetTestJSON-1155844381-project Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: dda5696537da4826ba6609ff53a4cb6f Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-VolumesGetTestJSON-1155844381-project Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: exception: Volume b555542c-64f6-4ad6-83dd-d62f7294ea95 could not be found. Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'b555542c-64f6-4ad6-83dd-d62f7294ea95'} Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b555542c-64f6-4ad6-83dd-d62f7294ea95 could not be found. (HTTP 404) (Request-ID: req-0c58fe40-9ceb-4b22-aa5a-5012eee3ef90) Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 13:30:15.868066 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b555542c-64f6-4ad6-83dd-d62f7294ea95 could not be found. Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b555542c-64f6-4ad6-83dd-d62f7294ea95 could not be found. Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b555542c-64f6-4ad6-83dd-d62f7294ea95 could not be found. Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c29bc0d9-9aae-4ed0-b524-1049202c8bb8 tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] Returning 404 to user: Volume b555542c-64f6-4ad6-83dd-d62f7294ea95 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:30:15.872537 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c29bc0d9-9aae-4ed0-b524-1049202c8bb8 tempest-VolumesGetTestJSON-1155844381 tempest-VolumesGetTestJSON-1155844381-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95" status: 404 len: 109 microversion: 2.1 time: 0.097079 Oct 12 13:30:15.876120 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 875/1725] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:30:15 2022] GET /compute/v2.1/os-volumes/b555542c-64f6-4ad6-83dd-d62f7294ea95 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:30:15.898774 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-3d5fe5a9-8503-4785-a29c-18029ce67677 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:15.911632 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-3d5fe5a9-8503-4785-a29c-18029ce67677 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:15.923710 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-3d5fe5a9-8503-4785-a29c-18029ce67677 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:15.929789 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3d5fe5a9-8503-4785-a29c-18029ce67677 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1366 microversion: 2.57 time: 0.742116 Oct 12 13:30:15.932252 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 851/1726] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:15 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1366 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:16.961635 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c426a697-0ebd-4ee4-a463-680dfd2ff2b4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:16.963148 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c426a697-0ebd-4ee4-a463-680dfd2ff2b4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:16.983333 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c426a697-0ebd-4ee4-a463-680dfd2ff2b4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:16.985092 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c426a697-0ebd-4ee4-a463-680dfd2ff2b4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:16.988272 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c426a697-0ebd-4ee4-a463-680dfd2ff2b4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:16.989921 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c426a697-0ebd-4ee4-a463-680dfd2ff2b4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:16.993451 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c426a697-0ebd-4ee4-a463-680dfd2ff2b4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:16.996960 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c426a697-0ebd-4ee4-a463-680dfd2ff2b4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:17.226767 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-c426a697-0ebd-4ee4-a463-680dfd2ff2b4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:17.244143 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-c426a697-0ebd-4ee4-a463-680dfd2ff2b4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:17.245633 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-c426a697-0ebd-4ee4-a463-680dfd2ff2b4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:17.246814 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c426a697-0ebd-4ee4-a463-680dfd2ff2b4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1366 microversion: 2.57 time: 0.292792 Oct 12 13:30:17.247366 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 876/1727] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:16 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:18.281197 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cdefa642-f3bf-451e-bf3a-7a4fb7c461c0 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:18.281820 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cdefa642-f3bf-451e-bf3a-7a4fb7c461c0 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:18.291283 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cdefa642-f3bf-451e-bf3a-7a4fb7c461c0 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:18.291770 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cdefa642-f3bf-451e-bf3a-7a4fb7c461c0 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:18.292205 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cdefa642-f3bf-451e-bf3a-7a4fb7c461c0 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:18.292921 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cdefa642-f3bf-451e-bf3a-7a4fb7c461c0 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:18.293382 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cdefa642-f3bf-451e-bf3a-7a4fb7c461c0 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:18.293827 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cdefa642-f3bf-451e-bf3a-7a4fb7c461c0 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:18.502708 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-cdefa642-f3bf-451e-bf3a-7a4fb7c461c0 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:18.514193 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-cdefa642-f3bf-451e-bf3a-7a4fb7c461c0 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:18.515633 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-cdefa642-f3bf-451e-bf3a-7a4fb7c461c0 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:18.516807 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cdefa642-f3bf-451e-bf3a-7a4fb7c461c0 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1366 microversion: 2.57 time: 0.239576 Oct 12 13:30:18.525292 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 852/1728] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:18 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:19.551848 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0dc4e27c-d691-4bee-9e7e-150937b6fd52 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:19.562271 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-0dc4e27c-d691-4bee-9e7e-150937b6fd52 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:19.570479 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0dc4e27c-d691-4bee-9e7e-150937b6fd52 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:19.572393 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0dc4e27c-d691-4bee-9e7e-150937b6fd52 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:19.573298 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0dc4e27c-d691-4bee-9e7e-150937b6fd52 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:19.575197 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0dc4e27c-d691-4bee-9e7e-150937b6fd52 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:19.576500 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0dc4e27c-d691-4bee-9e7e-150937b6fd52 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:19.578492 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0dc4e27c-d691-4bee-9e7e-150937b6fd52 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:20.117971 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-0dc4e27c-d691-4bee-9e7e-150937b6fd52 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:20.132884 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-0dc4e27c-d691-4bee-9e7e-150937b6fd52 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:20.137371 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-0dc4e27c-d691-4bee-9e7e-150937b6fd52 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:20.141809 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0dc4e27c-d691-4bee-9e7e-150937b6fd52 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1366 microversion: 2.57 time: 0.593138 Oct 12 13:30:20.146102 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 877/1729] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:19 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1366 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:21.174597 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-79af57d9-bb97-46a2-8ada-052d1164da47 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:21.175890 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-79af57d9-bb97-46a2-8ada-052d1164da47 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:21.196579 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79af57d9-bb97-46a2-8ada-052d1164da47 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:21.197103 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79af57d9-bb97-46a2-8ada-052d1164da47 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:21.205612 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79af57d9-bb97-46a2-8ada-052d1164da47 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:21.209226 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79af57d9-bb97-46a2-8ada-052d1164da47 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:21.209977 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79af57d9-bb97-46a2-8ada-052d1164da47 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:21.212528 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79af57d9-bb97-46a2-8ada-052d1164da47 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:21.551253 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-79af57d9-bb97-46a2-8ada-052d1164da47 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:21.565986 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-79af57d9-bb97-46a2-8ada-052d1164da47 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:21.567423 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-79af57d9-bb97-46a2-8ada-052d1164da47 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:21.568597 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-79af57d9-bb97-46a2-8ada-052d1164da47 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1366 microversion: 2.57 time: 0.399124 Oct 12 13:30:21.584440 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 853/1730] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:21 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:22.618664 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-015bc3b4-6b8d-46bd-917f-bc6f7c8e7d1b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:22.619299 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-015bc3b4-6b8d-46bd-917f-bc6f7c8e7d1b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:22.627326 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-015bc3b4-6b8d-46bd-917f-bc6f7c8e7d1b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:22.646237 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-015bc3b4-6b8d-46bd-917f-bc6f7c8e7d1b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:22.646839 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-015bc3b4-6b8d-46bd-917f-bc6f7c8e7d1b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:22.647612 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-015bc3b4-6b8d-46bd-917f-bc6f7c8e7d1b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:22.648080 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-015bc3b4-6b8d-46bd-917f-bc6f7c8e7d1b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:22.657953 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-015bc3b4-6b8d-46bd-917f-bc6f7c8e7d1b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:22.988289 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-015bc3b4-6b8d-46bd-917f-bc6f7c8e7d1b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:23.024654 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-015bc3b4-6b8d-46bd-917f-bc6f7c8e7d1b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:23.039631 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-015bc3b4-6b8d-46bd-917f-bc6f7c8e7d1b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:23.044115 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-015bc3b4-6b8d-46bd-917f-bc6f7c8e7d1b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1366 microversion: 2.57 time: 0.432821 Oct 12 13:30:23.048448 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 878/1731] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:22 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1366 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:23.248763 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e3f2de94-89c3-4eea-bab1-200b2b5ce321 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] Action: 'create', calling method: .version_select at 0x7f8a9bd920d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-8919485", "metadata": {"Type": "work"}}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e3f2de94-89c3-4eea-bab1-200b2b5ce321 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] Request method failure captured: Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 119 Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsFuXutNEJS0H5shgMZvAeuhI9js0MWWpkog2_MG3X3WrDwfb-yhTW_JNbL9nehWtNUjGWMtD7K_9TGHeLT1MzkIk2vFZdIDCyL_f-dJZzwJA_TputFRLQeyywSlwmQ8wuxSPyK9AVr-hQbm9jrllSWecABy4JcA6aW5Qon5xjfMR58 Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 0c22e3333c394949bb991e14e9e66d40 Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-VolumesNegativeTest-398206964 Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0c22e3333c394949bb991e14e9e66d40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0c22e3333c394949bb991e14e9e66d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c22e3333c394949bb991e14e9e66d40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c22e3333c394949bb991e14e9e66d40"}]}] Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-VolumesNegativeTest-398206964 Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 0c22e3333c394949bb991e14e9e66d40 Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-VolumesNegativeTest-398206964 Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-VolumesNegativeTest-398206964-project Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: c52496eb87f14e01847ef38f786ed948 Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-VolumesNegativeTest-398206964-project Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-8919485", "metadata": {"Type": "work"}}} Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-8919485', 'metadata': {'Type': 'work'}}}} Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise error Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi '#$%' Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 13:30:23.262261 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 13:30:23.266920 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 12 13:30:23.266920 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.266920 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:23.266920 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.266920 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:23.266920 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:23.266920 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:23.266920 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 13:30:23.266920 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 13:30:23.266920 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 12 13:30:23.266920 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.266920 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e3f2de94-89c3-4eea-bab1-200b2b5ce321 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:30:23.266920 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e3f2de94-89c3-4eea-bab1-200b2b5ce321 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.430400 Oct 12 13:30:23.268849 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 854/1732] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Oct 12 13:30:22 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 433 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 12 13:30:23.275431 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-18d60a0f-4045-4c28-8367-70f2891afaa2 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] Action: 'create', calling method: .version_select at 0x7f8a9bd38ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-752885071", "metadata": {"Type": "work"}}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-18d60a0f-4045-4c28-8367-70f2891afaa2 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] Request method failure captured: Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 119 Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsFuXutNEJS0H5shgMZvAeuhI9js0MWWpkog2_MG3X3WrDwfb-yhTW_JNbL9nehWtNUjGWMtD7K_9TGHeLT1MzkIk2vFZdIDCyL_f-dJZzwJA_TputFRLQeyywSlwmQ8wuxSPyK9AVr-hQbm9jrllSWecABy4JcA6aW5Qon5xjfMR58 Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 0c22e3333c394949bb991e14e9e66d40 Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-VolumesNegativeTest-398206964 Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0c22e3333c394949bb991e14e9e66d40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0c22e3333c394949bb991e14e9e66d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c22e3333c394949bb991e14e9e66d40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c22e3333c394949bb991e14e9e66d40"}]}] Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-VolumesNegativeTest-398206964 Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 0c22e3333c394949bb991e14e9e66d40 Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-VolumesNegativeTest-398206964 Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-VolumesNegativeTest-398206964-project Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: c52496eb87f14e01847ef38f786ed948 Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-VolumesNegativeTest-398206964-project Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-752885071", "metadata": {"Type": "work"}}} Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-752885071', 'metadata': {'Type': 'work'}}}} Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise error Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi '0' Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 13:30:23.279425 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 13:30:23.288314 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 12 13:30:23.288314 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.288314 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:23.288314 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.288314 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:23.288314 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:23.288314 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:23.288314 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 13:30:23.288314 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 13:30:23.288314 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 12 13:30:23.288314 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.288314 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-18d60a0f-4045-4c28-8367-70f2891afaa2 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:30:23.289814 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-18d60a0f-4045-4c28-8367-70f2891afaa2 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017725 Oct 12 13:30:23.292535 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 879/1733] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Oct 12 13:30:23 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:30:23.324422 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-db5eacfa-fed6-40a5-baec-de04814d79e4 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] Action: 'create', calling method: .version_select at 0x7f8a9b5f1f70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-603399269", "metadata": {"Type": "work"}}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-db5eacfa-fed6-40a5-baec-de04814d79e4 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] Request method failure captured: Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 118 Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsFuXutNEJS0H5shgMZvAeuhI9js0MWWpkog2_MG3X3WrDwfb-yhTW_JNbL9nehWtNUjGWMtD7K_9TGHeLT1MzkIk2vFZdIDCyL_f-dJZzwJA_TputFRLQeyywSlwmQ8wuxSPyK9AVr-hQbm9jrllSWecABy4JcA6aW5Qon5xjfMR58 Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 0c22e3333c394949bb991e14e9e66d40 Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-VolumesNegativeTest-398206964 Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0c22e3333c394949bb991e14e9e66d40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0c22e3333c394949bb991e14e9e66d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c22e3333c394949bb991e14e9e66d40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c22e3333c394949bb991e14e9e66d40"}]}] Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-VolumesNegativeTest-398206964 Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 0c22e3333c394949bb991e14e9e66d40 Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-VolumesNegativeTest-398206964 Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-VolumesNegativeTest-398206964-project Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: c52496eb87f14e01847ef38f786ed948 Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-VolumesNegativeTest-398206964-project Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-603399269", "metadata": {"Type": "work"}}} Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-603399269', 'metadata': {'Type': 'work'}}}} Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise error Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi '' Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 13:30:23.337675 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 13:30:23.342868 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 12 13:30:23.342868 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.342868 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:23.342868 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.342868 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:23.342868 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:23.342868 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:23.342868 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 13:30:23.342868 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 13:30:23.342868 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 12 13:30:23.342868 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.344451 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-db5eacfa-fed6-40a5-baec-de04814d79e4 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:30:23.347427 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-db5eacfa-fed6-40a5-baec-de04814d79e4 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.032804 Oct 12 13:30:23.360500 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 855/1734] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Oct 12 13:30:23 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:30:23.368024 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-22629854-236a-4014-bb4b-4af89e1b9853 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] Calling method '.version_select at 0x7f8a9b8e94c0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:23.410013 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-22629854-236a-4014-bb4b-4af89e1b9853 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] HTTP exception thrown: Volume tempest-invalid-297780668 could not be found. Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-22629854-236a-4014-bb4b-4af89e1b9853 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] Request method failure captured: Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-297780668 HTTP/1.1 Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsFuXutNEJS0H5shgMZvAeuhI9js0MWWpkog2_MG3X3WrDwfb-yhTW_JNbL9nehWtNUjGWMtD7K_9TGHeLT1MzkIk2vFZdIDCyL_f-dJZzwJA_TputFRLQeyywSlwmQ8wuxSPyK9AVr-hQbm9jrllSWecABy4JcA6aW5Qon5xjfMR58 Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 0c22e3333c394949bb991e14e9e66d40 Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-VolumesNegativeTest-398206964 Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0c22e3333c394949bb991e14e9e66d40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0c22e3333c394949bb991e14e9e66d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c22e3333c394949bb991e14e9e66d40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c22e3333c394949bb991e14e9e66d40"}]}] Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-VolumesNegativeTest-398206964 Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 0c22e3333c394949bb991e14e9e66d40 Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-VolumesNegativeTest-398206964 Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-VolumesNegativeTest-398206964-project Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: c52496eb87f14e01847ef38f786ed948 Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-VolumesNegativeTest-398206964-project Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: exception: Volume tempest-invalid-297780668 could not be found. Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'tempest-invalid-297780668'} Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-297780668 could not be found. (HTTP 404) (Request-ID: req-82952264-6a14-4f12-9052-6e3d3419f563) Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 13:30:23.419194 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-297780668 could not be found. Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-297780668 could not be found. Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-297780668 could not be found. Oct 12 13:30:23.423048 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.435248 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-22629854-236a-4014-bb4b-4af89e1b9853 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] Returning 404 to user: Volume tempest-invalid-297780668 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:30:23.436213 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-22629854-236a-4014-bb4b-4af89e1b9853 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-297780668" status: 404 len: 98 microversion: 2.1 time: 0.074173 Oct 12 13:30:23.437203 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 880/1735] 10.222.0.52 () {58 vars in 1215 bytes} [Wed Oct 12 13:30:23 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-297780668 => generated 98 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:30:23.449112 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2d012dae-b909-45be-bc46-bb8b4765dddc tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004198 Oct 12 13:30:23.450142 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 856/1736] 10.222.0.52 () {58 vars in 1140 bytes} [Wed Oct 12 13:30:23 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 12 13:30:23.466440 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-192e9235-2b26-4ed8-a134-16a629b6359e tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008481 Oct 12 13:30:23.467716 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 881/1737] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:30:23 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 12 13:30:23.480580 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-92478f6b-1e66-422e-9cd6-92681486ba55 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] Calling method '.version_select at 0x7f8a9bd92550>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:23.583751 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-92478f6b-1e66-422e-9cd6-92681486ba55 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] HTTP exception thrown: Volume 2fc5327c-8c35-4300-8330-31ffdd8a190e could not be found. Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-92478f6b-1e66-422e-9cd6-92681486ba55 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] Request method failure captured: Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: request: DELETE /compute/v2.1/os-volumes/2fc5327c-8c35-4300-8330-31ffdd8a190e HTTP/1.1 Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsFuXutNEJS0H5shgMZvAeuhI9js0MWWpkog2_MG3X3WrDwfb-yhTW_JNbL9nehWtNUjGWMtD7K_9TGHeLT1MzkIk2vFZdIDCyL_f-dJZzwJA_TputFRLQeyywSlwmQ8wuxSPyK9AVr-hQbm9jrllSWecABy4JcA6aW5Qon5xjfMR58 Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 0c22e3333c394949bb991e14e9e66d40 Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-VolumesNegativeTest-398206964 Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0c22e3333c394949bb991e14e9e66d40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0c22e3333c394949bb991e14e9e66d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c22e3333c394949bb991e14e9e66d40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c22e3333c394949bb991e14e9e66d40"}]}] Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-VolumesNegativeTest-398206964 Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 0c22e3333c394949bb991e14e9e66d40 Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-VolumesNegativeTest-398206964 Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-VolumesNegativeTest-398206964-project Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: c52496eb87f14e01847ef38f786ed948 Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-VolumesNegativeTest-398206964-project Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: exception: Volume 2fc5327c-8c35-4300-8330-31ffdd8a190e could not be found. Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '2fc5327c-8c35-4300-8330-31ffdd8a190e'} Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2fc5327c-8c35-4300-8330-31ffdd8a190e could not be found. (HTTP 404) (Request-ID: req-49d90fda-7bcc-4451-bd36-dca1f909f83e) Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 13:30:23.588566 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2fc5327c-8c35-4300-8330-31ffdd8a190e could not be found. Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2fc5327c-8c35-4300-8330-31ffdd8a190e could not be found. Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2fc5327c-8c35-4300-8330-31ffdd8a190e could not be found. Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-92478f6b-1e66-422e-9cd6-92681486ba55 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] Returning 404 to user: Volume 2fc5327c-8c35-4300-8330-31ffdd8a190e could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-92478f6b-1e66-422e-9cd6-92681486ba55 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/2fc5327c-8c35-4300-8330-31ffdd8a190e" status: 404 len: 109 microversion: 2.1 time: 0.116257 Oct 12 13:30:23.601168 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 857/1738] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 12 13:30:23 2022] DELETE /compute/v2.1/os-volumes/2fc5327c-8c35-4300-8330-31ffdd8a190e => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:30:23.611235 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e2e76753-7f73-4436-a00a-09980c28fc12 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] Calling method '.version_select at 0x7f8a9b9fd160>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-e2e76753-7f73-4436-a00a-09980c28fc12 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] HTTP exception thrown: Volume 56737738-1433-4715-b6f6-aa37c0ef517a could not be found. Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e2e76753-7f73-4436-a00a-09980c28fc12 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] Request method failure captured: Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-volumes/56737738-1433-4715-b6f6-aa37c0ef517a HTTP/1.1 Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsFuXutNEJS0H5shgMZvAeuhI9js0MWWpkog2_MG3X3WrDwfb-yhTW_JNbL9nehWtNUjGWMtD7K_9TGHeLT1MzkIk2vFZdIDCyL_f-dJZzwJA_TputFRLQeyywSlwmQ8wuxSPyK9AVr-hQbm9jrllSWecABy4JcA6aW5Qon5xjfMR58 Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 0c22e3333c394949bb991e14e9e66d40 Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-VolumesNegativeTest-398206964 Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0c22e3333c394949bb991e14e9e66d40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0c22e3333c394949bb991e14e9e66d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c22e3333c394949bb991e14e9e66d40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c22e3333c394949bb991e14e9e66d40"}]}] Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-VolumesNegativeTest-398206964 Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 0c22e3333c394949bb991e14e9e66d40 Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-VolumesNegativeTest-398206964 Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-VolumesNegativeTest-398206964-project Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: c52496eb87f14e01847ef38f786ed948 Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-VolumesNegativeTest-398206964-project Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: exception: Volume 56737738-1433-4715-b6f6-aa37c0ef517a could not be found. Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '56737738-1433-4715-b6f6-aa37c0ef517a'} Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 56737738-1433-4715-b6f6-aa37c0ef517a could not be found. (HTTP 404) (Request-ID: req-12fdc5ca-75e1-497a-88dc-bb7fb5317407) Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 13:30:23.697874 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 56737738-1433-4715-b6f6-aa37c0ef517a could not be found. Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 56737738-1433-4715-b6f6-aa37c0ef517a could not be found. Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 56737738-1433-4715-b6f6-aa37c0ef517a could not be found. Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e2e76753-7f73-4436-a00a-09980c28fc12 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] Returning 404 to user: Volume 56737738-1433-4715-b6f6-aa37c0ef517a could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e2e76753-7f73-4436-a00a-09980c28fc12 tempest-VolumesNegativeTest-398206964 tempest-VolumesNegativeTest-398206964-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/56737738-1433-4715-b6f6-aa37c0ef517a" status: 404 len: 109 microversion: 2.1 time: 0.089054 Oct 12 13:30:23.702338 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 882/1739] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:30:23 2022] GET /compute/v2.1/os-volumes/56737738-1433-4715-b6f6-aa37c0ef517a => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:30:24.082031 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-79a06794-a750-4e7f-9e66-07d6040f9fb2 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:24.083016 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-79a06794-a750-4e7f-9e66-07d6040f9fb2 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:24.099783 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79a06794-a750-4e7f-9e66-07d6040f9fb2 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:24.100728 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79a06794-a750-4e7f-9e66-07d6040f9fb2 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:24.101778 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79a06794-a750-4e7f-9e66-07d6040f9fb2 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:24.102722 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79a06794-a750-4e7f-9e66-07d6040f9fb2 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:24.103384 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79a06794-a750-4e7f-9e66-07d6040f9fb2 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:24.104056 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79a06794-a750-4e7f-9e66-07d6040f9fb2 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:24.607306 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-79a06794-a750-4e7f-9e66-07d6040f9fb2 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:24.624644 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-79a06794-a750-4e7f-9e66-07d6040f9fb2 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:24.630106 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-79a06794-a750-4e7f-9e66-07d6040f9fb2 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:24.635210 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-79a06794-a750-4e7f-9e66-07d6040f9fb2 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1366 microversion: 2.57 time: 0.554523 Oct 12 13:30:24.635834 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 858/1740] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:24 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1366 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:25.668175 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5c10875a-ead5-4114-807a-cc7011125f28 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:25.668706 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-5c10875a-ead5-4114-807a-cc7011125f28 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:25.686161 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5c10875a-ead5-4114-807a-cc7011125f28 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:25.703683 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5c10875a-ead5-4114-807a-cc7011125f28 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:25.704727 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5c10875a-ead5-4114-807a-cc7011125f28 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:25.706344 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5c10875a-ead5-4114-807a-cc7011125f28 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:25.707040 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5c10875a-ead5-4114-807a-cc7011125f28 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:25.708720 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5c10875a-ead5-4114-807a-cc7011125f28 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:26.201728 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-5c10875a-ead5-4114-807a-cc7011125f28 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:26.217811 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-5c10875a-ead5-4114-807a-cc7011125f28 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:26.223114 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-5c10875a-ead5-4114-807a-cc7011125f28 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:26.229286 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5c10875a-ead5-4114-807a-cc7011125f28 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1366 microversion: 2.57 time: 0.565377 Oct 12 13:30:26.233471 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 883/1741] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:25 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1366 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:27.266857 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0d7928f5-b5d2-4b2b-90f1-c3e27d2d1110 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:27.273325 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-0d7928f5-b5d2-4b2b-90f1-c3e27d2d1110 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:27.309715 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0d7928f5-b5d2-4b2b-90f1-c3e27d2d1110 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:27.322166 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0d7928f5-b5d2-4b2b-90f1-c3e27d2d1110 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:27.326295 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0d7928f5-b5d2-4b2b-90f1-c3e27d2d1110 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:27.327943 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0d7928f5-b5d2-4b2b-90f1-c3e27d2d1110 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:27.342434 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0d7928f5-b5d2-4b2b-90f1-c3e27d2d1110 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:27.344706 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0d7928f5-b5d2-4b2b-90f1-c3e27d2d1110 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:27.650751 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-0d7928f5-b5d2-4b2b-90f1-c3e27d2d1110 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:27.671097 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-0d7928f5-b5d2-4b2b-90f1-c3e27d2d1110 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:27.675586 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-0d7928f5-b5d2-4b2b-90f1-c3e27d2d1110 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:27.683409 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0d7928f5-b5d2-4b2b-90f1-c3e27d2d1110 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1366 microversion: 2.57 time: 0.425167 Oct 12 13:30:27.684866 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 884/1742] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:27 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1366 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:28.034306 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-302b5dc7-4853-4545-9352-4d7e0bdba826 tempest-FloatingIPsNegativeTestJSON-1060221837 tempest-FloatingIPsNegativeTestJSON-1060221837-project] Calling method '.version_select at 0x7f8a9ba13790>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:28.195338 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-302b5dc7-4853-4545-9352-4d7e0bdba826 tempest-FloatingIPsNegativeTestJSON-1060221837 tempest-FloatingIPsNegativeTestJSON-1060221837-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 1.106392 Oct 12 13:30:28.196110 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 859/1743] 10.222.0.52 () {58 vars in 1149 bytes} [Wed Oct 12 13:30:27 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:30:28.213478 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ac7c3f42-3267-4eab-bdd6-7459184bc32a tempest-FloatingIPsNegativeTestJSON-1060221837 tempest-FloatingIPsNegativeTestJSON-1060221837-project] Action: 'create', calling method: .version_select at 0x7f8a9b8e9b80>, body: {"pool": "non_exist_pool"} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:30:28.345617 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-ac7c3f42-3267-4eab-bdd6-7459184bc32a tempest-FloatingIPsNegativeTestJSON-1060221837 tempest-FloatingIPsNegativeTestJSON-1060221837-project] HTTP exception thrown: Floating IP pool not found. Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ac7c3f42-3267-4eab-bdd6-7459184bc32a tempest-FloatingIPsNegativeTestJSON-1060221837 tempest-FloatingIPsNegativeTestJSON-1060221837-project] Request method failure captured: Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 26 Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsFyiuQDhaGkmKlbp5SqpPz_Pc6RwbxVaeS5XQsMZPIcQHzZ0l9ECMoa0Wf82F8cx3ZhxyJ8zMd6-zBLOGiohYtOndduGMoguHrPre3xgpxh9bTFeCZTdJbHRLBjIeHvYxslPtYDlUUW4eIg1bp1n4kUDZCWm_oYmGz2z-0DOKb1QO8 Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: d7c6b0793da9495fab08b394d9dadb8f Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1060221837 Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d7c6b0793da9495fab08b394d9dadb8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d7c6b0793da9495fab08b394d9dadb8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d7c6b0793da9495fab08b394d9dadb8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d7c6b0793da9495fab08b394d9dadb8f"}]}] Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1060221837 Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: d7c6b0793da9495fab08b394d9dadb8f Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1060221837 Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-FloatingIPsNegativeTestJSON-1060221837-project Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: e9db6dc2a02246b2a713652775d54b15 Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1060221837-project Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: {"pool": "non_exist_pool"} Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: exception: Floating IP pool not found. Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:30:28.348615 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:30:28.356485 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 12 13:30:28.356485 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:28.356485 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ac7c3f42-3267-4eab-bdd6-7459184bc32a tempest-FloatingIPsNegativeTestJSON-1060221837 tempest-FloatingIPsNegativeTestJSON-1060221837-project] Returning 404 to user: Floating IP pool not found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:30:28.356485 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ac7c3f42-3267-4eab-bdd6-7459184bc32a tempest-FloatingIPsNegativeTestJSON-1060221837 tempest-FloatingIPsNegativeTestJSON-1060221837-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.141311 Oct 12 13:30:28.356485 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 885/1744] 10.222.0.52 () {60 vars in 1170 bytes} [Wed Oct 12 13:30:28 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:30:28.363771 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a4e5254b-84dd-4456-b5c6-10c719dc6cd4 tempest-FloatingIPsNegativeTestJSON-1060221837 tempest-FloatingIPsNegativeTestJSON-1060221837-project] Calling method '.version_select at 0x7f8a9b68e550>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:28.553497 n-d-861076-2 devstack@n-api.service[120932]: DEBUG neutronclient.v2_0.client [None req-a4e5254b-84dd-4456-b5c6-10c719dc6cd4 tempest-FloatingIPsNegativeTestJSON-1060221837 tempest-FloatingIPsNegativeTestJSON-1060221837-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 12dc7cf7-fcbd-4ad2-b56c-099bd3a0ec5e could not be found", "detail": ""}} {{(pid=120932) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 13:30:28.555702 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-a4e5254b-84dd-4456-b5c6-10c719dc6cd4 tempest-FloatingIPsNegativeTestJSON-1060221837 tempest-FloatingIPsNegativeTestJSON-1060221837-project] HTTP exception thrown: Floating IP not found for ID 12dc7cf7-fcbd-4ad2-b56c-099bd3a0ec5e Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a4e5254b-84dd-4456-b5c6-10c719dc6cd4 tempest-FloatingIPsNegativeTestJSON-1060221837 tempest-FloatingIPsNegativeTestJSON-1060221837-project] Request method failure captured: Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: request: DELETE /compute/v2.1/os-floating-ips/12dc7cf7-fcbd-4ad2-b56c-099bd3a0ec5e HTTP/1.1 Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsFyiuQDhaGkmKlbp5SqpPz_Pc6RwbxVaeS5XQsMZPIcQHzZ0l9ECMoa0Wf82F8cx3ZhxyJ8zMd6-zBLOGiohYtOndduGMoguHrPre3xgpxh9bTFeCZTdJbHRLBjIeHvYxslPtYDlUUW4eIg1bp1n4kUDZCWm_oYmGz2z-0DOKb1QO8 Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: d7c6b0793da9495fab08b394d9dadb8f Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1060221837 Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d7c6b0793da9495fab08b394d9dadb8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d7c6b0793da9495fab08b394d9dadb8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d7c6b0793da9495fab08b394d9dadb8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d7c6b0793da9495fab08b394d9dadb8f"}]}] Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1060221837 Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: d7c6b0793da9495fab08b394d9dadb8f Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1060221837 Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-FloatingIPsNegativeTestJSON-1060221837-project Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: e9db6dc2a02246b2a713652775d54b15 Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1060221837-project Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: exception: Floating IP not found for ID 12dc7cf7-fcbd-4ad2-b56c-099bd3a0ec5e Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '12dc7cf7-fcbd-4ad2-b56c-099bd3a0ec5e'} Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 12dc7cf7-fcbd-4ad2-b56c-099bd3a0ec5e could not be found Oct 12 13:30:28.559468 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df1600df-8fb5-4ba2-818c-e4b4677848dc'] Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 12dc7cf7-fcbd-4ad2-b56c-099bd3a0ec5e. Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 12dc7cf7-fcbd-4ad2-b56c-099bd3a0ec5e Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 12dc7cf7-fcbd-4ad2-b56c-099bd3a0ec5e Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a4e5254b-84dd-4456-b5c6-10c719dc6cd4 tempest-FloatingIPsNegativeTestJSON-1060221837 tempest-FloatingIPsNegativeTestJSON-1060221837-project] Returning 404 to user: Floating IP not found for ID 12dc7cf7-fcbd-4ad2-b56c-099bd3a0ec5e {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a4e5254b-84dd-4456-b5c6-10c719dc6cd4 tempest-FloatingIPsNegativeTestJSON-1060221837 tempest-FloatingIPsNegativeTestJSON-1060221837-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/12dc7cf7-fcbd-4ad2-b56c-099bd3a0ec5e" status: 404 len: 111 microversion: 2.1 time: 0.203388 Oct 12 13:30:28.567759 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 860/1745] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 12 13:30:28 2022] DELETE /compute/v2.1/os-floating-ips/12dc7cf7-fcbd-4ad2-b56c-099bd3a0ec5e => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:30:28.719265 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-197f7966-41b2-4d49-9ee3-0f3cc0395a50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:28.724215 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-197f7966-41b2-4d49-9ee3-0f3cc0395a50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:28.753985 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-197f7966-41b2-4d49-9ee3-0f3cc0395a50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:28.754756 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-197f7966-41b2-4d49-9ee3-0f3cc0395a50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:28.756052 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-197f7966-41b2-4d49-9ee3-0f3cc0395a50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:28.757732 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-197f7966-41b2-4d49-9ee3-0f3cc0395a50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:28.770282 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-197f7966-41b2-4d49-9ee3-0f3cc0395a50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:28.773285 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-197f7966-41b2-4d49-9ee3-0f3cc0395a50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:29.034532 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-197f7966-41b2-4d49-9ee3-0f3cc0395a50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:29.056454 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-197f7966-41b2-4d49-9ee3-0f3cc0395a50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:29.078338 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-197f7966-41b2-4d49-9ee3-0f3cc0395a50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:29.080402 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-197f7966-41b2-4d49-9ee3-0f3cc0395a50 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1366 microversion: 2.57 time: 0.367802 Oct 12 13:30:29.099361 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 886/1746] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:28 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1366 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:30.144550 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3fcd7948-82bf-4540-945a-ac3e6acff4ab tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:30.144550 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3fcd7948-82bf-4540-945a-ac3e6acff4ab tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:30.170300 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3fcd7948-82bf-4540-945a-ac3e6acff4ab tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:30.171632 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3fcd7948-82bf-4540-945a-ac3e6acff4ab tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:30.172269 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3fcd7948-82bf-4540-945a-ac3e6acff4ab tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:30.173657 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3fcd7948-82bf-4540-945a-ac3e6acff4ab tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:30.178733 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3fcd7948-82bf-4540-945a-ac3e6acff4ab tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:30.179869 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3fcd7948-82bf-4540-945a-ac3e6acff4ab tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:30.523149 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-3fcd7948-82bf-4540-945a-ac3e6acff4ab tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:30.540599 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-3fcd7948-82bf-4540-945a-ac3e6acff4ab tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:30.542838 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-3fcd7948-82bf-4540-945a-ac3e6acff4ab tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:30.547663 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3fcd7948-82bf-4540-945a-ac3e6acff4ab tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1366 microversion: 2.57 time: 0.414609 Oct 12 13:30:30.548761 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 861/1747] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:30 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1366 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:31.580261 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e25b28e8-ba54-4f62-a650-790b667a2407 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:31.581890 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-e25b28e8-ba54-4f62-a650-790b667a2407 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:31.629216 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e25b28e8-ba54-4f62-a650-790b667a2407 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:31.629727 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e25b28e8-ba54-4f62-a650-790b667a2407 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:31.633484 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e25b28e8-ba54-4f62-a650-790b667a2407 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:31.637953 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e25b28e8-ba54-4f62-a650-790b667a2407 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:31.638699 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e25b28e8-ba54-4f62-a650-790b667a2407 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:31.639331 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-e25b28e8-ba54-4f62-a650-790b667a2407 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:32.660873 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e25b28e8-ba54-4f62-a650-790b667a2407 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:32.691492 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e25b28e8-ba54-4f62-a650-790b667a2407 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:32.697086 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-e25b28e8-ba54-4f62-a650-790b667a2407 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:32.709132 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e25b28e8-ba54-4f62-a650-790b667a2407 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1366 microversion: 2.57 time: 1.122826 Oct 12 13:30:32.723239 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 887/1748] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:31 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1366 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:30:33.800271 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b6970775-8848-4dd7-92c8-717d95580aae tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:33.800271 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b6970775-8848-4dd7-92c8-717d95580aae tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:33.800271 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b6970775-8848-4dd7-92c8-717d95580aae tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:33.800271 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b6970775-8848-4dd7-92c8-717d95580aae tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:33.800271 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b6970775-8848-4dd7-92c8-717d95580aae tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:33.800271 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b6970775-8848-4dd7-92c8-717d95580aae tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:33.800271 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b6970775-8848-4dd7-92c8-717d95580aae tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:33.800271 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b6970775-8848-4dd7-92c8-717d95580aae tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:33.813087 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-b6970775-8848-4dd7-92c8-717d95580aae tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:33.840639 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-b6970775-8848-4dd7-92c8-717d95580aae tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:33.844254 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-b6970775-8848-4dd7-92c8-717d95580aae tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:33.847404 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b6970775-8848-4dd7-92c8-717d95580aae tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1366 microversion: 2.57 time: 0.123121 Oct 12 13:30:33.863713 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 862/1749] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:33 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1366 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:34.883328 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fb25942c-1c2a-414b-8b88-3c6d079907e4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:34.883951 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-fb25942c-1c2a-414b-8b88-3c6d079907e4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:34.901650 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb25942c-1c2a-414b-8b88-3c6d079907e4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:34.903085 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb25942c-1c2a-414b-8b88-3c6d079907e4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:34.903085 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb25942c-1c2a-414b-8b88-3c6d079907e4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:34.903810 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb25942c-1c2a-414b-8b88-3c6d079907e4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:34.904498 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb25942c-1c2a-414b-8b88-3c6d079907e4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:34.905112 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb25942c-1c2a-414b-8b88-3c6d079907e4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:34.908388 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=73 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:30:36.065207 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-fb25942c-1c2a-414b-8b88-3c6d079907e4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:36.085534 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-fb25942c-1c2a-414b-8b88-3c6d079907e4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:36.085534 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-fb25942c-1c2a-414b-8b88-3c6d079907e4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:36.085534 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fb25942c-1c2a-414b-8b88-3c6d079907e4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1366 microversion: 2.57 time: 1.204858 Oct 12 13:30:36.085534 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 888/1750] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:34 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1366 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:37.116830 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f0470c02-a0c4-4354-b067-347c63803586 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:37.118324 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f0470c02-a0c4-4354-b067-347c63803586 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:37.135320 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0470c02-a0c4-4354-b067-347c63803586 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:37.136041 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0470c02-a0c4-4354-b067-347c63803586 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:37.136627 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0470c02-a0c4-4354-b067-347c63803586 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:37.137530 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0470c02-a0c4-4354-b067-347c63803586 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:37.139397 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0470c02-a0c4-4354-b067-347c63803586 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:37.140006 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0470c02-a0c4-4354-b067-347c63803586 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:37.410797 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f0470c02-a0c4-4354-b067-347c63803586 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:37.435201 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f0470c02-a0c4-4354-b067-347c63803586 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:37.436648 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f0470c02-a0c4-4354-b067-347c63803586 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:37.441089 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f0470c02-a0c4-4354-b067-347c63803586 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1366 microversion: 2.57 time: 0.331787 Oct 12 13:30:37.443153 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 863/1751] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:37 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:38.478516 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5e90b01e-1725-41a4-8e68-5a8bd1eccab8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:38.479896 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-5e90b01e-1725-41a4-8e68-5a8bd1eccab8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:38.513556 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5e90b01e-1725-41a4-8e68-5a8bd1eccab8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:38.518938 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5e90b01e-1725-41a4-8e68-5a8bd1eccab8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:38.518938 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5e90b01e-1725-41a4-8e68-5a8bd1eccab8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:38.520595 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5e90b01e-1725-41a4-8e68-5a8bd1eccab8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:38.523338 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5e90b01e-1725-41a4-8e68-5a8bd1eccab8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:38.524413 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-5e90b01e-1725-41a4-8e68-5a8bd1eccab8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:38.642059 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-5e90b01e-1725-41a4-8e68-5a8bd1eccab8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:38.653735 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-5e90b01e-1725-41a4-8e68-5a8bd1eccab8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:38.655857 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-5e90b01e-1725-41a4-8e68-5a8bd1eccab8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:38.657439 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5e90b01e-1725-41a4-8e68-5a8bd1eccab8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1372 microversion: 2.57 time: 0.185521 Oct 12 13:30:38.658589 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 889/1752] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:38 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1372 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:39.698659 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-aeef71eb-4280-4d5a-a444-03ed3aeec0f4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:39.699662 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-aeef71eb-4280-4d5a-a444-03ed3aeec0f4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:39.716731 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aeef71eb-4280-4d5a-a444-03ed3aeec0f4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:39.718614 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aeef71eb-4280-4d5a-a444-03ed3aeec0f4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:39.719840 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aeef71eb-4280-4d5a-a444-03ed3aeec0f4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:39.728075 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aeef71eb-4280-4d5a-a444-03ed3aeec0f4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:39.728075 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aeef71eb-4280-4d5a-a444-03ed3aeec0f4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:39.728075 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aeef71eb-4280-4d5a-a444-03ed3aeec0f4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:39.843113 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-aeef71eb-4280-4d5a-a444-03ed3aeec0f4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:39.855761 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-aeef71eb-4280-4d5a-a444-03ed3aeec0f4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:39.860059 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-aeef71eb-4280-4d5a-a444-03ed3aeec0f4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:39.860059 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-aeef71eb-4280-4d5a-a444-03ed3aeec0f4 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1372 microversion: 2.57 time: 0.172326 Oct 12 13:30:39.873466 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 864/1753] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:39 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:40.887073 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3314e767-18d3-42b4-9887-85219158c77b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:40.887687 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-3314e767-18d3-42b4-9887-85219158c77b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:40.903318 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3314e767-18d3-42b4-9887-85219158c77b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:40.903318 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3314e767-18d3-42b4-9887-85219158c77b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:40.903318 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3314e767-18d3-42b4-9887-85219158c77b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:40.910136 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3314e767-18d3-42b4-9887-85219158c77b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:40.910920 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3314e767-18d3-42b4-9887-85219158c77b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:40.911769 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3314e767-18d3-42b4-9887-85219158c77b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:41.043382 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-3314e767-18d3-42b4-9887-85219158c77b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:41.052301 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-3314e767-18d3-42b4-9887-85219158c77b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:41.055148 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-3314e767-18d3-42b4-9887-85219158c77b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:41.056662 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3314e767-18d3-42b4-9887-85219158c77b tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1372 microversion: 2.57 time: 0.174752 Oct 12 13:30:41.072235 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 890/1754] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:40 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1372 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:42.094481 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ee677935-0fd6-44b3-a527-d2503b6b3932 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:42.099140 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ee677935-0fd6-44b3-a527-d2503b6b3932 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:42.129560 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ee677935-0fd6-44b3-a527-d2503b6b3932 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:42.131673 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ee677935-0fd6-44b3-a527-d2503b6b3932 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:42.132664 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ee677935-0fd6-44b3-a527-d2503b6b3932 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:42.134000 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ee677935-0fd6-44b3-a527-d2503b6b3932 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:42.138522 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ee677935-0fd6-44b3-a527-d2503b6b3932 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:42.139504 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ee677935-0fd6-44b3-a527-d2503b6b3932 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:42.146380 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:30:42.258502 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-ee677935-0fd6-44b3-a527-d2503b6b3932 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:42.273408 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-ee677935-0fd6-44b3-a527-d2503b6b3932 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:42.275034 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-ee677935-0fd6-44b3-a527-d2503b6b3932 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:42.276217 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ee677935-0fd6-44b3-a527-d2503b6b3932 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1357 microversion: 2.57 time: 0.192773 Oct 12 13:30:42.277196 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 865/1755] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:42 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:42.310413 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d1605a5b-0f1c-48c4-ad2c-9ac3b84a5a1c tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:42.311523 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-d1605a5b-0f1c-48c4-ad2c-9ac3b84a5a1c tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:42.318306 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d1605a5b-0f1c-48c4-ad2c-9ac3b84a5a1c tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:42.319206 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d1605a5b-0f1c-48c4-ad2c-9ac3b84a5a1c tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:42.320734 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d1605a5b-0f1c-48c4-ad2c-9ac3b84a5a1c tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:42.321800 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d1605a5b-0f1c-48c4-ad2c-9ac3b84a5a1c tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:42.322413 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d1605a5b-0f1c-48c4-ad2c-9ac3b84a5a1c tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:42.323104 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d1605a5b-0f1c-48c4-ad2c-9ac3b84a5a1c tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:42.355632 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-d1605a5b-0f1c-48c4-ad2c-9ac3b84a5a1c tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Going to try to terminate instance {{(pid=120933) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:30:42.703435 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d1605a5b-0f1c-48c4-ad2c-9ac3b84a5a1c tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 204 len: 0 microversion: 2.57 time: 0.391613 Oct 12 13:30:42.703435 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 891/1756] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 12 13:30:42 2022] DELETE /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 13:30:42.709123 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8deda2fc-45fe-4e5b-986a-e3d51667d3b7 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:42.709972 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8deda2fc-45fe-4e5b-986a-e3d51667d3b7 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:42.717933 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=32 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:30:42.719554 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8deda2fc-45fe-4e5b-986a-e3d51667d3b7 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:42.720164 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8deda2fc-45fe-4e5b-986a-e3d51667d3b7 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:42.725460 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8deda2fc-45fe-4e5b-986a-e3d51667d3b7 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:42.738750 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8deda2fc-45fe-4e5b-986a-e3d51667d3b7 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:42.739556 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8deda2fc-45fe-4e5b-986a-e3d51667d3b7 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:42.740083 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8deda2fc-45fe-4e5b-986a-e3d51667d3b7 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:42.905782 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8deda2fc-45fe-4e5b-986a-e3d51667d3b7 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:42.919812 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8deda2fc-45fe-4e5b-986a-e3d51667d3b7 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:42.922324 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8deda2fc-45fe-4e5b-986a-e3d51667d3b7 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:42.923804 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8deda2fc-45fe-4e5b-986a-e3d51667d3b7 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1363 microversion: 2.57 time: 0.220424 Oct 12 13:30:42.931730 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 866/1757] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:42 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:43.557469 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-987bab83-8a95-44bb-8efa-dcd21c5d6296 tempest-AttachSCSIVolumeTestJSON-866050322 tempest-AttachSCSIVolumeTestJSON-866050322-project] Action: 'create', calling method: .version_select at 0x7f8a9bb788b0>, body: {"keypair": {"name": "tempest-keypair-1221716700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3CfO1ftA9VnZw8NXitrF2813eymRlpAYXOQcZPszIyrnMl1re9PozdwpNowcCx+PI/HOlp9sNqUfGQHUnUuLy8SWPNNJOBW7qARDciF0VngdxRn9NGfy33n+Zu57cKhw=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:30:43.573735 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-987bab83-8a95-44bb-8efa-dcd21c5d6296 tempest-AttachSCSIVolumeTestJSON-866050322 tempest-AttachSCSIVolumeTestJSON-866050322-project] Getting quotas for project 7fce18a3e9f94fd28e6fbfea081c5348. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:30:43.579883 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-987bab83-8a95-44bb-8efa-dcd21c5d6296 tempest-AttachSCSIVolumeTestJSON-866050322 tempest-AttachSCSIVolumeTestJSON-866050322-project] Getting quotas for user 40b9a108a82f4dc4bd5bd004b069637d and project 7fce18a3e9f94fd28e6fbfea081c5348. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:30:43.676852 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-987bab83-8a95-44bb-8efa-dcd21c5d6296 tempest-AttachSCSIVolumeTestJSON-866050322 tempest-AttachSCSIVolumeTestJSON-866050322-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.681246 Oct 12 13:30:43.677512 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 892/1758] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:30:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:30:43.954586 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8e7bf7f5-3e2e-4f23-89a5-ab28a06b1585 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:43.955302 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8e7bf7f5-3e2e-4f23-89a5-ab28a06b1585 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:43.963997 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8e7bf7f5-3e2e-4f23-89a5-ab28a06b1585 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:43.964569 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8e7bf7f5-3e2e-4f23-89a5-ab28a06b1585 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:43.965121 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8e7bf7f5-3e2e-4f23-89a5-ab28a06b1585 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:43.965886 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8e7bf7f5-3e2e-4f23-89a5-ab28a06b1585 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:43.966410 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8e7bf7f5-3e2e-4f23-89a5-ab28a06b1585 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:43.966900 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8e7bf7f5-3e2e-4f23-89a5-ab28a06b1585 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:44.056489 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8e7bf7f5-3e2e-4f23-89a5-ab28a06b1585 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:44.064966 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8e7bf7f5-3e2e-4f23-89a5-ab28a06b1585 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:44.066420 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8e7bf7f5-3e2e-4f23-89a5-ab28a06b1585 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:44.067581 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8e7bf7f5-3e2e-4f23-89a5-ab28a06b1585 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1363 microversion: 2.57 time: 0.118209 Oct 12 13:30:44.068357 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 867/1759] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:43 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1363 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 13:30:45.095947 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-67fb4ea8-8347-415b-a4e5-9501f94c59f8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:45.097547 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-67fb4ea8-8347-415b-a4e5-9501f94c59f8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:45.106529 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-67fb4ea8-8347-415b-a4e5-9501f94c59f8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:45.107304 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-67fb4ea8-8347-415b-a4e5-9501f94c59f8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:45.108221 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-67fb4ea8-8347-415b-a4e5-9501f94c59f8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:45.109231 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-67fb4ea8-8347-415b-a4e5-9501f94c59f8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:45.109959 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-67fb4ea8-8347-415b-a4e5-9501f94c59f8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:45.110600 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-67fb4ea8-8347-415b-a4e5-9501f94c59f8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:45.157331 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-67fb4ea8-8347-415b-a4e5-9501f94c59f8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:45.157864 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-67fb4ea8-8347-415b-a4e5-9501f94c59f8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:45.158473 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-67fb4ea8-8347-415b-a4e5-9501f94c59f8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:45.160095 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-67fb4ea8-8347-415b-a4e5-9501f94c59f8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lazy-loading 'fault' on Instance uuid 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:30:45.276948 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-67fb4ea8-8347-415b-a4e5-9501f94c59f8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:45.281203 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-67fb4ea8-8347-415b-a4e5-9501f94c59f8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:45.282966 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-67fb4ea8-8347-415b-a4e5-9501f94c59f8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d5ce13c7e64902a3af7af5341b7810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6016c32ac5f048e0a42f1dc200f7fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:30:45.285446 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-67fb4ea8-8347-415b-a4e5-9501f94c59f8 tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 200 len: 1368 microversion: 2.57 time: 0.195610 Oct 12 13:30:45.286665 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 893/1760] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:45 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 13:30:46.316966 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d304520a-ad7e-4187-b8d0-1f44e4bf2aee tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:46.318192 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d304520a-ad7e-4187-b8d0-1f44e4bf2aee tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] [instance: 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:30:46.331165 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d304520a-ad7e-4187-b8d0-1f44e4bf2aee tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:46.333981 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d304520a-ad7e-4187-b8d0-1f44e4bf2aee tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:46.335990 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d304520a-ad7e-4187-b8d0-1f44e4bf2aee tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:46.338607 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d304520a-ad7e-4187-b8d0-1f44e4bf2aee tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:30:46.339271 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d304520a-ad7e-4187-b8d0-1f44e4bf2aee tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:30:46.340854 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d304520a-ad7e-4187-b8d0-1f44e4bf2aee tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:30:46.359463 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-d304520a-ad7e-4187-b8d0-1f44e4bf2aee tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] HTTP exception thrown: Instance 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 could not be found. Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d304520a-ad7e-4187-b8d0-1f44e4bf2aee tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Request method failure captured: Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 HTTP/1.1 Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsFU3pj4BiKnsqypi8GnDPlpW_xgiDj_MAhB_2z5GzkfjdKDdDn3GpwyFTgjVuZlIwl21-QDEJmM_RIywayNUEA43WPajKlZ4xH3sJzxIqXYXpEFIcU7vW8YoBQzizGdtbpgjbdfi7RP6UA5ra29AAfJYRLv8M1RLyHWPOKwn51cQ70 Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: X-Openstack-Nova-Api-Version: 2.57 Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 6016c32ac5f048e0a42f1dc200f7fe79 Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServerShowV257Test-1598712046 Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6016c32ac5f048e0a42f1dc200f7fe79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6016c32ac5f048e0a42f1dc200f7fe79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6016c32ac5f048e0a42f1dc200f7fe79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6016c32ac5f048e0a42f1dc200f7fe79"}]}] Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServerShowV257Test-1598712046 Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 6016c32ac5f048e0a42f1dc200f7fe79 Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServerShowV257Test-1598712046 Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServerShowV257Test-1598712046-project Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 00d5ce13c7e64902a3af7af5341b7810 Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServerShowV257Test-1598712046-project Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 could not be found. Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84'} Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 could not be found. Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 could not be found. Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:46.361325 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:46.366077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:46.366077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:46.366077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:46.366077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:30:46.366077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:30:46.366077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 could not be found. Oct 12 13:30:46.366077 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:46.366077 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d304520a-ad7e-4187-b8d0-1f44e4bf2aee tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] Returning 404 to user: Instance 8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:30:46.366077 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d304520a-ad7e-4187-b8d0-1f44e4bf2aee tempest-ServerShowV257Test-1598712046 tempest-ServerShowV257Test-1598712046-project] 10.222.0.52 "GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84" status: 404 len: 111 microversion: 2.57 time: 0.053798 Oct 12 13:30:46.366690 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 868/1761] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Oct 12 13:30:46 2022] GET /compute/v2.1/servers/8b64d09e-2ff9-4d0c-9998-7b3a77f1cb84 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:30:47.124785 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f2a9764b-e241-4468-a844-b0ccd98e29af tempest-AttachSCSIVolumeTestJSON-866050322 tempest-AttachSCSIVolumeTestJSON-866050322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-103426003", "imageRef": "cba55252-1f6e-4373-8d72-911044d4c218", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b7ca6c81-0575-4f0b-be15-aa42cd846de3"}], "security_groups": [{"name": "tempest-securitygroup--1826106455"}], "key_name": "tempest-keypair-1221716700", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:30:47.144666 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:30:47.432423 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-f2a9764b-e241-4468-a844-b0ccd98e29af tempest-AttachSCSIVolumeTestJSON-866050322 tempest-AttachSCSIVolumeTestJSON-866050322-project] validate_networks() for [('b7ca6c81-0575-4f0b-be15-aa42cd846de3', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-f2a9764b-e241-4468-a844-b0ccd98e29af tempest-AttachSCSIVolumeTestJSON-866050322 tempest-AttachSCSIVolumeTestJSON-866050322-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fdb7d25f-8d27-48ac-8296-ad5d8bd886b8) Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:30:48.097541 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:30:48.100676 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:30:48.100676 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:30:48.100676 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:30:48.100676 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:30:48.100676 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:30:48.100676 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:30:48.100676 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:30:48.100676 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:30:48.100676 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:30:48.100676 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:30:48.100676 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:30:48.100676 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:30:48.100676 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:30:48.100676 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:30:48.100676 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:30:48.100676 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fdb7d25f-8d27-48ac-8296-ad5d8bd886b8) Oct 12 13:30:48.100676 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:48.100676 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-f2a9764b-e241-4468-a844-b0ccd98e29af tempest-AttachSCSIVolumeTestJSON-866050322 tempest-AttachSCSIVolumeTestJSON-866050322-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:30:48.100676 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f2a9764b-e241-4468-a844-b0ccd98e29af tempest-AttachSCSIVolumeTestJSON-866050322 tempest-AttachSCSIVolumeTestJSON-866050322-project] Request method failure captured: Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 486 Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsE8SPN6NjpVUpRb0cFluDHdznGwQKD8xRjm_7y2JSLaCBzX8UjKxkNl6HFe4rPU7qIc-05lYObaJuU0UBWoNcPOmAoLQoW4n5vGHvfvbiSm9KBnnKDP2345QRds1PsdcrEEXzRQ2IEcSfvq59oiCZFM59If3Mgivyjmty57nRN_Eso Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 7fce18a3e9f94fd28e6fbfea081c5348 Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-866050322 Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7fce18a3e9f94fd28e6fbfea081c5348"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7fce18a3e9f94fd28e6fbfea081c5348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7fce18a3e9f94fd28e6fbfea081c5348"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7fce18a3e9f94fd28e6fbfea081c5348"}]}] Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-866050322 Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 7fce18a3e9f94fd28e6fbfea081c5348 Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-866050322 Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AttachSCSIVolumeTestJSON-866050322-project Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 40b9a108a82f4dc4bd5bd004b069637d Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-866050322-project Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-103426003", "imageRef": "cba55252-1f6e-4373-8d72-911044d4c218", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b7ca6c81-0575-4f0b-be15-aa42cd846de3"}], "security_groups": [{"name": "tempest-securitygroup--1826106455"}], "key_name": "tempest-keypair-1221716700", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-AttachSCSIVolumeTestJSON-server-103426003', 'imageRef': 'cba55252-1f6e-4373-8d72-911044d4c218', 'flavorRef': '452', 'config_drive': True, 'networks': [{'uuid': 'b7ca6c81-0575-4f0b-be15-aa42cd846de3'}], 'security_groups': [{'name': 'tempest-securitygroup--1826106455'}], 'key_name': 'tempest-keypair-1221716700', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:30:48.104689 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fdb7d25f-8d27-48ac-8296-ad5d8bd886b8) Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:48.107913 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:48.112942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:48.112942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:30:48.112942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:30:48.112942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:30:48.112942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:30:48.112942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:30:48.112942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:48.112942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:48.112942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:48.112942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:48.112942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:48.112942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:48.112942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:48.112942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:30:48.112942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:30:48.112942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:30:48.112942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:48.112942 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:30:48.112942 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f2a9764b-e241-4468-a844-b0ccd98e29af tempest-AttachSCSIVolumeTestJSON-866050322 tempest-AttachSCSIVolumeTestJSON-866050322-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:30:48.112942 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:30:48.112942 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f2a9764b-e241-4468-a844-b0ccd98e29af tempest-AttachSCSIVolumeTestJSON-866050322 tempest-AttachSCSIVolumeTestJSON-866050322-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.984123 Oct 12 13:30:48.112942 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 894/1762] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:30:47 2022] POST /compute/v2.1/servers => generated 214 bytes in 988 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:30:48.123158 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3198fa72-5ed5-4b12-86e0-210b46bd5de8 tempest-AttachSCSIVolumeTestJSON-866050322 tempest-AttachSCSIVolumeTestJSON-866050322-project] Calling method '.version_select at 0x7f8a9ba139d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:48.236442 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3198fa72-5ed5-4b12-86e0-210b46bd5de8 tempest-AttachSCSIVolumeTestJSON-866050322 tempest-AttachSCSIVolumeTestJSON-866050322-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221716700" status: 202 len: 0 microversion: 2.1 time: 0.116969 Oct 12 13:30:48.240363 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 869/1763] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 12 13:30:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221716700 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:30:54.303252 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:30:55.276133 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:30:55.582071 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9b1a7087-0851-4ee4-937a-5635651fa8e0 tempest-QuotasTestJSON-840102946 tempest-QuotasTestJSON-840102946-project] Calling method '.version_select at 0x7f8aa03f39d0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:57.780027 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=19 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:30:58.001361 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9b1a7087-0851-4ee4-937a-5635651fa8e0 tempest-QuotasTestJSON-840102946 tempest-QuotasTestJSON-840102946-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/33f38607b3d248a28e280e6eabec5bca/defaults" status: 200 len: 371 microversion: 2.1 time: 3.698798 Oct 12 13:30:58.001993 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 895/1764] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 12 13:30:54 2022] GET /compute/v2.1/os-quota-sets/33f38607b3d248a28e280e6eabec5bca/defaults => generated 371 bytes in 3700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:30:58.019997 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5b4a9afc-f2af-492e-8c6a-060b076e8b80 tempest-QuotasTestJSON-840102946 tempest-QuotasTestJSON-840102946-project] Calling method '.version_select at 0x7f8a9b9d3a60>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:58.165934 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:30:58.494109 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f2b883fe-35e4-4f22-b5df-fea8e9737f26 tempest-FloatingIPDetailsNegativeTestJSON-1224800000 tempest-FloatingIPDetailsNegativeTestJSON-1224800000-project] Calling method '.version_select at 0x7f8a9b42b310>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:58.639338 n-d-861076-2 devstack@n-api.service[120932]: DEBUG neutronclient.v2_0.client [None req-f2b883fe-35e4-4f22-b5df-fea8e9737f26 tempest-FloatingIPDetailsNegativeTestJSON-1224800000 tempest-FloatingIPDetailsNegativeTestJSON-1224800000-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9dbbc930-2cd7-4020-8d43-7d3fcadf01da could not be found", "detail": ""}} {{(pid=120932) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 13:30:58.640060 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-f2b883fe-35e4-4f22-b5df-fea8e9737f26 tempest-FloatingIPDetailsNegativeTestJSON-1224800000 tempest-FloatingIPDetailsNegativeTestJSON-1224800000-project] HTTP exception thrown: Floating IP not found for ID 9dbbc930-2cd7-4020-8d43-7d3fcadf01da Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f2b883fe-35e4-4f22-b5df-fea8e9737f26 tempest-FloatingIPDetailsNegativeTestJSON-1224800000 tempest-FloatingIPDetailsNegativeTestJSON-1224800000-project] Request method failure captured: Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/os-floating-ips/9dbbc930-2cd7-4020-8d43-7d3fcadf01da HTTP/1.1 Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsGRPI8JNo4PON9AGCZ3fjViA5qudpRDkv6Zv3yMp3x8YiUg6-TecD2xL3WxW8XnE9TkRi9ftTX3txbZ2QweLsxd81zn0wfN1k1Tf5UT7sZ-Wus3twF12UGOay64fPt0_PaeNvB83d9KbJwt3vRJM2bO4Bc3l9gb3KA2pHxT6ST3p7o Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 446778dfb14a44b68b66b511153f9d66 Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1224800000 Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/446778dfb14a44b68b66b511153f9d66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_446778dfb14a44b68b66b511153f9d66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/446778dfb14a44b68b66b511153f9d66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/446778dfb14a44b68b66b511153f9d66"}]}] Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1224800000 Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 446778dfb14a44b68b66b511153f9d66 Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1224800000 Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1224800000-project Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 0dce4bd76020425b8b7117c9856d6f5a Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1224800000-project Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: exception: Floating IP not found for ID 9dbbc930-2cd7-4020-8d43-7d3fcadf01da Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '9dbbc930-2cd7-4020-8d43-7d3fcadf01da'} Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 13:30:58.642053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9dbbc930-2cd7-4020-8d43-7d3fcadf01da could not be found Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9723f335-cab5-45f8-8ef1-dd5dc0b1aad2'] Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9dbbc930-2cd7-4020-8d43-7d3fcadf01da. Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9dbbc930-2cd7-4020-8d43-7d3fcadf01da Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9dbbc930-2cd7-4020-8d43-7d3fcadf01da Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f2b883fe-35e4-4f22-b5df-fea8e9737f26 tempest-FloatingIPDetailsNegativeTestJSON-1224800000 tempest-FloatingIPDetailsNegativeTestJSON-1224800000-project] Returning 404 to user: Floating IP not found for ID 9dbbc930-2cd7-4020-8d43-7d3fcadf01da {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f2b883fe-35e4-4f22-b5df-fea8e9737f26 tempest-FloatingIPDetailsNegativeTestJSON-1224800000 tempest-FloatingIPDetailsNegativeTestJSON-1224800000-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/9dbbc930-2cd7-4020-8d43-7d3fcadf01da" status: 404 len: 111 microversion: 2.1 time: 0.869604 Oct 12 13:30:58.646308 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 870/1765] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 12 13:30:57 2022] GET /compute/v2.1/os-floating-ips/9dbbc930-2cd7-4020-8d43-7d3fcadf01da => generated 111 bytes in 871 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 13:30:58.897767 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5b4a9afc-f2af-492e-8c6a-060b076e8b80 tempest-QuotasTestJSON-840102946 tempest-QuotasTestJSON-840102946-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/33f38607b3d248a28e280e6eabec5bca" status: 200 len: 371 microversion: 2.1 time: 0.886016 Oct 12 13:30:58.902534 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 896/1766] 10.222.0.52 () {58 vars in 1242 bytes} [Wed Oct 12 13:30:58 2022] GET /compute/v2.1/os-quota-sets/33f38607b3d248a28e280e6eabec5bca => generated 371 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:30:58.916418 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ba19048c-9f7b-4571-91d6-71c58f7a4a81 tempest-QuotasTestJSON-840102946 tempest-QuotasTestJSON-840102946-project] Calling method '.version_select at 0x7f8a9bd59430>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:30:59.778078 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ba19048c-9f7b-4571-91d6-71c58f7a4a81 tempest-QuotasTestJSON-840102946 tempest-QuotasTestJSON-840102946-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/33f38607b3d248a28e280e6eabec5bca/defaults" status: 200 len: 371 microversion: 2.1 time: 0.867032 Oct 12 13:30:59.782552 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 871/1767] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 12 13:30:58 2022] GET /compute/v2.1/os-quota-sets/33f38607b3d248a28e280e6eabec5bca/defaults => generated 371 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:30:59.796498 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-dc5d9816-f021-446a-bf7c-ade9a9104f63 tempest-QuotasTestJSON-840102946 tempest-QuotasTestJSON-840102946-project] Calling method '.version_select at 0x7f8a9bd01550>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:01.422909 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-dc5d9816-f021-446a-bf7c-ade9a9104f63 tempest-QuotasTestJSON-840102946 tempest-QuotasTestJSON-840102946-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/33f38607b3d248a28e280e6eabec5bca" status: 200 len: 371 microversion: 2.1 time: 1.630056 Oct 12 13:31:01.423548 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 897/1768] 10.222.0.52 () {58 vars in 1242 bytes} [Wed Oct 12 13:30:59 2022] GET /compute/v2.1/os-quota-sets/33f38607b3d248a28e280e6eabec5bca => generated 371 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:31:01.436771 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7403ea0b-eb78-4546-a36a-44308bf65958 tempest-QuotasTestJSON-840102946 tempest-QuotasTestJSON-840102946-project] Calling method '.version_select at 0x7f8a9b9b69d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:02.992933 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7403ea0b-eb78-4546-a36a-44308bf65958 tempest-QuotasTestJSON-840102946 tempest-QuotasTestJSON-840102946-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/33f38607b3d248a28e280e6eabec5bca?user_id=2ff89dbd30334e5b97d4cd49d58522c9" status: 200 len: 371 microversion: 2.1 time: 1.560811 Oct 12 13:31:02.999139 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 872/1769] 10.222.0.52 () {58 vars in 1323 bytes} [Wed Oct 12 13:31:01 2022] GET /compute/v2.1/os-quota-sets/33f38607b3d248a28e280e6eabec5bca?user_id=2ff89dbd30334e5b97d4cd49d58522c9 => generated 371 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:31:15.563708 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9542f3e0-75a2-493d-8d20-8df007ccb4ca tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Calling method '.version_select at 0x7f8aa03f39d0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:15.577793 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:31:15.578774 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=13 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:31:15.626136 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9542f3e0-75a2-493d-8d20-8df007ccb4ca tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] 10.222.0.52 "GET /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2" status: 200 len: 637 microversion: 2.1 time: 0.067872 Oct 12 13:31:15.627235 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 898/1770] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:31:15 2022] GET /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2 => generated 637 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:31:15.643862 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8278b196-1d08-475b-b7b4-b2ecfdac0443 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Action: 'update_all', calling method: .version_select at 0x7f8a9b4149d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:31:15.663162 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:31:15.665805 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=8 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:31:15.721338 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-8278b196-1d08-475b-b7b4-b2ecfdac0443 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Getting quotas for project bb0925b344e944fca289c3ac9ac50a17. Resources: dict_keys(['metadata_items']) {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:31:15.727080 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-8278b196-1d08-475b-b7b4-b2ecfdac0443 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Getting quotas for user 246169f7c4de409c86691559b874e19a and project bb0925b344e944fca289c3ac9ac50a17. Resources: dict_keys(['metadata_items']) {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:31:16.189635 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8278b196-1d08-475b-b7b4-b2ecfdac0443 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] 10.222.0.52 "PUT /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.550096 Oct 12 13:31:16.190371 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 873/1771] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 12 13:31:15 2022] PUT /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata => generated 61 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:31:16.199879 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-bd7fc9ba-dd10-4866-a470-73d6d8d4e6a6 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Calling method '.version_select at 0x7f8a9b9fd9d0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:16.546155 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-bd7fc9ba-dd10-4866-a470-73d6d8d4e6a6 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] 10.222.0.52 "DELETE /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.350140 Oct 12 13:31:16.546834 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 899/1772] 10.222.0.52 () {58 vars in 1296 bytes} [Wed Oct 12 13:31:16 2022] DELETE /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata/os_version => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:31:16.555124 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9b00555d-8652-46da-a342-c0b7815342f2 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Calling method '.version_select at 0x7f8a9b5f5940>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:16.606258 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9b00555d-8652-46da-a342-c0b7815342f2 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] 10.222.0.52 "GET /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata" status: 200 len: 37 microversion: 2.1 time: 0.055144 Oct 12 13:31:16.606976 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 874/1773] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 12 13:31:16 2022] GET /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata => generated 37 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:31:16.631703 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-67ddd029-76cc-43d8-aab2-ddfd592605ad tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Action: 'update_all', calling method: .version_select at 0x7f8a9ba51550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:31:16.690635 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-67ddd029-76cc-43d8-aab2-ddfd592605ad tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Getting quotas for project bb0925b344e944fca289c3ac9ac50a17. Resources: dict_keys(['metadata_items']) {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:31:16.697374 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-67ddd029-76cc-43d8-aab2-ddfd592605ad tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Getting quotas for user 246169f7c4de409c86691559b874e19a and project bb0925b344e944fca289c3ac9ac50a17. Resources: dict_keys(['metadata_items']) {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:31:17.014977 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1a0f69d5-7ba8-46bf-9eb0-8560cc2df641 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] 10.222.0.52 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.410989 Oct 12 13:31:17.016097 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 900/1774] 10.222.0.52 () {58 vars in 1128 bytes} [Wed Oct 12 13:31:16 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 12 13:31:17.031593 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0ca178f3-b3c0-43c6-a136-2d4f50f7a3e9 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] Calling method '.version_select at 0x7f8a9bb78670>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:17.107970 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-0ca178f3-b3c0-43c6-a136-2d4f50f7a3e9 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] HTTP exception thrown: Image not found. Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0ca178f3-b3c0-43c6-a136-2d4f50f7a3e9 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] Request method failure captured: Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsGkuHw_36_8Fer9uvsRVj2xz_pHdznrinxiQLblsWbe3macgCutc9HsPLLaEtIRrjBZaYGTTVnuujDem3rRDEM-fYjVRPmHO7tAakB_YFFhYCZFQzHS3GHJ1DopctiKcOQy8aT9Fmi7TPSHRX7eEtBw0_rLwBmdA28ZyrkXOZ1OySc Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: e4201a278da14b3285ce17208e8221da Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-848543449 Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e4201a278da14b3285ce17208e8221da"}]}, {"type": "tempest-type-445636729", "name": "tempest-service-586230299", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e4201a278da14b3285ce17208e8221da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4201a278da14b3285ce17208e8221da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4201a278da14b3285ce17208e8221da"}]}] Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-848543449 Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: e4201a278da14b3285ce17208e8221da Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-848543449 Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ImagesDeleteNegativeTestJSON-848543449-project Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 919746fdd3e944d4a98ba83f683b51cf Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-848543449-project Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: exception: Image not found. Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '-1'} Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.110263 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:17.115333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:31:17.115333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:31:17.115333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:31:17.115333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:31:17.115333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:31:17.115333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:31:17.115333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:31:17.115333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:31:17.115333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 13:31:17.115333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 13:31:17.115333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 13:31:17.115333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.115333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:31:17.115333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.115333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:17.115333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:31:17.115333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:31:17.115333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:31:17.115333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:31:17.115333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 13:31:17.115333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.117625 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0ca178f3-b3c0-43c6-a136-2d4f50f7a3e9 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] Returning 404 to user: Image not found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:31:17.118648 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0ca178f3-b3c0-43c6-a136-2d4f50f7a3e9 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] 10.222.0.52 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.094527 Oct 12 13:31:17.119530 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 901/1775] 10.222.0.52 () {58 vars in 1134 bytes} [Wed Oct 12 13:31:17 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:31:17.134414 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4c272e3e-3279-4971-a1d3-991d25a8d7f1 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] Calling method '.version_select at 0x7f8a9bb78670>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:17.146897 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-67ddd029-76cc-43d8-aab2-ddfd592605ad tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] 10.222.0.52 "PUT /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.533189 Oct 12 13:31:17.147504 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 875/1776] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 12 13:31:16 2022] PUT /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata => generated 61 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:31:17.157312 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7dfb1894-fa54-4723-a56a-9d23d160428d tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Calling method '.version_select at 0x7f8a9ba51040>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:17.177901 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-4c272e3e-3279-4971-a1d3-991d25a8d7f1 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] HTTP exception thrown: Image not found. Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4c272e3e-3279-4971-a1d3-991d25a8d7f1 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] Request method failure captured: Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: request: DELETE /compute/v2.1/images/d4b79088-df26-45fd-8441-ed1a8762c54j HTTP/1.1 Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsGkuHw_36_8Fer9uvsRVj2xz_pHdznrinxiQLblsWbe3macgCutc9HsPLLaEtIRrjBZaYGTTVnuujDem3rRDEM-fYjVRPmHO7tAakB_YFFhYCZFQzHS3GHJ1DopctiKcOQy8aT9Fmi7TPSHRX7eEtBw0_rLwBmdA28ZyrkXOZ1OySc Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: e4201a278da14b3285ce17208e8221da Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-848543449 Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e4201a278da14b3285ce17208e8221da"}]}, {"type": "tempest-type-445636729", "name": "tempest-service-586230299", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e4201a278da14b3285ce17208e8221da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4201a278da14b3285ce17208e8221da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4201a278da14b3285ce17208e8221da"}]}] Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-848543449 Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: e4201a278da14b3285ce17208e8221da Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-848543449 Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ImagesDeleteNegativeTestJSON-848543449-project Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 919746fdd3e944d4a98ba83f683b51cf Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-848543449-project Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: exception: Image not found. Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'd4b79088-df26-45fd-8441-ed1a8762c54j'} Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d4b79088-df26-45fd-8441-ed1a8762c54j to delete Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d4b79088-df26-45fd-8441-ed1a8762c54j could not be found. Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.182996 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4c272e3e-3279-4971-a1d3-991d25a8d7f1 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] Returning 404 to user: Image not found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4c272e3e-3279-4971-a1d3-991d25a8d7f1 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] 10.222.0.52 "DELETE /compute/v2.1/images/d4b79088-df26-45fd-8441-ed1a8762c54j" status: 404 len: 62 microversion: 2.1 time: 0.059463 Oct 12 13:31:17.193063 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 902/1777] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:31:17 2022] DELETE /compute/v2.1/images/d4b79088-df26-45fd-8441-ed1a8762c54j => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:31:17.200998 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-beac6c6a-2b9d-418b-992f-e0f4e6a66a79 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] Calling method '.version_select at 0x7f8a9b9d3310>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:17.220591 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7dfb1894-fa54-4723-a56a-9d23d160428d tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] 10.222.0.52 "GET /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.066657 Oct 12 13:31:17.225118 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 876/1778] 10.222.0.52 () {58 vars in 1290 bytes} [Wed Oct 12 13:31:17 2022] GET /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata/os_distro => generated 33 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 13:31:17.233747 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-beac6c6a-2b9d-418b-992f-e0f4e6a66a79 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] HTTP exception thrown: Image not found. Oct 12 13:31:17.235324 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0fad9ed7-bad8-4724-ab2f-307ee92aeb86 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Action: 'update_all', calling method: .version_select at 0x7f8a9bd92a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-beac6c6a-2b9d-418b-992f-e0f4e6a66a79 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] Request method failure captured: Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: request: DELETE /compute/v2.1/images/8eed1e30-7301-4173-b472-3a34d08a89ac1 HTTP/1.1 Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsGkuHw_36_8Fer9uvsRVj2xz_pHdznrinxiQLblsWbe3macgCutc9HsPLLaEtIRrjBZaYGTTVnuujDem3rRDEM-fYjVRPmHO7tAakB_YFFhYCZFQzHS3GHJ1DopctiKcOQy8aT9Fmi7TPSHRX7eEtBw0_rLwBmdA28ZyrkXOZ1OySc Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: e4201a278da14b3285ce17208e8221da Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-848543449 Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e4201a278da14b3285ce17208e8221da"}]}, {"type": "tempest-type-445636729", "name": "tempest-service-586230299", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e4201a278da14b3285ce17208e8221da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4201a278da14b3285ce17208e8221da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4201a278da14b3285ce17208e8221da"}]}] Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-848543449 Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: e4201a278da14b3285ce17208e8221da Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-848543449 Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ImagesDeleteNegativeTestJSON-848543449-project Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 919746fdd3e944d4a98ba83f683b51cf Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-848543449-project Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: exception: Image not found. Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '8eed1e30-7301-4173-b472-3a34d08a89ac1'} Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8eed1e30-7301-4173-b472-3a34d08a89ac1 to delete Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8eed1e30-7301-4173-b472-3a34d08a89ac1 could not be found. Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.236595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:31:17.241077 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.241077 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:17.241077 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:31:17.241077 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:31:17.241077 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:31:17.241077 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:31:17.241077 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:31:17.241077 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:31:17.241077 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:31:17.241077 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:31:17.241077 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 13:31:17.241077 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 13:31:17.241077 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 13:31:17.241077 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.241077 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:31:17.241077 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.241077 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:17.241077 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:31:17.241077 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:31:17.241077 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:31:17.241077 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:31:17.241077 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 13:31:17.241077 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.243956 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-beac6c6a-2b9d-418b-992f-e0f4e6a66a79 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] Returning 404 to user: Image not found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:31:17.246636 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-beac6c6a-2b9d-418b-992f-e0f4e6a66a79 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] 10.222.0.52 "DELETE /compute/v2.1/images/8eed1e30-7301-4173-b472-3a34d08a89ac1" status: 404 len: 62 microversion: 2.1 time: 0.051440 Oct 12 13:31:17.249699 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 903/1779] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:31:17 2022] DELETE /compute/v2.1/images/8eed1e30-7301-4173-b472-3a34d08a89ac1 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 12 13:31:17.261677 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-748abac4-ab88-458c-94bb-620d93b95a74 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] Calling method '.version_select at 0x7f8a9b9d3310>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:17.284520 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-748abac4-ab88-458c-94bb-620d93b95a74 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] HTTP exception thrown: Image not found. Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-748abac4-ab88-458c-94bb-620d93b95a74 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] Request method failure captured: Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: request: DELETE /compute/v2.1/images/tempest-invalid-904233299 HTTP/1.1 Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsGkuHw_36_8Fer9uvsRVj2xz_pHdznrinxiQLblsWbe3macgCutc9HsPLLaEtIRrjBZaYGTTVnuujDem3rRDEM-fYjVRPmHO7tAakB_YFFhYCZFQzHS3GHJ1DopctiKcOQy8aT9Fmi7TPSHRX7eEtBw0_rLwBmdA28ZyrkXOZ1OySc Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: e4201a278da14b3285ce17208e8221da Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-848543449 Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e4201a278da14b3285ce17208e8221da"}]}, {"type": "tempest-type-445636729", "name": "tempest-service-586230299", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e4201a278da14b3285ce17208e8221da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4201a278da14b3285ce17208e8221da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4201a278da14b3285ce17208e8221da"}]}] Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-848543449 Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: e4201a278da14b3285ce17208e8221da Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-848543449 Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ImagesDeleteNegativeTestJSON-848543449-project Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 919746fdd3e944d4a98ba83f683b51cf Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-848543449-project Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: exception: Image not found. Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'tempest-invalid-904233299'} Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-904233299 to delete Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-904233299 could not be found. Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:31:17.286960 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-748abac4-ab88-458c-94bb-620d93b95a74 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] Returning 404 to user: Image not found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-748abac4-ab88-458c-94bb-620d93b95a74 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] 10.222.0.52 "DELETE /compute/v2.1/images/tempest-invalid-904233299" status: 404 len: 62 microversion: 2.1 time: 0.034648 Oct 12 13:31:17.297362 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 904/1780] 10.222.0.52 () {58 vars in 1203 bytes} [Wed Oct 12 13:31:17 2022] DELETE /compute/v2.1/images/tempest-invalid-904233299 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:31:17.301836 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4cd0c7a2-9577-4bae-b747-512b650fd577 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] Calling method '.version_select at 0x7f8a9bb78550>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:17.328888 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-4cd0c7a2-9577-4bae-b747-512b650fd577 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] HTTP exception thrown: Image not found. Oct 12 13:31:17.329056 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-0fad9ed7-bad8-4724-ab2f-307ee92aeb86 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Getting quotas for project bb0925b344e944fca289c3ac9ac50a17. Resources: dict_keys(['metadata_items']) {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4cd0c7a2-9577-4bae-b747-512b650fd577 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] Request method failure captured: Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: request: DELETE /compute/v2.1/images/960806b3-3b74-4fcf-b3f1-3c90a2a6166b HTTP/1.1 Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsGkuHw_36_8Fer9uvsRVj2xz_pHdznrinxiQLblsWbe3macgCutc9HsPLLaEtIRrjBZaYGTTVnuujDem3rRDEM-fYjVRPmHO7tAakB_YFFhYCZFQzHS3GHJ1DopctiKcOQy8aT9Fmi7TPSHRX7eEtBw0_rLwBmdA28ZyrkXOZ1OySc Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: e4201a278da14b3285ce17208e8221da Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-848543449 Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e4201a278da14b3285ce17208e8221da"}]}, {"type": "tempest-type-445636729", "name": "tempest-service-586230299", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e4201a278da14b3285ce17208e8221da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4201a278da14b3285ce17208e8221da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4201a278da14b3285ce17208e8221da"}]}] Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-848543449 Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: e4201a278da14b3285ce17208e8221da Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-848543449 Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ImagesDeleteNegativeTestJSON-848543449-project Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 919746fdd3e944d4a98ba83f683b51cf Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-848543449-project Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: exception: Image not found. Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '960806b3-3b74-4fcf-b3f1-3c90a2a6166b'} Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 960806b3-3b74-4fcf-b3f1-3c90a2a6166b to delete Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 960806b3-3b74-4fcf-b3f1-3c90a2a6166b could not be found. Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.333496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:31:17.337861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.337861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:17.337861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:31:17.337861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:31:17.337861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:31:17.337861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:31:17.337861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:31:17.337861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:31:17.337861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:31:17.337861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:31:17.337861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 13:31:17.337861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 13:31:17.337861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 13:31:17.337861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.337861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:31:17.337861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.337861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:17.337861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:31:17.337861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:31:17.337861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:31:17.337861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:31:17.337861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 13:31:17.337861 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:17.339515 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-0fad9ed7-bad8-4724-ab2f-307ee92aeb86 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Getting quotas for user 246169f7c4de409c86691559b874e19a and project bb0925b344e944fca289c3ac9ac50a17. Resources: dict_keys(['metadata_items']) {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:31:17.340405 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4cd0c7a2-9577-4bae-b747-512b650fd577 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] Returning 404 to user: Image not found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:31:17.341326 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4cd0c7a2-9577-4bae-b747-512b650fd577 tempest-ImagesDeleteNegativeTestJSON-848543449 tempest-ImagesDeleteNegativeTestJSON-848543449-project] 10.222.0.52 "DELETE /compute/v2.1/images/960806b3-3b74-4fcf-b3f1-3c90a2a6166b" status: 404 len: 62 microversion: 2.1 time: 0.044534 Oct 12 13:31:17.347482 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 905/1781] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:31:17 2022] DELETE /compute/v2.1/images/960806b3-3b74-4fcf-b3f1-3c90a2a6166b => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:31:17.527979 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0fad9ed7-bad8-4724-ab2f-307ee92aeb86 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] 10.222.0.52 "PUT /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.297608 Oct 12 13:31:17.528575 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 877/1782] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 12 13:31:17 2022] PUT /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata => generated 61 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 13:31:17.539333 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3f2eb513-2f62-497e-8665-9aa956a23be1 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Calling method '.version_select at 0x7f8a9bb78160>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:17.585172 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3f2eb513-2f62-497e-8665-9aa956a23be1 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] 10.222.0.52 "GET /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.048415 Oct 12 13:31:17.585172 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 906/1783] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 12 13:31:17 2022] GET /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata => generated 61 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 13:31:17.597360 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-be974be7-576e-4d0f-a8d6-a104d364af37 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Action: 'update_all', calling method: .version_select at 0x7f8a9b5f5820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:31:17.652310 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-be974be7-576e-4d0f-a8d6-a104d364af37 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Getting quotas for project bb0925b344e944fca289c3ac9ac50a17. Resources: dict_keys(['metadata_items']) {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:31:17.659471 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-be974be7-576e-4d0f-a8d6-a104d364af37 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Getting quotas for user 246169f7c4de409c86691559b874e19a and project bb0925b344e944fca289c3ac9ac50a17. Resources: dict_keys(['metadata_items']) {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:31:17.832477 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-be974be7-576e-4d0f-a8d6-a104d364af37 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] 10.222.0.52 "PUT /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.241887 Oct 12 13:31:17.833079 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 878/1784] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 12 13:31:17 2022] PUT /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata => generated 61 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:31:17.846446 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-96cebd82-af22-4744-968d-cc274078454d tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Action: 'update_all', calling method: .version_select at 0x7f8a9b9d3b80>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:31:17.903093 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-96cebd82-af22-4744-968d-cc274078454d tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Getting quotas for project bb0925b344e944fca289c3ac9ac50a17. Resources: dict_keys(['metadata_items']) {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:31:17.908835 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-96cebd82-af22-4744-968d-cc274078454d tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Getting quotas for user 246169f7c4de409c86691559b874e19a and project bb0925b344e944fca289c3ac9ac50a17. Resources: dict_keys(['metadata_items']) {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:31:18.315171 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-96cebd82-af22-4744-968d-cc274078454d tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] 10.222.0.52 "PUT /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata" status: 200 len: 64 microversion: 2.1 time: 0.476212 Oct 12 13:31:18.315917 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 907/1785] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 12 13:31:17 2022] PUT /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata => generated 64 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:31:18.327035 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8e6558c2-44a2-46c7-8375-ac9545cac89d tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Calling method '.version_select at 0x7f8a9b5f55e0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:18.375598 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8e6558c2-44a2-46c7-8375-ac9545cac89d tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] 10.222.0.52 "GET /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata" status: 200 len: 64 microversion: 2.1 time: 0.053925 Oct 12 13:31:18.377223 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 879/1786] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 12 13:31:18 2022] GET /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata => generated 64 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 13:31:18.387772 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-98613e18-0fdf-4f54-80a2-1080182f3cd8 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Action: 'update_all', calling method: .version_select at 0x7f8a9b9d3ca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:31:18.449334 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-98613e18-0fdf-4f54-80a2-1080182f3cd8 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Getting quotas for project bb0925b344e944fca289c3ac9ac50a17. Resources: dict_keys(['metadata_items']) {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:31:18.455399 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-98613e18-0fdf-4f54-80a2-1080182f3cd8 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Getting quotas for user 246169f7c4de409c86691559b874e19a and project bb0925b344e944fca289c3ac9ac50a17. Resources: dict_keys(['metadata_items']) {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:31:18.944506 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-98613e18-0fdf-4f54-80a2-1080182f3cd8 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] 10.222.0.52 "PUT /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.560917 Oct 12 13:31:18.946819 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 908/1787] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 12 13:31:18 2022] PUT /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata => generated 61 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 13:31:18.959153 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-826c4d08-250a-4550-9209-5944f3f270ca tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Action: 'update', calling method: .version_select at 0x7f8a9b672ee0>, body: {"meta": {"os_version": "alt"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:31:19.026231 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-826c4d08-250a-4550-9209-5944f3f270ca tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Getting quotas for project bb0925b344e944fca289c3ac9ac50a17. Resources: dict_keys(['metadata_items']) {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:31:19.032174 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-826c4d08-250a-4550-9209-5944f3f270ca tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Getting quotas for user 246169f7c4de409c86691559b874e19a and project bb0925b344e944fca289c3ac9ac50a17. Resources: dict_keys(['metadata_items']) {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:31:19.477963 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-826c4d08-250a-4550-9209-5944f3f270ca tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] 10.222.0.52 "PUT /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.524604 Oct 12 13:31:19.478288 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 880/1788] 10.222.0.52 () {60 vars in 1313 bytes} [Wed Oct 12 13:31:18 2022] PUT /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata/os_version => generated 31 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 13:31:19.488837 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-897566df-a9b3-4066-8927-a63f4be49468 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Calling method '.version_select at 0x7f8a9bd01550>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:19.534026 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-897566df-a9b3-4066-8927-a63f4be49468 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] 10.222.0.52 "GET /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata" status: 200 len: 58 microversion: 2.1 time: 0.046412 Oct 12 13:31:19.534026 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 909/1789] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 12 13:31:19 2022] GET /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata => generated 58 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:31:19.545339 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9cf84a9b-a799-476d-b397-77ad4c80f936 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Action: 'update_all', calling method: .version_select at 0x7f8a9b5f5160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:31:19.601895 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-9cf84a9b-a799-476d-b397-77ad4c80f936 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Getting quotas for project bb0925b344e944fca289c3ac9ac50a17. Resources: dict_keys(['metadata_items']) {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:31:19.608701 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-9cf84a9b-a799-476d-b397-77ad4c80f936 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Getting quotas for user 246169f7c4de409c86691559b874e19a and project bb0925b344e944fca289c3ac9ac50a17. Resources: dict_keys(['metadata_items']) {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:31:20.073649 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9cf84a9b-a799-476d-b397-77ad4c80f936 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] 10.222.0.52 "PUT /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.535178 Oct 12 13:31:20.078651 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 881/1790] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Oct 12 13:31:19 2022] PUT /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata => generated 61 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:31:20.091571 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e8e5c850-4980-42a1-93f7-16bf56b0ec44 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Action: 'create', calling method: .version_select at 0x7f8a9b9fd5e0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:31:20.158544 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-e8e5c850-4980-42a1-93f7-16bf56b0ec44 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Getting quotas for project bb0925b344e944fca289c3ac9ac50a17. Resources: dict_keys(['metadata_items']) {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:31:20.169100 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-e8e5c850-4980-42a1-93f7-16bf56b0ec44 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Getting quotas for user 246169f7c4de409c86691559b874e19a and project bb0925b344e944fca289c3ac9ac50a17. Resources: dict_keys(['metadata_items']) {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:31:20.607942 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e8e5c850-4980-42a1-93f7-16bf56b0ec44 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] 10.222.0.52 "POST /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata" status: 200 len: 85 microversion: 2.1 time: 0.522907 Oct 12 13:31:20.609438 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 910/1791] 10.222.0.52 () {60 vars in 1281 bytes} [Wed Oct 12 13:31:20 2022] POST /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata => generated 85 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 13:31:20.621894 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d7314f81-a939-40d8-89f9-38d04a78df08 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] Calling method '.version_select at 0x7f8a9be6c430>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:20.669355 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d7314f81-a939-40d8-89f9-38d04a78df08 tempest-ImagesMetadataTestJSON-2132527761 tempest-ImagesMetadataTestJSON-2132527761-project] 10.222.0.52 "GET /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata" status: 200 len: 85 microversion: 2.1 time: 0.051046 Oct 12 13:31:20.670430 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 882/1792] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Oct 12 13:31:20 2022] GET /compute/v2.1/images/c77e6afa-4f7e-4710-bba8-4d6d93845ee2/metadata => generated 85 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 13:31:26.106486 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c314d6cb-1283-4028-837e-eae817f29259 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-172613885", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:31:26.167122 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-c314d6cb-1283-4028-837e-eae817f29259 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] validate_networks() for None {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:31:26.399395 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-c314d6cb-1283-4028-837e-eae817f29259 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Flavor limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:31:26.399794 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-c314d6cb-1283-4028-837e-eae817f29259 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Image limits 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:31:26.400262 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-c314d6cb-1283-4028-837e-eae817f29259 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Flavor pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:31:26.400850 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-c314d6cb-1283-4028-837e-eae817f29259 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Image pref 0:0:0 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:31:26.401280 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.virt.hardware [None req-c314d6cb-1283-4028-837e-eae817f29259 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:31:26.410884 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c314d6cb-1283-4028-837e-eae817f29259 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:26.411366 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c314d6cb-1283-4028-837e-eae817f29259 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:26.411801 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c314d6cb-1283-4028-837e-eae817f29259 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:26.412522 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c314d6cb-1283-4028-837e-eae817f29259 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:26.412995 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c314d6cb-1283-4028-837e-eae817f29259 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:26.413419 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c314d6cb-1283-4028-837e-eae817f29259 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:26.432106 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-c314d6cb-1283-4028-837e-eae817f29259 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Getting quotas for project 6338ad2886354139845460c4db1b6df7. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:31:26.438320 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-c314d6cb-1283-4028-837e-eae817f29259 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Getting quotas for user a2a8d4d88cf44099aef748a804f1dad0 and project 6338ad2886354139845460c4db1b6df7. Resources: {'ram', 'cores', 'instances'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:31:26.456291 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c314d6cb-1283-4028-837e-eae817f29259 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Going to run 1 instances... {{(pid=120933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:31:26.458647 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c314d6cb-1283-4028-837e-eae817f29259 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:31:26.589121 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c314d6cb-1283-4028-837e-eae817f29259 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838006 Oct 12 13:31:26.592746 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 911/1793] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:31:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 13:31:26.605436 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-52629236-2af0-4ccc-96c0-7750cbff460d tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:26.606660 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-52629236-2af0-4ccc-96c0-7750cbff460d tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:31:26.712950 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-52629236-2af0-4ccc-96c0-7750cbff460d tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a8d4d88cf44099aef748a804f1dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6338ad2886354139845460c4db1b6df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:31:26.723035 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-52629236-2af0-4ccc-96c0-7750cbff460d tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 200 len: 1216 microversion: 2.1 time: 0.123819 Oct 12 13:31:26.723971 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 883/1794] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:31:26 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 1216 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:27.749655 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-59af0e4a-060c-4425-828d-1b4478ab9d1d tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:27.750227 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-59af0e4a-060c-4425-828d-1b4478ab9d1d tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:31:27.816535 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-59af0e4a-060c-4425-828d-1b4478ab9d1d tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a8d4d88cf44099aef748a804f1dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6338ad2886354139845460c4db1b6df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:31:27.824500 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-59af0e4a-060c-4425-828d-1b4478ab9d1d tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 200 len: 1216 microversion: 2.1 time: 0.081131 Oct 12 13:31:27.825563 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 912/1795] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:31:27 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 1216 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:28.852120 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cda5d0af-7734-4639-a460-384333c797e2 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:28.855643 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cda5d0af-7734-4639-a460-384333c797e2 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:31:28.926351 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-cda5d0af-7734-4639-a460-384333c797e2 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a8d4d88cf44099aef748a804f1dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6338ad2886354139845460c4db1b6df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:31:28.938074 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cda5d0af-7734-4639-a460-384333c797e2 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 200 len: 1216 microversion: 2.1 time: 0.092019 Oct 12 13:31:28.939724 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 884/1796] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:31:28 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 1216 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:29.963198 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-221d46b5-240c-47db-9295-c7cdd3d5200e tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:29.963824 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-221d46b5-240c-47db-9295-c7cdd3d5200e tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:31:30.027035 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-221d46b5-240c-47db-9295-c7cdd3d5200e tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a8d4d88cf44099aef748a804f1dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6338ad2886354139845460c4db1b6df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:31:30.034427 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-221d46b5-240c-47db-9295-c7cdd3d5200e tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 200 len: 1216 microversion: 2.1 time: 0.076473 Oct 12 13:31:30.035028 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 913/1797] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:31:29 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 1216 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:31.057664 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2ae07154-9b5b-40d8-b6da-0640dddfcd94 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:31.059154 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2ae07154-9b5b-40d8-b6da-0640dddfcd94 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:31:31.068481 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2ae07154-9b5b-40d8-b6da-0640dddfcd94 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:31.069405 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2ae07154-9b5b-40d8-b6da-0640dddfcd94 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:31.070724 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2ae07154-9b5b-40d8-b6da-0640dddfcd94 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:31.071925 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2ae07154-9b5b-40d8-b6da-0640dddfcd94 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:31.072619 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2ae07154-9b5b-40d8-b6da-0640dddfcd94 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:31.073326 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2ae07154-9b5b-40d8-b6da-0640dddfcd94 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:31.185868 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-2ae07154-9b5b-40d8-b6da-0640dddfcd94 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a8d4d88cf44099aef748a804f1dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6338ad2886354139845460c4db1b6df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:31:31.194315 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2ae07154-9b5b-40d8-b6da-0640dddfcd94 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 200 len: 1268 microversion: 2.1 time: 0.141061 Oct 12 13:31:31.195108 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 885/1798] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:31:31 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 1268 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:32.219378 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fb99cf2c-8016-4b7e-b94c-77f3ef03c749 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:32.225015 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-fb99cf2c-8016-4b7e-b94c-77f3ef03c749 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:31:32.239636 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb99cf2c-8016-4b7e-b94c-77f3ef03c749 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:32.241749 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb99cf2c-8016-4b7e-b94c-77f3ef03c749 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:32.249668 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb99cf2c-8016-4b7e-b94c-77f3ef03c749 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:32.251116 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb99cf2c-8016-4b7e-b94c-77f3ef03c749 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:32.251811 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb99cf2c-8016-4b7e-b94c-77f3ef03c749 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:32.252471 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-fb99cf2c-8016-4b7e-b94c-77f3ef03c749 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:32.402283 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-fb99cf2c-8016-4b7e-b94c-77f3ef03c749 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a8d4d88cf44099aef748a804f1dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6338ad2886354139845460c4db1b6df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:31:32.413283 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fb99cf2c-8016-4b7e-b94c-77f3ef03c749 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 200 len: 1274 microversion: 2.1 time: 0.196872 Oct 12 13:31:32.430936 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 914/1799] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:31:32 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 1274 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:33.445102 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e2cd0bbf-af01-419d-982b-34bff8e94b5d tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:33.448348 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e2cd0bbf-af01-419d-982b-34bff8e94b5d tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:31:33.458050 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2cd0bbf-af01-419d-982b-34bff8e94b5d tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:33.459456 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2cd0bbf-af01-419d-982b-34bff8e94b5d tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:33.460093 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2cd0bbf-af01-419d-982b-34bff8e94b5d tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:33.461499 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2cd0bbf-af01-419d-982b-34bff8e94b5d tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:33.462147 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2cd0bbf-af01-419d-982b-34bff8e94b5d tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:33.462791 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2cd0bbf-af01-419d-982b-34bff8e94b5d tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:33.826311 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-e2cd0bbf-af01-419d-982b-34bff8e94b5d tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a8d4d88cf44099aef748a804f1dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6338ad2886354139845460c4db1b6df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:31:33.870092 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e2cd0bbf-af01-419d-982b-34bff8e94b5d tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 200 len: 1316 microversion: 2.1 time: 0.422600 Oct 12 13:31:33.870092 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 886/1800] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:31:33 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 1316 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:34.669665 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-f8cbf2cf-870a-4831-b130-9b53fb0cc0e3 req-4baf849f-5d4e-4981-bd2f-61f61e4812d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a17a9511-ef30-472b-928d-b0efc0e47126", "tag": "0e474f0b-c8da-4aa8-a005-11b1cde4cedd"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:31:34.689837 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-f8cbf2cf-870a-4831-b130-9b53fb0cc0e3 req-4baf849f-5d4e-4981-bd2f-61f61e4812d5 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:34.690323 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-f8cbf2cf-870a-4831-b130-9b53fb0cc0e3 req-4baf849f-5d4e-4981-bd2f-61f61e4812d5 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:34.690756 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-f8cbf2cf-870a-4831-b130-9b53fb0cc0e3 req-4baf849f-5d4e-4981-bd2f-61f61e4812d5 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:34.712726 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-f8cbf2cf-870a-4831-b130-9b53fb0cc0e3 req-4baf849f-5d4e-4981-bd2f-61f61e4812d5 service nova] Creating event network-changed:0e474f0b-c8da-4aa8-a005-11b1cde4cedd for instance a17a9511-ef30-472b-928d-b0efc0e47126 on n-h1-861076-2 Oct 12 13:31:34.726745 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-f8cbf2cf-870a-4831-b130-9b53fb0cc0e3 req-4baf849f-5d4e-4981-bd2f-61f61e4812d5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061636 Oct 12 13:31:34.727677 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 915/1801] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:31:34.894863 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8121f308-ae01-4409-b695-4f0ee46cfab7 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:34.895622 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8121f308-ae01-4409-b695-4f0ee46cfab7 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:31:34.908179 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8121f308-ae01-4409-b695-4f0ee46cfab7 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:34.908950 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8121f308-ae01-4409-b695-4f0ee46cfab7 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:34.909566 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8121f308-ae01-4409-b695-4f0ee46cfab7 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:34.910429 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8121f308-ae01-4409-b695-4f0ee46cfab7 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:34.911035 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8121f308-ae01-4409-b695-4f0ee46cfab7 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:34.913440 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8121f308-ae01-4409-b695-4f0ee46cfab7 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:35.266350 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-8121f308-ae01-4409-b695-4f0ee46cfab7 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a8d4d88cf44099aef748a804f1dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6338ad2886354139845460c4db1b6df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:31:35.274212 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8121f308-ae01-4409-b695-4f0ee46cfab7 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 200 len: 1316 microversion: 2.1 time: 0.383581 Oct 12 13:31:35.283589 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 887/1802] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:31:34 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:36.311787 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-73aa6bab-f281-4508-a74c-14527cd6fab8 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:36.313958 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-73aa6bab-f281-4508-a74c-14527cd6fab8 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:31:36.331967 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-73aa6bab-f281-4508-a74c-14527cd6fab8 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:36.332842 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-73aa6bab-f281-4508-a74c-14527cd6fab8 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:36.335639 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-73aa6bab-f281-4508-a74c-14527cd6fab8 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:36.337842 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-73aa6bab-f281-4508-a74c-14527cd6fab8 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:36.340968 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-73aa6bab-f281-4508-a74c-14527cd6fab8 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:36.342103 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-73aa6bab-f281-4508-a74c-14527cd6fab8 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:36.421713 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:31:36.598272 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-73aa6bab-f281-4508-a74c-14527cd6fab8 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a8d4d88cf44099aef748a804f1dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6338ad2886354139845460c4db1b6df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:31:36.613945 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-73aa6bab-f281-4508-a74c-14527cd6fab8 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 200 len: 1316 microversion: 2.1 time: 0.310292 Oct 12 13:31:36.615450 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 916/1803] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:31:36 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:37.640958 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e5a5ca66-afe7-4bd2-bef6-7e7db205915f tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:37.642093 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e5a5ca66-afe7-4bd2-bef6-7e7db205915f tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:31:37.649251 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e5a5ca66-afe7-4bd2-bef6-7e7db205915f tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:37.649736 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e5a5ca66-afe7-4bd2-bef6-7e7db205915f tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:37.650168 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e5a5ca66-afe7-4bd2-bef6-7e7db205915f tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:37.650964 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e5a5ca66-afe7-4bd2-bef6-7e7db205915f tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:37.651574 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e5a5ca66-afe7-4bd2-bef6-7e7db205915f tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:37.652195 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e5a5ca66-afe7-4bd2-bef6-7e7db205915f tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:37.986669 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-e5a5ca66-afe7-4bd2-bef6-7e7db205915f tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a8d4d88cf44099aef748a804f1dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6338ad2886354139845460c4db1b6df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:31:38.000747 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e5a5ca66-afe7-4bd2-bef6-7e7db205915f tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 200 len: 1316 microversion: 2.1 time: 0.363471 Oct 12 13:31:38.003663 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 888/1804] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:31:37 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 1316 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:39.037860 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3ba2fbfe-9051-40f4-b991-c994a067b155 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:39.040813 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-3ba2fbfe-9051-40f4-b991-c994a067b155 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:31:39.061963 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3ba2fbfe-9051-40f4-b991-c994a067b155 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:39.070561 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3ba2fbfe-9051-40f4-b991-c994a067b155 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:39.071679 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3ba2fbfe-9051-40f4-b991-c994a067b155 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:39.073340 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3ba2fbfe-9051-40f4-b991-c994a067b155 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:39.074322 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3ba2fbfe-9051-40f4-b991-c994a067b155 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:39.081180 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3ba2fbfe-9051-40f4-b991-c994a067b155 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:39.395214 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-3ba2fbfe-9051-40f4-b991-c994a067b155 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a8d4d88cf44099aef748a804f1dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6338ad2886354139845460c4db1b6df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:31:39.404095 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3ba2fbfe-9051-40f4-b991-c994a067b155 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 200 len: 1316 microversion: 2.1 time: 0.375753 Oct 12 13:31:39.414556 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 917/1805] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:31:39 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 1316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:31:40.427203 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-50d43743-1d9b-4a1e-92ce-84ce528e6bce tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:40.427759 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-50d43743-1d9b-4a1e-92ce-84ce528e6bce tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:31:40.431299 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=28 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:31:40.436553 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-50d43743-1d9b-4a1e-92ce-84ce528e6bce tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:40.437333 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-50d43743-1d9b-4a1e-92ce-84ce528e6bce tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:40.437768 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-50d43743-1d9b-4a1e-92ce-84ce528e6bce tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:40.438979 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-50d43743-1d9b-4a1e-92ce-84ce528e6bce tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:40.439429 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-50d43743-1d9b-4a1e-92ce-84ce528e6bce tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:40.440012 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-50d43743-1d9b-4a1e-92ce-84ce528e6bce tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:40.604768 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=22 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:31:40.616522 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-50d43743-1d9b-4a1e-92ce-84ce528e6bce tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a8d4d88cf44099aef748a804f1dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6338ad2886354139845460c4db1b6df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:31:40.629619 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-50d43743-1d9b-4a1e-92ce-84ce528e6bce tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 200 len: 1316 microversion: 2.1 time: 0.206269 Oct 12 13:31:40.645900 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 889/1806] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:31:40 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 1316 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:41.217772 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f2cd4df9-4883-493c-9a20-d52329b65e3f tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-708456140", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "085c5084-6641-4d97-b026-eba4d19b3b13"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:31:41.275291 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-f2cd4df9-4883-493c-9a20-d52329b65e3f tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] validate_networks() for [('085c5084-6641-4d97-b026-eba4d19b3b13', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:31:41.654709 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-346ba99c-ab45-4d7e-a55c-e43eab5aabcd tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:41.655373 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-346ba99c-ab45-4d7e-a55c-e43eab5aabcd tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:31:41.664133 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-346ba99c-ab45-4d7e-a55c-e43eab5aabcd tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:41.665089 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-346ba99c-ab45-4d7e-a55c-e43eab5aabcd tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:41.665727 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-346ba99c-ab45-4d7e-a55c-e43eab5aabcd tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:41.667638 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-346ba99c-ab45-4d7e-a55c-e43eab5aabcd tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:41.667638 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-346ba99c-ab45-4d7e-a55c-e43eab5aabcd tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:41.667638 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-346ba99c-ab45-4d7e-a55c-e43eab5aabcd tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:41.814500 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-346ba99c-ab45-4d7e-a55c-e43eab5aabcd tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a8d4d88cf44099aef748a804f1dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6338ad2886354139845460c4db1b6df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:31:41.823504 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-346ba99c-ab45-4d7e-a55c-e43eab5aabcd tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 200 len: 1316 microversion: 2.1 time: 0.173136 Oct 12 13:31:41.840694 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 890/1807] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:31:41 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-f2cd4df9-4883-493c-9a20-d52329b65e3f tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3d2ad994-765b-41ca-bdc5-6fc90ea39981) Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:31:42.102899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3d2ad994-765b-41ca-bdc5-6fc90ea39981) Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-f2cd4df9-4883-493c-9a20-d52329b65e3f tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f2cd4df9-4883-493c-9a20-d52329b65e3f tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] Request method failure captured: Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 199 Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsG7f5gAkYTYcb5ZxFKrGb0R1lnMDupHsnutcBeA8zI4qtW7QolFo7J_AJtqsIKvJ_hhyGHsKzqvBMLj6CQ6JItzf4id-S_jpQbB4BL8XKPqwI0MT5tFWoJrl-YR1KjDh7fd1Fh0-N0BTObyfFbnS-012t2AHsJyLseZe5EZIKAPuMY Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 1447f1a9596e4bf4b6f1bcad819e2e1d Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ImagesTestJSON-1024771684 Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1447f1a9596e4bf4b6f1bcad819e2e1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1447f1a9596e4bf4b6f1bcad819e2e1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1447f1a9596e4bf4b6f1bcad819e2e1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1447f1a9596e4bf4b6f1bcad819e2e1d"}]}] Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ImagesTestJSON-1024771684 Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 1447f1a9596e4bf4b6f1bcad819e2e1d Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ImagesTestJSON-1024771684 Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ImagesTestJSON-1024771684-project Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 6f398d6cf40942df9f727e0033cdd813 Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ImagesTestJSON-1024771684-project Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-ImagesTestJSON-server-708456140", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "085c5084-6641-4d97-b026-eba4d19b3b13"}]}} Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-ImagesTestJSON-server-708456140', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '085c5084-6641-4d97-b026-eba4d19b3b13'}]}}} Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:31:42.107504 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:31:42.114605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3d2ad994-765b-41ca-bdc5-6fc90ea39981) Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f2cd4df9-4883-493c-9a20-d52329b65e3f tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f2cd4df9-4883-493c-9a20-d52329b65e3f tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.508446 Oct 12 13:31:42.119125 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 918/1808] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:31:40 2022] POST /compute/v2.1/servers => generated 214 bytes in 1510 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:31:42.543591 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-c985c0b6-331a-43a2-849b-e598bdd95645 req-dfc5602a-8d39-4211-908a-8024977e1153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17a9511-ef30-472b-928d-b0efc0e47126", "name": "network-vif-plugged", "status": "completed", "tag": "0e474f0b-c8da-4aa8-a005-11b1cde4cedd"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:31:42.556695 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-c985c0b6-331a-43a2-849b-e598bdd95645 req-dfc5602a-8d39-4211-908a-8024977e1153 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:42.557679 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-c985c0b6-331a-43a2-849b-e598bdd95645 req-dfc5602a-8d39-4211-908a-8024977e1153 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:42.558332 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-c985c0b6-331a-43a2-849b-e598bdd95645 req-dfc5602a-8d39-4211-908a-8024977e1153 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:42.571764 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-c985c0b6-331a-43a2-849b-e598bdd95645 req-dfc5602a-8d39-4211-908a-8024977e1153 service nova] Creating event network-vif-plugged:0e474f0b-c8da-4aa8-a005-11b1cde4cedd for instance a17a9511-ef30-472b-928d-b0efc0e47126 on n-h1-861076-2 Oct 12 13:31:42.579188 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-c985c0b6-331a-43a2-849b-e598bdd95645 req-dfc5602a-8d39-4211-908a-8024977e1153 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040479 Oct 12 13:31:42.580144 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 891/1809] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:31:42.838395 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b22abf4b-db96-4156-8643-812a5945460d tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1729721780", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "085c5084-6641-4d97-b026-eba4d19b3b13"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:31:42.850405 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e5e16fea-de5f-43d6-8ce7-d62a83dd48fe tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:42.855368 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e5e16fea-de5f-43d6-8ce7-d62a83dd48fe tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:31:42.861142 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e5e16fea-de5f-43d6-8ce7-d62a83dd48fe tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:42.861948 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e5e16fea-de5f-43d6-8ce7-d62a83dd48fe tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:42.862860 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e5e16fea-de5f-43d6-8ce7-d62a83dd48fe tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:42.863749 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e5e16fea-de5f-43d6-8ce7-d62a83dd48fe tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:42.865033 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e5e16fea-de5f-43d6-8ce7-d62a83dd48fe tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:42.865706 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e5e16fea-de5f-43d6-8ce7-d62a83dd48fe tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:42.919251 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-b22abf4b-db96-4156-8643-812a5945460d tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] validate_networks() for [('085c5084-6641-4d97-b026-eba4d19b3b13', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:31:43.126471 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-e5e16fea-de5f-43d6-8ce7-d62a83dd48fe tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a8d4d88cf44099aef748a804f1dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6338ad2886354139845460c4db1b6df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:31:43.135776 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e5e16fea-de5f-43d6-8ce7-d62a83dd48fe tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 200 len: 1316 microversion: 2.1 time: 0.291622 Oct 12 13:31:43.149463 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 892/1810] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:31:42 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-b22abf4b-db96-4156-8643-812a5945460d tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-33df338f-ba48-417f-8c55-d76bc9249eee) Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:31:44.093888 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-33df338f-ba48-417f-8c55-d76bc9249eee) Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-b22abf4b-db96-4156-8643-812a5945460d tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b22abf4b-db96-4156-8643-812a5945460d tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] Request method failure captured: Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 200 Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsG7f5gAkYTYcb5ZxFKrGb0R1lnMDupHsnutcBeA8zI4qtW7QolFo7J_AJtqsIKvJ_hhyGHsKzqvBMLj6CQ6JItzf4id-S_jpQbB4BL8XKPqwI0MT5tFWoJrl-YR1KjDh7fd1Fh0-N0BTObyfFbnS-012t2AHsJyLseZe5EZIKAPuMY Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 1447f1a9596e4bf4b6f1bcad819e2e1d Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ImagesTestJSON-1024771684 Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1447f1a9596e4bf4b6f1bcad819e2e1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1447f1a9596e4bf4b6f1bcad819e2e1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1447f1a9596e4bf4b6f1bcad819e2e1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1447f1a9596e4bf4b6f1bcad819e2e1d"}]}] Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ImagesTestJSON-1024771684 Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 1447f1a9596e4bf4b6f1bcad819e2e1d Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ImagesTestJSON-1024771684 Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ImagesTestJSON-1024771684-project Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 6f398d6cf40942df9f727e0033cdd813 Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ImagesTestJSON-1024771684-project Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-ImagesTestJSON-server-1729721780", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "085c5084-6641-4d97-b026-eba4d19b3b13"}]}} Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-ImagesTestJSON-server-1729721780', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '085c5084-6641-4d97-b026-eba4d19b3b13'}]}}} Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:31:44.097893 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:31:44.105840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-33df338f-ba48-417f-8c55-d76bc9249eee) Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b22abf4b-db96-4156-8643-812a5945460d tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b22abf4b-db96-4156-8643-812a5945460d tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.265276 Oct 12 13:31:44.108983 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 919/1811] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:31:42 2022] POST /compute/v2.1/servers => generated 214 bytes in 1270 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:31:44.162555 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f6c736d6-6677-4e8a-92e2-478dea9958e8 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:44.163293 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f6c736d6-6677-4e8a-92e2-478dea9958e8 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:31:44.178156 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f6c736d6-6677-4e8a-92e2-478dea9958e8 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:44.178727 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f6c736d6-6677-4e8a-92e2-478dea9958e8 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:44.179805 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f6c736d6-6677-4e8a-92e2-478dea9958e8 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:44.180823 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f6c736d6-6677-4e8a-92e2-478dea9958e8 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:44.181808 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f6c736d6-6677-4e8a-92e2-478dea9958e8 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:44.182372 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f6c736d6-6677-4e8a-92e2-478dea9958e8 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:44.336154 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f6c736d6-6677-4e8a-92e2-478dea9958e8 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a8d4d88cf44099aef748a804f1dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6338ad2886354139845460c4db1b6df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:31:44.344710 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f6c736d6-6677-4e8a-92e2-478dea9958e8 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 200 len: 1466 microversion: 2.1 time: 0.188681 Oct 12 13:31:44.345638 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 893/1812] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:31:44 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 1466 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:44.370485 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ab9ca7b4-30db-430f-8459-2dc147bdf924 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1768243943", "metadata": {"image_type": "test"}}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:31:44.373586 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-ab9ca7b4-30db-430f-8459-2dc147bdf924 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:31:44.382856 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ab9ca7b4-30db-430f-8459-2dc147bdf924 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:44.383562 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ab9ca7b4-30db-430f-8459-2dc147bdf924 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:44.398461 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ab9ca7b4-30db-430f-8459-2dc147bdf924 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:44.398461 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ab9ca7b4-30db-430f-8459-2dc147bdf924 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:44.398461 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ab9ca7b4-30db-430f-8459-2dc147bdf924 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:44.398461 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ab9ca7b4-30db-430f-8459-2dc147bdf924 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:44.441681 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-ab9ca7b4-30db-430f-8459-2dc147bdf924 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Getting quotas for project 6338ad2886354139845460c4db1b6df7. Resources: dict_keys(['metadata_items']) {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:31:44.447957 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-ab9ca7b4-30db-430f-8459-2dc147bdf924 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Getting quotas for user a2a8d4d88cf44099aef748a804f1dad0 and project 6338ad2886354139845460c4db1b6df7. Resources: dict_keys(['metadata_items']) {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:31:44.712179 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3522b9c9-2568-49df-be74-78c049c0dd6d tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-177435312", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "085c5084-6641-4d97-b026-eba4d19b3b13"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:31:44.787892 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-3522b9c9-2568-49df-be74-78c049c0dd6d tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] validate_networks() for [('085c5084-6641-4d97-b026-eba4d19b3b13', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-3522b9c9-2568-49df-be74-78c049c0dd6d tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-84487662-78b4-45bb-b079-7e9c86e5c2c9) Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:31:45.386629 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-84487662-78b4-45bb-b079-7e9c86e5c2c9) Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-3522b9c9-2568-49df-be74-78c049c0dd6d tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3522b9c9-2568-49df-be74-78c049c0dd6d tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] Request method failure captured: Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 199 Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsG7f5gAkYTYcb5ZxFKrGb0R1lnMDupHsnutcBeA8zI4qtW7QolFo7J_AJtqsIKvJ_hhyGHsKzqvBMLj6CQ6JItzf4id-S_jpQbB4BL8XKPqwI0MT5tFWoJrl-YR1KjDh7fd1Fh0-N0BTObyfFbnS-012t2AHsJyLseZe5EZIKAPuMY Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 1447f1a9596e4bf4b6f1bcad819e2e1d Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ImagesTestJSON-1024771684 Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1447f1a9596e4bf4b6f1bcad819e2e1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1447f1a9596e4bf4b6f1bcad819e2e1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1447f1a9596e4bf4b6f1bcad819e2e1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1447f1a9596e4bf4b6f1bcad819e2e1d"}]}] Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ImagesTestJSON-1024771684 Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 1447f1a9596e4bf4b6f1bcad819e2e1d Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ImagesTestJSON-1024771684 Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ImagesTestJSON-1024771684-project Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 6f398d6cf40942df9f727e0033cdd813 Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ImagesTestJSON-1024771684-project Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-ImagesTestJSON-server-177435312", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "085c5084-6641-4d97-b026-eba4d19b3b13"}]}} Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-ImagesTestJSON-server-177435312', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '085c5084-6641-4d97-b026-eba4d19b3b13'}]}}} Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:31:45.391523 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:31:45.395246 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-84487662-78b4-45bb-b079-7e9c86e5c2c9) Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3522b9c9-2568-49df-be74-78c049c0dd6d tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3522b9c9-2568-49df-be74-78c049c0dd6d tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.686922 Oct 12 13:31:45.399436 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 894/1813] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:31:44 2022] POST /compute/v2.1/servers => generated 214 bytes in 689 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 12 13:31:45.428715 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ab9ca7b4-30db-430f-8459-2dc147bdf924 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "POST /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126/action" status: 202 len: 0 microversion: 2.1 time: 1.062987 Oct 12 13:31:45.436278 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 920/1814] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:31:44 2022] POST /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126/action => generated 0 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 13:31:45.440029 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3f13d929-1055-49e0-839c-c26b39e8c9ea tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8aa3e3b0d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:45.994575 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-71a9714f-3bd5-4528-9d43-0b1d97a44881 tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-656568046", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "085c5084-6641-4d97-b026-eba4d19b3b13"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:31:46.059395 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-71a9714f-3bd5-4528-9d43-0b1d97a44881 tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] validate_networks() for [('085c5084-6641-4d97-b026-eba4d19b3b13', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:31:46.202767 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3f13d929-1055-49e0-839c-c26b39e8c9ea tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1422 microversion: 2.1 time: 0.766141 Oct 12 13:31:46.212751 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 895/1815] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:31:45 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1422 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-71a9714f-3bd5-4528-9d43-0b1d97a44881 tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d2ca788c-e08a-4ba1-8ec9-c4b2e77483d4) Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:31:46.633805 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d2ca788c-e08a-4ba1-8ec9-c4b2e77483d4) Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-71a9714f-3bd5-4528-9d43-0b1d97a44881 tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-71a9714f-3bd5-4528-9d43-0b1d97a44881 tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] Request method failure captured: Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 199 Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsG7f5gAkYTYcb5ZxFKrGb0R1lnMDupHsnutcBeA8zI4qtW7QolFo7J_AJtqsIKvJ_hhyGHsKzqvBMLj6CQ6JItzf4id-S_jpQbB4BL8XKPqwI0MT5tFWoJrl-YR1KjDh7fd1Fh0-N0BTObyfFbnS-012t2AHsJyLseZe5EZIKAPuMY Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 1447f1a9596e4bf4b6f1bcad819e2e1d Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ImagesTestJSON-1024771684 Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1447f1a9596e4bf4b6f1bcad819e2e1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1447f1a9596e4bf4b6f1bcad819e2e1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1447f1a9596e4bf4b6f1bcad819e2e1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1447f1a9596e4bf4b6f1bcad819e2e1d"}]}] Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ImagesTestJSON-1024771684 Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 1447f1a9596e4bf4b6f1bcad819e2e1d Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ImagesTestJSON-1024771684 Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ImagesTestJSON-1024771684-project Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 6f398d6cf40942df9f727e0033cdd813 Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ImagesTestJSON-1024771684-project Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-ImagesTestJSON-server-656568046", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "085c5084-6641-4d97-b026-eba4d19b3b13"}]}} Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-ImagesTestJSON-server-656568046', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '085c5084-6641-4d97-b026-eba4d19b3b13'}]}}} Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:31:46.642841 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:31:46.646826 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d2ca788c-e08a-4ba1-8ec9-c4b2e77483d4) Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-71a9714f-3bd5-4528-9d43-0b1d97a44881 tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-71a9714f-3bd5-4528-9d43-0b1d97a44881 tempest-ImagesTestJSON-1024771684 tempest-ImagesTestJSON-1024771684-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.653257 Oct 12 13:31:46.651446 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 921/1816] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:31:45 2022] POST /compute/v2.1/servers => generated 214 bytes in 655 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 12 13:31:47.220010 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f4af106d-a969-4e79-aa36-cb61e49b9610 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9ba51040>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:47.280302 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f4af106d-a969-4e79-aa36-cb61e49b9610 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1422 microversion: 2.1 time: 0.064176 Oct 12 13:31:47.282083 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 896/1817] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:31:47 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1422 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:48.298794 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ed3adc9b-17cd-4d04-aa9a-12a92712f528 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8aa03f3160>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:48.416265 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ed3adc9b-17cd-4d04-aa9a-12a92712f528 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1422 microversion: 2.1 time: 0.119536 Oct 12 13:31:48.417582 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 922/1818] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:31:48 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1422 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:49.440405 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a305a02e-3691-4dab-a404-262b2e3c5570 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9bd59430>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:49.522083 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a305a02e-3691-4dab-a404-262b2e3c5570 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1422 microversion: 2.1 time: 0.092332 Oct 12 13:31:49.523505 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 897/1819] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:31:49 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:50.412139 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-5a4320ea-2846-436d-9075-5120368973af req-8f6dfed0-cdea-40b9-8863-8ffea4c22431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17a9511-ef30-472b-928d-b0efc0e47126", "name": "network-vif-plugged", "status": "completed", "tag": "0e474f0b-c8da-4aa8-a005-11b1cde4cedd"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:31:50.424261 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:31:50.426751 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-5a4320ea-2846-436d-9075-5120368973af req-8f6dfed0-cdea-40b9-8863-8ffea4c22431 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:31:50.427419 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-5a4320ea-2846-436d-9075-5120368973af req-8f6dfed0-cdea-40b9-8863-8ffea4c22431 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:31:50.429182 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-5a4320ea-2846-436d-9075-5120368973af req-8f6dfed0-cdea-40b9-8863-8ffea4c22431 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:31:50.440680 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-5a4320ea-2846-436d-9075-5120368973af req-8f6dfed0-cdea-40b9-8863-8ffea4c22431 service nova] Creating event network-vif-plugged:0e474f0b-c8da-4aa8-a005-11b1cde4cedd for instance a17a9511-ef30-472b-928d-b0efc0e47126 on n-h1-861076-2 Oct 12 13:31:50.446270 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-5a4320ea-2846-436d-9075-5120368973af req-8f6dfed0-cdea-40b9-8863-8ffea4c22431 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038202 Oct 12 13:31:50.447466 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 923/1820] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:31:50.551314 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2afbd731-9efb-44f9-9f28-7a7938a62770 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9b3cb670>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:50.640264 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2afbd731-9efb-44f9-9f28-7a7938a62770 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1422 microversion: 2.1 time: 0.105046 Oct 12 13:31:50.641827 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 898/1821] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:31:50 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1422 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:51.658926 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-24ee9b27-be06-4cf2-9722-185b54bfd8ea tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9b9fdb80>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:51.764525 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-24ee9b27-be06-4cf2-9722-185b54bfd8ea tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1422 microversion: 2.1 time: 0.111303 Oct 12 13:31:51.765158 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 924/1822] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:31:51 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1422 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:52.780242 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4af49e59-aa5e-43d3-9179-d6eeb8106048 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9bd590d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:52.872506 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4af49e59-aa5e-43d3-9179-d6eeb8106048 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1422 microversion: 2.1 time: 0.096714 Oct 12 13:31:52.883048 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 899/1823] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:31:52 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1422 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:53.890207 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1d7e4f43-dc74-4222-8c54-d35eedf6f43f tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8aa034cca0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:54.026113 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1d7e4f43-dc74-4222-8c54-d35eedf6f43f tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1422 microversion: 2.1 time: 0.138337 Oct 12 13:31:54.033987 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 925/1824] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:31:53 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1422 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:55.039883 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=50 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:31:55.040454 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=76 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:31:55.044485 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cdaa3318-4c1a-40db-92ac-fac55888bd94 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9ba51550>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:55.127083 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cdaa3318-4c1a-40db-92ac-fac55888bd94 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1422 microversion: 2.1 time: 0.088749 Oct 12 13:31:55.138446 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 900/1825] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:31:55 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1422 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:56.145081 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-93f2d92e-5cde-4125-99c0-f1cf5194f440 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8aa03f31f0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:56.233818 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-93f2d92e-5cde-4125-99c0-f1cf5194f440 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1422 microversion: 2.1 time: 0.094343 Oct 12 13:31:56.234533 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 926/1826] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:31:56 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1422 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:57.258729 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b85c6959-a6ac-4a2d-8c9f-84653833a6ee tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9bd594c0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:57.392112 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b85c6959-a6ac-4a2d-8c9f-84653833a6ee tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1422 microversion: 2.1 time: 0.142454 Oct 12 13:31:57.394119 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 901/1827] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:31:57 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1422 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:31:58.410274 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a3fd3ae9-b9b9-4e90-a345-7aa5b3e903b2 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9bd01160>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:58.487492 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a3fd3ae9-b9b9-4e90-a345-7aa5b3e903b2 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1422 microversion: 2.1 time: 0.079053 Oct 12 13:31:58.491116 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 927/1828] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:31:58 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1422 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:31:59.138895 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3718ef62-6b3d-43d8-85e3-0be6fb41c6a0 tempest-TaggedBootDevicesTest_v242-1693284857 tempest-TaggedBootDevicesTest_v242-1693284857-project] Action: 'create', calling method: .version_select at 0x7f8a9b3cb700>, body: {"keypair": {"name": "tempest-keypair-1042952464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcBNJAlJwyYeGm0iLoUqzJMASAGarGr+BaNi3Rjuwqev5kWVPnCuwq4fESFy3EJqBhnmMYMuhKBP014bImtmFsSelmYQSAt+9c8eDOjdR0P2r1LbK5I3/NgvpIwX04Vmg=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:31:59.174213 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-3718ef62-6b3d-43d8-85e3-0be6fb41c6a0 tempest-TaggedBootDevicesTest_v242-1693284857 tempest-TaggedBootDevicesTest_v242-1693284857-project] Getting quotas for project 9563afdd8e5d44168520840b728589f0. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:31:59.185094 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-3718ef62-6b3d-43d8-85e3-0be6fb41c6a0 tempest-TaggedBootDevicesTest_v242-1693284857 tempest-TaggedBootDevicesTest_v242-1693284857-project] Getting quotas for user 33ac777507b74ece99233cb1fbfb6160 and project 9563afdd8e5d44168520840b728589f0. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:31:59.319890 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3718ef62-6b3d-43d8-85e3-0be6fb41c6a0 tempest-TaggedBootDevicesTest_v242-1693284857 tempest-TaggedBootDevicesTest_v242-1693284857-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.187095 Oct 12 13:31:59.320922 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 902/1829] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Oct 12 13:31:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 189 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 12 13:31:59.504009 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fc70752c-96b9-4455-821f-02bdb7596f3f tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9b9fd4c0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:31:59.588004 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fc70752c-96b9-4455-821f-02bdb7596f3f tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1422 microversion: 2.1 time: 0.087728 Oct 12 13:31:59.589151 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 928/1830] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:31:59 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1422 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:00.605849 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-76fdb599-f34f-49c9-b16d-3436fda554b6 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8aa3e3b8b0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:00.663732 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-76fdb599-f34f-49c9-b16d-3436fda554b6 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1422 microversion: 2.1 time: 0.062716 Oct 12 13:32:00.667421 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 903/1831] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:00 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1422 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:01.678526 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:32:01.683742 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d33c517d-2612-4c2b-ab97-e2a60e06cb03 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9b9fdc10>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:01.752833 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d33c517d-2612-4c2b-ab97-e2a60e06cb03 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1422 microversion: 2.1 time: 0.075178 Oct 12 13:32:01.755998 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 929/1832] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:01 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1422 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:02.770216 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b70e3066-1d3f-489b-a4ed-6a641650d8ef tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9bd59700>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:02.821325 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b70e3066-1d3f-489b-a4ed-6a641650d8ef tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1422 microversion: 2.1 time: 0.056630 Oct 12 13:32:02.833307 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 904/1833] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:02 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1422 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:03.838286 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0242858d-6a9d-4d03-b089-7cd11f4ab620 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9b9fd160>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:03.932639 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0242858d-6a9d-4d03-b089-7cd11f4ab620 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1422 microversion: 2.1 time: 0.099541 Oct 12 13:32:03.933448 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 930/1834] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:03 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1422 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:04.398836 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6287a840-4a03-468e-918b-ec36074bd979 tempest-TaggedBootDevicesTest_v242-1693284857 tempest-TaggedBootDevicesTest_v242-1693284857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-170793538", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b2b06842-41ad-4559-a787-709a1c5df127"}, {"port": "991a1e71-698a-4fd0-a6dd-1891bed46364", "tag": "port-1"}, {"port": "c4ba1c41-5f12-4a64-b156-7721c68ac99f", "tag": "port-2"}, {"uuid": "f2039d0e-5670-4ee5-896b-8bb69ef6c71b", "tag": "net-1"}, {"uuid": "f2039d0e-5670-4ee5-896b-8bb69ef6c71b"}, {"uuid": "6dd4ea29-42ce-4139-87c6-97c6ea8399ac", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "6dd4ea29-42ce-4139-87c6-97c6ea8399ac", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "64fdab1d-0f89-4fa3-a3fa-056959bd4082", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c8a23ca3-0661-482e-be8e-3fc867ae0c88", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "0fe95185-eca8-4faa-ba90-9526d6dc96c4", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1253571309"}], "key_name": "tempest-keypair-1042952464", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:32:04.643673 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-6287a840-4a03-468e-918b-ec36074bd979 tempest-TaggedBootDevicesTest_v242-1693284857 tempest-TaggedBootDevicesTest_v242-1693284857-project] validate_networks() for [('b2b06842-41ad-4559-a787-709a1c5df127', None, None, None, None, None), (None, None, '991a1e71-698a-4fd0-a6dd-1891bed46364', None, None, None), (None, None, 'c4ba1c41-5f12-4a64-b156-7721c68ac99f', None, None, None), ('f2039d0e-5670-4ee5-896b-8bb69ef6c71b', None, None, None, None, None), ('f2039d0e-5670-4ee5-896b-8bb69ef6c71b', None, None, None, None, None), ('6dd4ea29-42ce-4139-87c6-97c6ea8399ac', '10.2.2.100', None, None, None, None), ('6dd4ea29-42ce-4139-87c6-97c6ea8399ac', '10.2.2.200', None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:32:04.948777 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-07ef344c-337c-4eb3-a3cc-9e7b178c9269 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8aa00459d0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:04.956002 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:32:05.044826 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-07ef344c-337c-4eb3-a3cc-9e7b178c9269 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1422 microversion: 2.1 time: 0.101087 Oct 12 13:32:05.048180 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 931/1835] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:04 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1422 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-6287a840-4a03-468e-918b-ec36074bd979 tempest-TaggedBootDevicesTest_v242-1693284857 tempest-TaggedBootDevicesTest_v242-1693284857-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c8d68875-0005-448b-9ffe-ebcf904e6353) Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:32:05.921205 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:32:05.931042 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:32:05.931042 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:32:05.931042 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:32:05.931042 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:32:05.931042 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:32:05.931042 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:32:05.931042 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:32:05.931042 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:32:05.931042 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:32:05.931042 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:32:05.931042 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:32:05.931042 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:32:05.931042 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:32:05.931042 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:32:05.931042 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:32:05.931042 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c8d68875-0005-448b-9ffe-ebcf904e6353) Oct 12 13:32:05.931042 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:32:05.933132 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-6287a840-4a03-468e-918b-ec36074bd979 tempest-TaggedBootDevicesTest_v242-1693284857 tempest-TaggedBootDevicesTest_v242-1693284857-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:32:05.933132 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6287a840-4a03-468e-918b-ec36074bd979 tempest-TaggedBootDevicesTest_v242-1693284857 tempest-TaggedBootDevicesTest_v242-1693284857-project] Request method failure captured: Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 1344 Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsGQm39LQ-OFXMzU9tbZ4b3zdmkqbEslID7Yotm8w78j-f1qtz-UQKAhw0pSSgZV_fLdKROnbMuotLV7XpJ0XRdgocP2SMvPrQJkFNul1cFZyAzd7f8cw9j2P-g_BltBaoIyGXsHt_MGkbh__LPcqdwXVC_AfrlcoLMSYkgLqZwKwAI Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: X-Openstack-Nova-Api-Version: 2.42 Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 9563afdd8e5d44168520840b728589f0 Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1693284857 Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9563afdd8e5d44168520840b728589f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9563afdd8e5d44168520840b728589f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9563afdd8e5d44168520840b728589f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9563afdd8e5d44168520840b728589f0"}]}] Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1693284857 Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 9563afdd8e5d44168520840b728589f0 Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1693284857 Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-TaggedBootDevicesTest_v242-1693284857-project Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 33ac777507b74ece99233cb1fbfb6160 Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1693284857-project Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-device-tagging-server-170793538", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b2b06842-41ad-4559-a787-709a1c5df127"}, {"port": "991a1e71-698a-4fd0-a6dd-1891bed46364", "tag": "port-1"}, {"port": "c4ba1c41-5f12-4a64-b156-7721c68ac99f", "tag": "port-2"}, {"uuid": "f2039d0e-5670-4ee5-896b-8bb69ef6c71b", "tag": "net-1"}, {"uuid": "f2039d0e-5670-4ee5-896b-8bb69ef6c71b"}, {"uuid": "6dd4ea29-42ce-4139-87c6-97c6ea8399ac", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "6dd4ea29-42ce-4139-87c6-97c6ea8399ac", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "64fdab1d-0f89-4fa3-a3fa-056959bd4082", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c8a23ca3-0661-482e-be8e-3fc867ae0c88", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "0fe95185-eca8-4faa-ba90-9526d6dc96c4", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1253571309"}], "key_name": "tempest-keypair-1042952464", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-device-tagging-server-170793538', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'config_drive': True, 'networks': [{'uuid': 'b2b06842-41ad-4559-a787-709a1c5df127'}, {'port': '991a1e71-698a-4fd0-a6dd-1891bed46364', 'tag': 'port-1'}, {'port': 'c4ba1c41-5f12-4a64-b156-7721c68ac99f', 'tag': 'port-2'}, {'uuid': 'f2039d0e-5670-4ee5-896b-8bb69ef6c71b', 'tag': 'net-1'}, {'uuid': 'f2039d0e-5670-4ee5-896b-8bb69ef6c71b'}, {'uuid': '6dd4ea29-42ce-4139-87c6-97c6ea8399ac', 'fixed_ip': '10.2.2.100', 'tag': 'net-2-100'}, {'uuid': '6dd4ea29-42ce-4139-87c6-97c6ea8399ac', 'fixed_ip': '10.2.2.200', 'tag': 'net-2-200'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'tag': 'boot', 'volume_id': '64fdab1d-0f89-4fa3-a3fa-056959bd4082', 'delete_on_termination': False}, {'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 1, 'tag': 'other', 'volume_id': 'c8a23ca3-0661-482e-be8e-3fc867ae0c88', 'delete_on_termination': False}, {'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 2, 'volume_id': '0fe95185-eca8-4faa-ba90-9526d6dc96c4', 'delete_on_termination': False}], 'security_groups': [{'name': 'tempest-securitygroup--1253571309'}], 'key_name': 'tempest-keypair-1042952464', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:32:05.939125 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:32:05.941548 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c8d68875-0005-448b-9ffe-ebcf904e6353) Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:32:05.944658 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:32:05.953563 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6287a840-4a03-468e-918b-ec36074bd979 tempest-TaggedBootDevicesTest_v242-1693284857 tempest-TaggedBootDevicesTest_v242-1693284857-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:32:05.953563 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:32:05.959548 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6287a840-4a03-468e-918b-ec36074bd979 tempest-TaggedBootDevicesTest_v242-1693284857 tempest-TaggedBootDevicesTest_v242-1693284857-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.42 time: 1.565255 Oct 12 13:32:05.962628 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 905/1836] 10.222.0.52 () {62 vars in 1189 bytes} [Wed Oct 12 13:32:04 2022] POST /compute/v2.1/servers => generated 214 bytes in 1569 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Oct 12 13:32:05.975878 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e39c83e2-c96d-46d1-9e1a-b12da986ef6a tempest-TaggedBootDevicesTest_v242-1693284857 tempest-TaggedBootDevicesTest_v242-1693284857-project] Calling method '.version_select at 0x7f8a9bb78c10>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:06.063841 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cd7f9b7b-7618-4c88-9f35-67399a77e8f0 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9b3cbee0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:06.096824 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e39c83e2-c96d-46d1-9e1a-b12da986ef6a tempest-TaggedBootDevicesTest_v242-1693284857 tempest-TaggedBootDevicesTest_v242-1693284857-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1042952464" status: 204 len: 0 microversion: 2.42 time: 0.125207 Oct 12 13:32:06.097774 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 932/1837] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Oct 12 13:32:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1042952464 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 13:32:06.147179 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cd7f9b7b-7618-4c88-9f35-67399a77e8f0 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1422 microversion: 2.1 time: 0.087605 Oct 12 13:32:06.147766 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 906/1838] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:06 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1422 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:07.165173 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-af168b66-f037-4c3d-b9fc-e3a73a4005ac tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9bfe3940>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:07.270386 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-af168b66-f037-4c3d-b9fc-e3a73a4005ac tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1422 microversion: 2.1 time: 0.104975 Oct 12 13:32:07.274991 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 933/1839] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:07 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1422 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:08.314452 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4abcfcc5-dae3-4c0c-8250-782c6937e6b0 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9b3cb820>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:08.351947 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4abcfcc5-dae3-4c0c-8250-782c6937e6b0 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1422 microversion: 2.1 time: 0.068772 Oct 12 13:32:08.352552 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 907/1840] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:08 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1422 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:09.379889 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6ae24de2-480d-4889-88e4-0b3dbb0b5528 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8aa0321d30>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:09.458454 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6ae24de2-480d-4889-88e4-0b3dbb0b5528 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1422 microversion: 2.1 time: 0.086430 Oct 12 13:32:09.459618 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 934/1841] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:09 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1422 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:10.471429 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:32:10.476696 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-283d69e6-1253-46de-854d-978f4e582bcf tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8aa3df6c10>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:10.543171 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-283d69e6-1253-46de-854d-978f4e582bcf tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1431 microversion: 2.1 time: 0.072347 Oct 12 13:32:10.546765 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 908/1842] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:10 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1431 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:10.557906 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6a347e01-0d18-469c-9ce8-8405516a6c71 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9b9d3310>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:10.692466 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6a347e01-0d18-469c-9ce8-8405516a6c71 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 200 len: 1431 microversion: 2.1 time: 0.136072 Oct 12 13:32:10.693305 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 935/1843] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:10 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 1431 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:10.708621 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0931a90d-cc0a-4791-bb9e-a13317cc00f0 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:10.709828 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0931a90d-cc0a-4791-bb9e-a13317cc00f0 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:32:10.716652 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0931a90d-cc0a-4791-bb9e-a13317cc00f0 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:10.717250 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0931a90d-cc0a-4791-bb9e-a13317cc00f0 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:10.717949 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0931a90d-cc0a-4791-bb9e-a13317cc00f0 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:10.718873 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0931a90d-cc0a-4791-bb9e-a13317cc00f0 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:10.720226 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0931a90d-cc0a-4791-bb9e-a13317cc00f0 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:10.721232 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0931a90d-cc0a-4791-bb9e-a13317cc00f0 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:11.039737 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-0931a90d-cc0a-4791-bb9e-a13317cc00f0 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a8d4d88cf44099aef748a804f1dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6338ad2886354139845460c4db1b6df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:32:11.065423 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0931a90d-cc0a-4791-bb9e-a13317cc00f0 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 200 len: 1479 microversion: 2.1 time: 0.357256 Oct 12 13:32:11.088767 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 909/1844] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:32:10 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 1479 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:12.096343 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-54609042-0353-45d2-a5ca-38c2aa63c280 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:12.103162 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-54609042-0353-45d2-a5ca-38c2aa63c280 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:32:12.142397 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-54609042-0353-45d2-a5ca-38c2aa63c280 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:12.159011 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-54609042-0353-45d2-a5ca-38c2aa63c280 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:12.163596 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-54609042-0353-45d2-a5ca-38c2aa63c280 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:12.164705 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-54609042-0353-45d2-a5ca-38c2aa63c280 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:12.166504 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-54609042-0353-45d2-a5ca-38c2aa63c280 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:12.175460 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-54609042-0353-45d2-a5ca-38c2aa63c280 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:12.521220 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-54609042-0353-45d2-a5ca-38c2aa63c280 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a8d4d88cf44099aef748a804f1dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6338ad2886354139845460c4db1b6df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:32:12.532157 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-54609042-0353-45d2-a5ca-38c2aa63c280 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 200 len: 1466 microversion: 2.1 time: 0.441225 Oct 12 13:32:12.538756 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 936/1845] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:32:12 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 1466 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:12.570578 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ac5e8427-3965-4365-acb8-e3e4a7a60c59 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8aa02fb940>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:12.644867 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ac5e8427-3965-4365-acb8-e3e4a7a60c59 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/92c34f67-0f72-4439-9fdb-d8567b96935c" status: 200 len: 784 microversion: 2.1 time: 0.089931 Oct 12 13:32:12.645719 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 910/1846] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:12 2022] GET /compute/v2.1/images/92c34f67-0f72-4439-9fdb-d8567b96935c => generated 784 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:32:12.665386 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-71000ce3-c05d-44a8-9746-0e72f6dec4c6 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:12.690155 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-71000ce3-c05d-44a8-9746-0e72f6dec4c6 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017075 Oct 12 13:32:12.690155 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 911/1847] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:32:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:32:12.705156 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-21b122f8-9839-4fc8-b572-37b6a37b3a5b tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9b68e040>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:12.978143 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-edd17516-2a46-469b-99e7-9264b6a49192 tempest-ImagesOneServerNegativeTestJSON-632272171 tempest-ImagesOneServerNegativeTestJSON-632272171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1449074278", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "3c6c8201-10f5-4e34-b44d-b366ced04a68"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:32:13.038184 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-edd17516-2a46-469b-99e7-9264b6a49192 tempest-ImagesOneServerNegativeTestJSON-632272171 tempest-ImagesOneServerNegativeTestJSON-632272171-project] validate_networks() for [('3c6c8201-10f5-4e34-b44d-b366ced04a68', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-edd17516-2a46-469b-99e7-9264b6a49192 tempest-ImagesOneServerNegativeTestJSON-632272171 tempest-ImagesOneServerNegativeTestJSON-632272171-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-317306de-e9ca-462f-a50f-54648eefcc9a) Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:32:14.245176 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-317306de-e9ca-462f-a50f-54648eefcc9a) Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-edd17516-2a46-469b-99e7-9264b6a49192 tempest-ImagesOneServerNegativeTestJSON-632272171 tempest-ImagesOneServerNegativeTestJSON-632272171-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-edd17516-2a46-469b-99e7-9264b6a49192 tempest-ImagesOneServerNegativeTestJSON-632272171 tempest-ImagesOneServerNegativeTestJSON-632272171-project] Request method failure captured: Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 217 Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsHbqISkRd1v4VWutF1I1mzQutPfpTl9QGokt8okuozSUCFHiDq_MpZYxVgS0qC-3GtHgp4duRI8MsRdVwSMwUK24tHFsuMxH6eKjghiQtNK3WYCaTFJRGAQ0c1MF3exBuEXwqJnup-RcA2XT98H15vnjuolGdFr2iv62jEYZTN8VV8 Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: f6f8f34ef87e4b128f457bbb6d73ecf9 Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-632272171 Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f6f8f34ef87e4b128f457bbb6d73ecf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f6f8f34ef87e4b128f457bbb6d73ecf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f6f8f34ef87e4b128f457bbb6d73ecf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f6f8f34ef87e4b128f457bbb6d73ecf9"}]}] Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-632272171 Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: f6f8f34ef87e4b128f457bbb6d73ecf9 Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-632272171 Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ImagesOneServerNegativeTestJSON-632272171-project Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: d67070e94a684c2eb8ae0422b4b0f66d Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-632272171-project Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1449074278", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "3c6c8201-10f5-4e34-b44d-b366ced04a68"}]}} Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:32:14.251486 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-ImagesOneServerNegativeTestJSON-server-1449074278', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '3c6c8201-10f5-4e34-b44d-b366ced04a68'}]}}} Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:32:14.258092 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-317306de-e9ca-462f-a50f-54648eefcc9a) Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-edd17516-2a46-469b-99e7-9264b6a49192 tempest-ImagesOneServerNegativeTestJSON-632272171 tempest-ImagesOneServerNegativeTestJSON-632272171-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-edd17516-2a46-469b-99e7-9264b6a49192 tempest-ImagesOneServerNegativeTestJSON-632272171 tempest-ImagesOneServerNegativeTestJSON-632272171-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.637128 Oct 12 13:32:14.272100 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 937/1848] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:32:12 2022] POST /compute/v2.1/servers => generated 214 bytes in 1638 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 12 13:32:14.479044 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-f60a2f3b-7627-4a35-8a65-435a056ccc2a req-12bc08f5-018e-4c4f-a1f4-db4da354b8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17a9511-ef30-472b-928d-b0efc0e47126", "name": "network-vif-unplugged", "status": "completed", "tag": "0e474f0b-c8da-4aa8-a005-11b1cde4cedd"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:32:14.513015 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-f60a2f3b-7627-4a35-8a65-435a056ccc2a req-12bc08f5-018e-4c4f-a1f4-db4da354b8b5 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:14.514355 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-f60a2f3b-7627-4a35-8a65-435a056ccc2a req-12bc08f5-018e-4c4f-a1f4-db4da354b8b5 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:14.517522 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-f60a2f3b-7627-4a35-8a65-435a056ccc2a req-12bc08f5-018e-4c4f-a1f4-db4da354b8b5 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:14.577457 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-f60a2f3b-7627-4a35-8a65-435a056ccc2a req-12bc08f5-018e-4c4f-a1f4-db4da354b8b5 service nova] Creating event network-vif-unplugged:0e474f0b-c8da-4aa8-a005-11b1cde4cedd for instance a17a9511-ef30-472b-928d-b0efc0e47126 on n-h1-861076-2 Oct 12 13:32:14.603075 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-f60a2f3b-7627-4a35-8a65-435a056ccc2a req-12bc08f5-018e-4c4f-a1f4-db4da354b8b5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123859 Oct 12 13:32:14.605883 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 938/1849] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:32:15.146228 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-21b122f8-9839-4fc8-b572-37b6a37b3a5b tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "DELETE /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 204 len: 0 microversion: 2.1 time: 2.451565 Oct 12 13:32:15.146809 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 912/1850] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:32:12 2022] DELETE /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 0 bytes in 2453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:32:15.157436 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1fffdc37-cb4c-4216-b577-c8ab06b3864a tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9bfe3550>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:15.198551 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-1fffdc37-cb4c-4216-b577-c8ab06b3864a tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] HTTP exception thrown: Image not found. Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1fffdc37-cb4c-4216-b577-c8ab06b3864a tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Request method failure captured: Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 HTTP/1.1 Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsGss46EUkjCm8EZXRwW36t3s03IBOw3hwE4z3xyAzZWD32RP1uUfGI1S_1k0dVzn55y05YNkPXwtkKRKtetZipxTqLs8RWTeKnLruvMgjWTVJ50kdEoQdLNAQVO5ynt4DdfccRBoVrSwTxzFMiTUR0RIcfLYAVO5BPzwA3VSEC6Q-8 Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 6338ad2886354139845460c4db1b6df7 Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ImagesOneServerTestJSON-799618320 Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6338ad2886354139845460c4db1b6df7"}]}, {"type": "tempest-type-445636729", "name": "tempest-service-586230299", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6338ad2886354139845460c4db1b6df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6338ad2886354139845460c4db1b6df7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6338ad2886354139845460c4db1b6df7"}]}] Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ImagesOneServerTestJSON-799618320 Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 6338ad2886354139845460c4db1b6df7 Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-799618320 Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ImagesOneServerTestJSON-799618320-project Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: a2a8d4d88cf44099aef748a804f1dad0 Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ImagesOneServerTestJSON-799618320-project Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: exception: Image not found. Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '6f057543-6efb-45bc-a0a8-cd81a1208c72'} Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6f057543-6efb-45bc-a0a8-cd81a1208c72 Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 13:32:15.201494 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6f057543-6efb-45bc-a0a8-cd81a1208c72 could not be found. Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 13:32:15.205854 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:32:15.221625 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1fffdc37-cb4c-4216-b577-c8ab06b3864a tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Returning 404 to user: Image not found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:32:15.223686 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1fffdc37-cb4c-4216-b577-c8ab06b3864a tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 404 len: 62 microversion: 2.1 time: 0.072445 Oct 12 13:32:15.232881 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 939/1851] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:15 2022] GET /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:32:15.240331 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0fbd6715-78c0-44db-9526-344862635195 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1198137255"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:32:15.244456 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0fbd6715-78c0-44db-9526-344862635195 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:32:15.267733 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0fbd6715-78c0-44db-9526-344862635195 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:15.273208 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0fbd6715-78c0-44db-9526-344862635195 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:15.273208 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0fbd6715-78c0-44db-9526-344862635195 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:15.273208 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0fbd6715-78c0-44db-9526-344862635195 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:15.277095 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0fbd6715-78c0-44db-9526-344862635195 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:15.282063 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0fbd6715-78c0-44db-9526-344862635195 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:15.923790 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0fbd6715-78c0-44db-9526-344862635195 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "POST /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126/action" status: 202 len: 0 microversion: 2.1 time: 0.688864 Oct 12 13:32:15.945315 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 913/1852] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:32:15 2022] POST /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126/action => generated 0 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 13:32:15.956564 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9f1ca86d-8ab8-4748-9ad8-773a0efd877a tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9bca5ee0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:16.015795 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9f1ca86d-8ab8-4748-9ad8-773a0efd877a tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.063858 Oct 12 13:32:16.017135 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 940/1853] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:15 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:17.033004 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-601cb679-05ac-4efb-bd4e-eb89f8835533 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8aa3dfb820>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:17.126493 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-601cb679-05ac-4efb-bd4e-eb89f8835533 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.098525 Oct 12 13:32:17.128334 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 914/1854] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:17 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:18.143478 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ea136888-9eac-4d3c-ac99-7dcda2b78150 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9bd01550>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:18.208126 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ea136888-9eac-4d3c-ac99-7dcda2b78150 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.069360 Oct 12 13:32:18.209061 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 941/1855] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:18 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:19.227088 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d3388a0f-f2ce-4ee7-88a5-0c2368260b56 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9b5f58b0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:19.300718 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d3388a0f-f2ce-4ee7-88a5-0c2368260b56 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.076103 Oct 12 13:32:19.301459 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 915/1856] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:19 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:20.319080 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c739b23d-e4c4-47d9-b25a-94235734c332 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9b9d3310>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:20.417329 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c739b23d-e4c4-47d9-b25a-94235734c332 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.104939 Oct 12 13:32:20.419350 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 942/1857] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:20 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:21.436233 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-16bf2a45-79d4-4a35-a102-55eb8133002b tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9b68e9d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:21.521438 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-16bf2a45-79d4-4a35-a102-55eb8133002b tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.089460 Oct 12 13:32:21.522258 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 916/1858] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:21 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:22.539151 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-496ae93a-cf26-42e8-8c0f-6820167e4de7 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8aa017b310>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:22.618982 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-496ae93a-cf26-42e8-8c0f-6820167e4de7 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.085569 Oct 12 13:32:22.619559 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 943/1859] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:22 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:22.710687 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-ba7bc053-572b-45c4-a827-1cdf3fb43530 req-fa3e7ca5-507f-4e9e-9888-03fcb4a9b2eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17a9511-ef30-472b-928d-b0efc0e47126", "name": "network-vif-plugged", "status": "completed", "tag": "0e474f0b-c8da-4aa8-a005-11b1cde4cedd"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:32:22.738975 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ba7bc053-572b-45c4-a827-1cdf3fb43530 req-fa3e7ca5-507f-4e9e-9888-03fcb4a9b2eb service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:22.739719 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ba7bc053-572b-45c4-a827-1cdf3fb43530 req-fa3e7ca5-507f-4e9e-9888-03fcb4a9b2eb service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:22.741746 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ba7bc053-572b-45c4-a827-1cdf3fb43530 req-fa3e7ca5-507f-4e9e-9888-03fcb4a9b2eb service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:22.783615 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-ba7bc053-572b-45c4-a827-1cdf3fb43530 req-fa3e7ca5-507f-4e9e-9888-03fcb4a9b2eb service nova] Creating event network-vif-plugged:0e474f0b-c8da-4aa8-a005-11b1cde4cedd for instance a17a9511-ef30-472b-928d-b0efc0e47126 on n-h1-861076-2 Oct 12 13:32:22.809908 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-ba7bc053-572b-45c4-a827-1cdf3fb43530 req-fa3e7ca5-507f-4e9e-9888-03fcb4a9b2eb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104142 Oct 12 13:32:22.810721 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 917/1860] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:32:23.643813 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ca549ffd-b636-4fcc-9673-50c14bc2c8da tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9b9fd820>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:23.729570 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ca549ffd-b636-4fcc-9673-50c14bc2c8da tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.089540 Oct 12 13:32:23.745511 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 944/1861] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:23 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:24.756952 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bdd457db-0562-47f1-b58c-bc951e304716 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8aa3e66af0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:24.845861 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bdd457db-0562-47f1-b58c-bc951e304716 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.096405 Oct 12 13:32:24.846521 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 918/1862] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:24 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:32:25.859162 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:32:25.859954 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=8 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:32:25.864769 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-42afc55f-37ad-4532-9e20-632ce6cbf227 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9be7c9d0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:25.946293 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-42afc55f-37ad-4532-9e20-632ce6cbf227 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.087924 Oct 12 13:32:25.952805 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 945/1863] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:25 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:26.964023 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-98ef789e-4ed0-4a39-ae06-58e1566983fa tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9b68ea60>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:27.032173 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-98ef789e-4ed0-4a39-ae06-58e1566983fa tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.072454 Oct 12 13:32:27.041942 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 919/1864] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:26 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:28.050632 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-60b309e0-6246-43d3-81a3-7121c05c8978 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9b9d3670>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:28.121969 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-60b309e0-6246-43d3-81a3-7121c05c8978 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.077585 Oct 12 13:32:28.124154 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 946/1865] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:28 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:29.143984 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d3c240fb-8a3e-44b9-b7c5-3f17457b6f80 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9b414ee0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:29.239445 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d3c240fb-8a3e-44b9-b7c5-3f17457b6f80 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.101723 Oct 12 13:32:29.241023 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 920/1866] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:29 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:30.257272 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6803c213-1ca9-4431-b047-cc81d560c184 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8aa04ef8b0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:30.342912 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6803c213-1ca9-4431-b047-cc81d560c184 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.091608 Oct 12 13:32:30.344450 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 947/1867] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:30 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:31.364882 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b9d5d7c9-9ad4-4f81-92cb-a9ca4ed41626 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9b3cbee0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:31.442942 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b9d5d7c9-9ad4-4f81-92cb-a9ca4ed41626 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.081752 Oct 12 13:32:31.443550 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 921/1868] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:31 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:32.459306 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-99976b96-ec4b-42c9-b02a-2104f71e68d8 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8aa01d65e0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:32.548846 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-99976b96-ec4b-42c9-b02a-2104f71e68d8 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.093878 Oct 12 13:32:32.560367 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 948/1869] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:32 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:33.567251 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:32:33.570039 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:32:33.589777 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-34d911a9-8594-4973-8c92-bf56ae729085 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8aa3e3bdc0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:33.731609 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-34d911a9-8594-4973-8c92-bf56ae729085 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.168010 Oct 12 13:32:33.733243 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 922/1870] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:33 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:34.752943 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-539b0cee-5641-436a-9b39-2b46d73cc8a3 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8aa0321d30>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:34.852672 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-539b0cee-5641-436a-9b39-2b46d73cc8a3 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.108349 Oct 12 13:32:34.854174 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 949/1871] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:34 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:35.875257 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4fbb2920-bab2-45c7-b9c8-44f0d3393a73 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9b3cb8b0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:35.950501 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4fbb2920-bab2-45c7-b9c8-44f0d3393a73 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.082226 Oct 12 13:32:35.952978 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 923/1872] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:35 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:36.967938 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2e080b20-f0ae-4f86-ad75-1d17e1b83ca0 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9bfe3af0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:37.043457 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2e080b20-f0ae-4f86-ad75-1d17e1b83ca0 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.077324 Oct 12 13:32:37.043457 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 950/1873] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:36 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:32:38.064548 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a7395faf-2679-437c-85e3-463ea80c0f8f tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9b5f55e0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:38.199980 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a7395faf-2679-437c-85e3-463ea80c0f8f tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.141473 Oct 12 13:32:38.201598 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 924/1874] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:38 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:39.224596 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9cf7a31a-f4ac-45d9-8e75-633cf545e398 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9bb780d0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:39.312757 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9cf7a31a-f4ac-45d9-8e75-633cf545e398 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.092489 Oct 12 13:32:39.316084 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 951/1875] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:39 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:40.332962 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f1946190-93de-4818-9682-1463b93f077a tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8aa3e00ca0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:40.432126 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f1946190-93de-4818-9682-1463b93f077a tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.104306 Oct 12 13:32:40.432738 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 925/1876] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:40 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:41.447523 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4d062a79-ee32-42e7-a426-cdae5268d426 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9b928a60>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:41.544846 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4d062a79-ee32-42e7-a426-cdae5268d426 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.100610 Oct 12 13:32:41.551399 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 952/1877] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:41 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:42.566831 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b7d41d46-08a2-49d0-9b25-fd9acbe3a179 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9b414280>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:42.714704 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b7d41d46-08a2-49d0-9b25-fd9acbe3a179 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.152230 Oct 12 13:32:42.715310 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 926/1878] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:42 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:43.730549 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-382ddd82-425f-4414-a95d-fe51ab590083 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9bf569d0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:43.855701 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-382ddd82-425f-4414-a95d-fe51ab590083 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.128952 Oct 12 13:32:43.858706 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 953/1879] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:43 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:44.871639 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-12a51331-c669-4833-ac1a-594eb193bb21 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8aa3e66af0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:44.984872 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-12a51331-c669-4833-ac1a-594eb193bb21 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1427 microversion: 2.1 time: 0.117234 Oct 12 13:32:44.985489 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 927/1880] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:44 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1427 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:46.013303 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-52fb2e18-2241-411f-8c87-72dc98c5d84c tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9bd38dc0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:46.099821 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-52fb2e18-2241-411f-8c87-72dc98c5d84c tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1436 microversion: 2.1 time: 0.103501 Oct 12 13:32:46.100735 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 954/1881] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:45 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1436 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:46.115844 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1e0e0d76-d12b-49ff-9fff-281429c096c9 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8aa3e00280>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:46.199326 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1e0e0d76-d12b-49ff-9fff-281429c096c9 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 200 len: 1436 microversion: 2.1 time: 0.087735 Oct 12 13:32:46.220246 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7be81205-dc88-4a8f-aec0-109f9113eb45 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:46.221913 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7be81205-dc88-4a8f-aec0-109f9113eb45 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:32:46.227529 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 928/1882] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Oct 12 13:32:46 2022] GET /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 1436 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:46.233341 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7be81205-dc88-4a8f-aec0-109f9113eb45 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:46.234144 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7be81205-dc88-4a8f-aec0-109f9113eb45 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:46.234769 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7be81205-dc88-4a8f-aec0-109f9113eb45 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:46.236084 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7be81205-dc88-4a8f-aec0-109f9113eb45 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:46.236728 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7be81205-dc88-4a8f-aec0-109f9113eb45 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:46.237383 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7be81205-dc88-4a8f-aec0-109f9113eb45 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:46.494905 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-7be81205-dc88-4a8f-aec0-109f9113eb45 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a8d4d88cf44099aef748a804f1dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6338ad2886354139845460c4db1b6df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:32:46.507880 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-7be81205-dc88-4a8f-aec0-109f9113eb45 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 200 len: 1479 microversion: 2.1 time: 0.294526 Oct 12 13:32:46.520112 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 955/1883] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:32:46 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 1479 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:47.533526 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cae4e905-f681-447a-bcd7-55fb382041b9 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:47.542062 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cae4e905-f681-447a-bcd7-55fb382041b9 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:32:47.562483 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cae4e905-f681-447a-bcd7-55fb382041b9 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:47.569214 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cae4e905-f681-447a-bcd7-55fb382041b9 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:47.573854 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cae4e905-f681-447a-bcd7-55fb382041b9 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:47.576408 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cae4e905-f681-447a-bcd7-55fb382041b9 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:47.577030 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cae4e905-f681-447a-bcd7-55fb382041b9 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:47.582914 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cae4e905-f681-447a-bcd7-55fb382041b9 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:47.991142 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-cae4e905-f681-447a-bcd7-55fb382041b9 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a8d4d88cf44099aef748a804f1dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6338ad2886354139845460c4db1b6df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:32:48.008863 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cae4e905-f681-447a-bcd7-55fb382041b9 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 200 len: 1466 microversion: 2.1 time: 0.480509 Oct 12 13:32:48.012017 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 929/1884] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:32:47 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 1466 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:32:48.043130 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-733f78bd-5c68-4d33-b379-63aa28a24a9b tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9bd38ee0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:50.308602 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-733f78bd-5c68-4d33-b379-63aa28a24a9b tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "DELETE /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a" status: 204 len: 0 microversion: 2.1 time: 2.267645 Oct 12 13:32:50.308602 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 956/1885] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:32:48 2022] DELETE /compute/v2.1/images/e1f762f9-8747-41a4-858f-0197d5e7f81a => generated 0 bytes in 2269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:32:50.315401 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-abce0f7f-4d29-4ab2-ac4a-c5324f79ecd1 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '.version_select at 0x7f8a9ba13670>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:50.359410 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-abce0f7f-4d29-4ab2-ac4a-c5324f79ecd1 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] HTTP exception thrown: Image not found. Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-abce0f7f-4d29-4ab2-ac4a-c5324f79ecd1 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Request method failure captured: Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: request: DELETE /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 HTTP/1.1 Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsGss46EUkjCm8EZXRwW36t3s03IBOw3hwE4z3xyAzZWD32RP1uUfGI1S_1k0dVzn55y05YNkPXwtkKRKtetZipxTqLs8RWTeKnLruvMgjWTVJ50kdEoQdLNAQVO5ynt4DdfccRBoVrSwTxzFMiTUR0RIcfLYAVO5BPzwA3VSEC6Q-8 Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 6338ad2886354139845460c4db1b6df7 Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ImagesOneServerTestJSON-799618320 Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6338ad2886354139845460c4db1b6df7"}]}, {"type": "tempest-type-445636729", "name": "tempest-service-586230299", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6338ad2886354139845460c4db1b6df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6338ad2886354139845460c4db1b6df7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6338ad2886354139845460c4db1b6df7"}]}] Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ImagesOneServerTestJSON-799618320 Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 6338ad2886354139845460c4db1b6df7 Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-799618320 Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ImagesOneServerTestJSON-799618320-project Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: a2a8d4d88cf44099aef748a804f1dad0 Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ImagesOneServerTestJSON-799618320-project Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: exception: Image not found. Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '6f057543-6efb-45bc-a0a8-cd81a1208c72'} Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6f057543-6efb-45bc-a0a8-cd81a1208c72 to delete Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6f057543-6efb-45bc-a0a8-cd81a1208c72 could not be found. Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:32:50.362029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-abce0f7f-4d29-4ab2-ac4a-c5324f79ecd1 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Returning 404 to user: Image not found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-abce0f7f-4d29-4ab2-ac4a-c5324f79ecd1 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "DELETE /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72" status: 404 len: 62 microversion: 2.1 time: 0.052208 Oct 12 13:32:50.366163 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 930/1886] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:32:50 2022] DELETE /compute/v2.1/images/6f057543-6efb-45bc-a0a8-cd81a1208c72 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 13:32:50.374953 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6af3b012-c520-47e8-905c-508afe34e9bf tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:50.374953 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-6af3b012-c520-47e8-905c-508afe34e9bf tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:32:50.381333 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6af3b012-c520-47e8-905c-508afe34e9bf tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:50.382045 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6af3b012-c520-47e8-905c-508afe34e9bf tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:50.382690 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6af3b012-c520-47e8-905c-508afe34e9bf tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:50.383461 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6af3b012-c520-47e8-905c-508afe34e9bf tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:50.383922 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6af3b012-c520-47e8-905c-508afe34e9bf tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:50.384398 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6af3b012-c520-47e8-905c-508afe34e9bf tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:50.448494 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-6af3b012-c520-47e8-905c-508afe34e9bf tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Going to try to terminate instance {{(pid=120933) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:32:50.929377 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6af3b012-c520-47e8-905c-508afe34e9bf tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 204 len: 0 microversion: 2.1 time: 0.560575 Oct 12 13:32:50.930344 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 957/1887] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:32:50 2022] DELETE /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:32:50.953791 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7791b5c5-2708-4852-81fb-17d0dc73a8fb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:50.953791 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-7791b5c5-2708-4852-81fb-17d0dc73a8fb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:32:50.961132 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7791b5c5-2708-4852-81fb-17d0dc73a8fb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:50.961718 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7791b5c5-2708-4852-81fb-17d0dc73a8fb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:50.962226 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7791b5c5-2708-4852-81fb-17d0dc73a8fb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:50.963040 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7791b5c5-2708-4852-81fb-17d0dc73a8fb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:50.963589 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7791b5c5-2708-4852-81fb-17d0dc73a8fb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:50.964250 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7791b5c5-2708-4852-81fb-17d0dc73a8fb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:51.171057 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-7791b5c5-2708-4852-81fb-17d0dc73a8fb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a8d4d88cf44099aef748a804f1dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6338ad2886354139845460c4db1b6df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:32:51.180780 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-19a5e3a9-315f-4b68-91ea-3eaaaae239ad req-eec80a08-5e86-4a0e-abc5-a2210c21b369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17a9511-ef30-472b-928d-b0efc0e47126", "name": "network-vif-unplugged", "status": "completed", "tag": "0e474f0b-c8da-4aa8-a005-11b1cde4cedd"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:32:51.181462 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-7791b5c5-2708-4852-81fb-17d0dc73a8fb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 200 len: 1472 microversion: 2.1 time: 0.234828 Oct 12 13:32:51.182431 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 958/1888] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:32:50 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 1472 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:32:51.219831 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-19a5e3a9-315f-4b68-91ea-3eaaaae239ad req-eec80a08-5e86-4a0e-abc5-a2210c21b369 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:51.220624 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-19a5e3a9-315f-4b68-91ea-3eaaaae239ad req-eec80a08-5e86-4a0e-abc5-a2210c21b369 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:51.221415 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-19a5e3a9-315f-4b68-91ea-3eaaaae239ad req-eec80a08-5e86-4a0e-abc5-a2210c21b369 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:51.237118 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-19a5e3a9-315f-4b68-91ea-3eaaaae239ad req-eec80a08-5e86-4a0e-abc5-a2210c21b369 service nova] Creating event network-vif-unplugged:0e474f0b-c8da-4aa8-a005-11b1cde4cedd for instance a17a9511-ef30-472b-928d-b0efc0e47126 on n-h1-861076-2 Oct 12 13:32:51.243293 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-19a5e3a9-315f-4b68-91ea-3eaaaae239ad req-eec80a08-5e86-4a0e-abc5-a2210c21b369 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.616509 Oct 12 13:32:51.244529 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 931/1889] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:32:52.206657 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-96d81bb3-586d-45dd-ab00-b0e87b895c0c tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:52.208489 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-96d81bb3-586d-45dd-ab00-b0e87b895c0c tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:32:52.217846 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-96d81bb3-586d-45dd-ab00-b0e87b895c0c tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:52.219842 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-96d81bb3-586d-45dd-ab00-b0e87b895c0c tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:52.222452 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-96d81bb3-586d-45dd-ab00-b0e87b895c0c tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:52.224837 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-96d81bb3-586d-45dd-ab00-b0e87b895c0c tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:52.228449 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-96d81bb3-586d-45dd-ab00-b0e87b895c0c tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:52.233526 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-96d81bb3-586d-45dd-ab00-b0e87b895c0c tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:52.592393 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-96d81bb3-586d-45dd-ab00-b0e87b895c0c tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a8d4d88cf44099aef748a804f1dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6338ad2886354139845460c4db1b6df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:32:52.604675 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-96d81bb3-586d-45dd-ab00-b0e87b895c0c tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 200 len: 1472 microversion: 2.1 time: 0.403291 Oct 12 13:32:52.605810 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 959/1890] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:32:52 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 1472 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:53.633317 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-512d72a9-07d3-4e95-b599-cd0e9d33f726 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:53.635015 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-512d72a9-07d3-4e95-b599-cd0e9d33f726 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:32:53.649809 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-512d72a9-07d3-4e95-b599-cd0e9d33f726 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:53.650681 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-512d72a9-07d3-4e95-b599-cd0e9d33f726 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:53.651338 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-512d72a9-07d3-4e95-b599-cd0e9d33f726 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:53.652291 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-512d72a9-07d3-4e95-b599-cd0e9d33f726 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:53.653914 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-512d72a9-07d3-4e95-b599-cd0e9d33f726 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:53.654594 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-512d72a9-07d3-4e95-b599-cd0e9d33f726 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:54.213768 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-512d72a9-07d3-4e95-b599-cd0e9d33f726 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a8d4d88cf44099aef748a804f1dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6338ad2886354139845460c4db1b6df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:32:54.234385 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-512d72a9-07d3-4e95-b599-cd0e9d33f726 tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 200 len: 1472 microversion: 2.1 time: 0.603104 Oct 12 13:32:54.236020 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 932/1891] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:32:53 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 1472 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:54.924125 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-c8734430-15a8-493e-9ca6-ab2620df6042 req-1299633b-caa9-4694-8c77-4bf923b7032a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17a9511-ef30-472b-928d-b0efc0e47126", "name": "network-vif-deleted", "tag": "0e474f0b-c8da-4aa8-a005-11b1cde4cedd"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:32:54.946865 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-c8734430-15a8-493e-9ca6-ab2620df6042 req-1299633b-caa9-4694-8c77-4bf923b7032a service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:54.950886 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-c8734430-15a8-493e-9ca6-ab2620df6042 req-1299633b-caa9-4694-8c77-4bf923b7032a service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:54.951363 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-c8734430-15a8-493e-9ca6-ab2620df6042 req-1299633b-caa9-4694-8c77-4bf923b7032a service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:54.972192 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-c8734430-15a8-493e-9ca6-ab2620df6042 req-1299633b-caa9-4694-8c77-4bf923b7032a service nova] Creating event network-vif-deleted:0e474f0b-c8da-4aa8-a005-11b1cde4cedd for instance a17a9511-ef30-472b-928d-b0efc0e47126 on n-h1-861076-2 Oct 12 13:32:54.998776 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-c8734430-15a8-493e-9ca6-ab2620df6042 req-1299633b-caa9-4694-8c77-4bf923b7032a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.834554 Oct 12 13:32:54.999709 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 960/1892] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:32:55.263330 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ccb74ead-726a-4cad-a8a5-1009ad4462cb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:55.264766 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ccb74ead-726a-4cad-a8a5-1009ad4462cb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:32:55.280909 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccb74ead-726a-4cad-a8a5-1009ad4462cb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:55.281724 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccb74ead-726a-4cad-a8a5-1009ad4462cb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:55.282567 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccb74ead-726a-4cad-a8a5-1009ad4462cb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:55.285620 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccb74ead-726a-4cad-a8a5-1009ad4462cb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:55.287683 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccb74ead-726a-4cad-a8a5-1009ad4462cb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:55.288301 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccb74ead-726a-4cad-a8a5-1009ad4462cb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:55.411960 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccb74ead-726a-4cad-a8a5-1009ad4462cb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:55.416232 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccb74ead-726a-4cad-a8a5-1009ad4462cb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:55.416711 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ccb74ead-726a-4cad-a8a5-1009ad4462cb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:55.417192 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-ccb74ead-726a-4cad-a8a5-1009ad4462cb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lazy-loading 'fault' on Instance uuid a17a9511-ef30-472b-928d-b0efc0e47126 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:32:55.519975 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-ccb74ead-726a-4cad-a8a5-1009ad4462cb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a8d4d88cf44099aef748a804f1dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6338ad2886354139845460c4db1b6df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:32:55.534529 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ccb74ead-726a-4cad-a8a5-1009ad4462cb tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 200 len: 1306 microversion: 2.1 time: 0.275997 Oct 12 13:32:55.537145 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 933/1893] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:32:55 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 1306 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:32:56.566519 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-20ba7193-53b3-4f24-b772-6c337b2da19e tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:32:56.567891 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-20ba7193-53b3-4f24-b772-6c337b2da19e tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] [instance: a17a9511-ef30-472b-928d-b0efc0e47126] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:32:56.576763 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-20ba7193-53b3-4f24-b772-6c337b2da19e tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:56.577290 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-20ba7193-53b3-4f24-b772-6c337b2da19e tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:56.577728 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-20ba7193-53b3-4f24-b772-6c337b2da19e tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:56.578695 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-20ba7193-53b3-4f24-b772-6c337b2da19e tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:32:56.579362 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-20ba7193-53b3-4f24-b772-6c337b2da19e tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:32:56.579957 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-20ba7193-53b3-4f24-b772-6c337b2da19e tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:32:56.625858 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-20ba7193-53b3-4f24-b772-6c337b2da19e tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] HTTP exception thrown: Instance a17a9511-ef30-472b-928d-b0efc0e47126 could not be found. Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-20ba7193-53b3-4f24-b772-6c337b2da19e tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Request method failure captured: Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 HTTP/1.1 Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsGss46EUkjCm8EZXRwW36t3s03IBOw3hwE4z3xyAzZWD32RP1uUfGI1S_1k0dVzn55y05YNkPXwtkKRKtetZipxTqLs8RWTeKnLruvMgjWTVJ50kdEoQdLNAQVO5ynt4DdfccRBoVrSwTxzFMiTUR0RIcfLYAVO5BPzwA3VSEC6Q-8 Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 6338ad2886354139845460c4db1b6df7 Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ImagesOneServerTestJSON-799618320 Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6338ad2886354139845460c4db1b6df7"}]}, {"type": "tempest-type-445636729", "name": "tempest-service-586230299", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6338ad2886354139845460c4db1b6df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6338ad2886354139845460c4db1b6df7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6338ad2886354139845460c4db1b6df7"}]}] Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ImagesOneServerTestJSON-799618320 Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 6338ad2886354139845460c4db1b6df7 Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-799618320 Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ImagesOneServerTestJSON-799618320-project Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: a2a8d4d88cf44099aef748a804f1dad0 Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ImagesOneServerTestJSON-799618320-project Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance a17a9511-ef30-472b-928d-b0efc0e47126 could not be found. Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'a17a9511-ef30-472b-928d-b0efc0e47126'} Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a17a9511-ef30-472b-928d-b0efc0e47126 could not be found. Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a17a9511-ef30-472b-928d-b0efc0e47126 could not be found. Oct 12 13:32:56.627560 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:32:56.632148 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:32:56.632148 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:32:56.632148 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:32:56.632148 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:32:56.632148 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:32:56.632148 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:32:56.632148 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:32:56.632148 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a17a9511-ef30-472b-928d-b0efc0e47126 could not be found. Oct 12 13:32:56.632148 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:32:56.632148 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-20ba7193-53b3-4f24-b772-6c337b2da19e tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] Returning 404 to user: Instance a17a9511-ef30-472b-928d-b0efc0e47126 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:32:56.632981 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-20ba7193-53b3-4f24-b772-6c337b2da19e tempest-ImagesOneServerTestJSON-799618320 tempest-ImagesOneServerTestJSON-799618320-project] 10.222.0.52 "GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126" status: 404 len: 111 microversion: 2.1 time: 0.069464 Oct 12 13:32:56.633797 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 961/1894] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:32:56 2022] GET /compute/v2.1/servers/a17a9511-ef30-472b-928d-b0efc0e47126 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:33:05.405118 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=10 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:33:05.533854 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=22 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:33:05.610798 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fe1c43cc-a0ee-42f7-8102-62c569699176 tempest-AbsoluteLimitsTestJSON-1293080303 tempest-AbsoluteLimitsTestJSON-1293080303-project] Calling method '.version_select at 0x7f8aa3df61f0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:33:05.632016 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe1c43cc-a0ee-42f7-8102-62c569699176 tempest-AbsoluteLimitsTestJSON-1293080303 tempest-AbsoluteLimitsTestJSON-1293080303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:33:05.632486 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe1c43cc-a0ee-42f7-8102-62c569699176 tempest-AbsoluteLimitsTestJSON-1293080303 tempest-AbsoluteLimitsTestJSON-1293080303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:33:05.632956 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe1c43cc-a0ee-42f7-8102-62c569699176 tempest-AbsoluteLimitsTestJSON-1293080303 tempest-AbsoluteLimitsTestJSON-1293080303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:33:05.633653 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe1c43cc-a0ee-42f7-8102-62c569699176 tempest-AbsoluteLimitsTestJSON-1293080303 tempest-AbsoluteLimitsTestJSON-1293080303-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:33:05.640876 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe1c43cc-a0ee-42f7-8102-62c569699176 tempest-AbsoluteLimitsTestJSON-1293080303 tempest-AbsoluteLimitsTestJSON-1293080303-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:33:05.640876 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe1c43cc-a0ee-42f7-8102-62c569699176 tempest-AbsoluteLimitsTestJSON-1293080303 tempest-AbsoluteLimitsTestJSON-1293080303-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:33:05.724888 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fe1c43cc-a0ee-42f7-8102-62c569699176 tempest-AbsoluteLimitsTestJSON-1293080303 tempest-AbsoluteLimitsTestJSON-1293080303-project] 10.222.0.52 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.850573 Oct 12 13:33:05.725564 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 934/1895] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Oct 12 13:33:04 2022] GET /compute/v2.1/limits => generated 511 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:33:06.690031 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:33:06.695310 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:33:07.768134 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-990cc232-32f7-4c31-8c93-199c4d23256d tempest-ServerActionsTestJSON-2071746438 tempest-ServerActionsTestJSON-2071746438-project] Action: 'create', calling method: .version_select at 0x7f8a9b9d3ca0>, body: {"keypair": {"name": "tempest-keypair-1206950621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAO+Y+UwjvnDGHEEaBxulXb8vvr/UDZCxfnc1HRYpNsymcuye6vy0Y445ghWCV2t/9FeoaLzjcnFxVqkVcf7MYpPhcXt7hxoOVx/68FuaJF+TVoDWi/4RIWJByclZlKw+A=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:33:07.813404 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-990cc232-32f7-4c31-8c93-199c4d23256d tempest-ServerActionsTestJSON-2071746438 tempest-ServerActionsTestJSON-2071746438-project] Getting quotas for project cea8b408fef44dc8a2d030446529365a. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:33:07.830767 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-990cc232-32f7-4c31-8c93-199c4d23256d tempest-ServerActionsTestJSON-2071746438 tempest-ServerActionsTestJSON-2071746438-project] Getting quotas for user 54c90a0260894adb90a4f65c3342af45 and project cea8b408fef44dc8a2d030446529365a. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:33:07.961515 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-990cc232-32f7-4c31-8c93-199c4d23256d tempest-ServerActionsTestJSON-2071746438 tempest-ServerActionsTestJSON-2071746438-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.280794 Oct 12 13:33:07.963753 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 962/1896] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:33:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:33:13.461226 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c6f31f25-871f-4254-84e0-be04c09210d9 tempest-ServerActionsTestJSON-2071746438 tempest-ServerActionsTestJSON-2071746438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-875571327", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b7e55d7-06f7-4a50-a257-c72d3670f90b"}], "security_groups": [{"name": "tempest-securitygroup--5728832"}], "key_name": "tempest-keypair-1206950621", "user_data": "}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:33:13.685033 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-c6f31f25-871f-4254-84e0-be04c09210d9 tempest-ServerActionsTestJSON-2071746438 tempest-ServerActionsTestJSON-2071746438-project] validate_networks() for [('9b7e55d7-06f7-4a50-a257-c72d3670f90b', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-c6f31f25-871f-4254-84e0-be04c09210d9 tempest-ServerActionsTestJSON-2071746438 tempest-ServerActionsTestJSON-2071746438-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5e82e5b2-211a-43a2-af58-9361871d5cb5) Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:33:14.370359 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5e82e5b2-211a-43a2-af58-9361871d5cb5) Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-c6f31f25-871f-4254-84e0-be04c09210d9 tempest-ServerActionsTestJSON-2071746438 tempest-ServerActionsTestJSON-2071746438-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c6f31f25-871f-4254-84e0-be04c09210d9 tempest-ServerActionsTestJSON-2071746438 tempest-ServerActionsTestJSON-2071746438-project] Request method failure captured: Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 490 Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsISQs_Cei0Uxle0haDkbVdaP27-8dMKibEbviFWXsVBeYufNyqTnYeSxH48kzSkbOgAr53LOvrrSJJ7G02ovqthc-iGFfKeoAaXcAGLqUWUtv3yJNe-ABAMEEFhz-lZny6oYi4X0sOmu1wzgrWM-HRg58RSY2ah0Upudi5DNVugcdo Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: cea8b408fef44dc8a2d030446529365a Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServerActionsTestJSON-2071746438 Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cea8b408fef44dc8a2d030446529365a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cea8b408fef44dc8a2d030446529365a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cea8b408fef44dc8a2d030446529365a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cea8b408fef44dc8a2d030446529365a"}]}] Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServerActionsTestJSON-2071746438 Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: cea8b408fef44dc8a2d030446529365a Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServerActionsTestJSON-2071746438 Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServerActionsTestJSON-2071746438-project Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 54c90a0260894adb90a4f65c3342af45 Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServerActionsTestJSON-2071746438-project Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-ServerActionsTestJSON-server-875571327", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "O8^%#kuS5+73Nd0", "networks": [{"uuid": "9b7e55d7-06f7-4a50-a257-c72d3670f90b"}], "security_groups": [{"name": "tempest-securitygroup--5728832"}], "key_name": "tempest-keypair-1206950621", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:33:14.382247 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-ServerActionsTestJSON-server-875571327', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'adminPass': 'O8^%#kuS5+73Nd0', 'networks': [{'uuid': '9b7e55d7-06f7-4a50-a257-c72d3670f90b'}], 'security_groups': [{'name': 'tempest-securitygroup--5728832'}], 'key_name': 'tempest-keypair-1206950621', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:33:14.385835 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5e82e5b2-211a-43a2-af58-9361871d5cb5) Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c6f31f25-871f-4254-84e0-be04c09210d9 tempest-ServerActionsTestJSON-2071746438 tempest-ServerActionsTestJSON-2071746438-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c6f31f25-871f-4254-84e0-be04c09210d9 tempest-ServerActionsTestJSON-2071746438 tempest-ServerActionsTestJSON-2071746438-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.926579 Oct 12 13:33:14.390859 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 935/1897] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:33:13 2022] POST /compute/v2.1/servers => generated 214 bytes in 928 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:33:14.399207 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d33f96ef-34d8-4374-adb9-a2313d0bee05 tempest-ServerActionsTestJSON-2071746438 tempest-ServerActionsTestJSON-2071746438-project] Calling method '.version_select at 0x7f8aa03f31f0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:33:14.499130 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d33f96ef-34d8-4374-adb9-a2313d0bee05 tempest-ServerActionsTestJSON-2071746438 tempest-ServerActionsTestJSON-2071746438-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1206950621" status: 202 len: 0 microversion: 2.1 time: 0.113575 Oct 12 13:33:14.499736 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 963/1898] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 12 13:33:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1206950621 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:33:29.717664 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:33:29.719085 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:33:29.720935 n-d-861076-2 devstack@n-api.service[120932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 13:33:29.721259 n-d-861076-2 devstack@n-api.service[120932]: Wed Oct 12 13:33:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-groups/7fa08142-6faf-4414-b56e-e1201efbb186 (ip 10.222.0.52) !!! Oct 12 13:33:29.724048 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:33:29.727989 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=10 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:33:30.342336 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ab736482-711f-4f07-a590-8e3a9a8b7598 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] Calling method '.version_select at 0x7f8aa3df6b80>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:33:31.060515 n-d-861076-2 devstack@n-api.service[120932]: DEBUG neutronclient.v2_0.client [None req-ab736482-711f-4f07-a590-8e3a9a8b7598 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7fa08142-6faf-4414-b56e-e1201efbb186 does not exist", "detail": ""}} {{(pid=120932) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 13:33:31.060515 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.security_group_api [None req-ab736482-711f-4f07-a590-8e3a9a8b7598 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] Neutron security group 7fa08142-6faf-4414-b56e-e1201efbb186 not found {{(pid=120932) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 13:33:31.061536 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-ab736482-711f-4f07-a590-8e3a9a8b7598 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] HTTP exception thrown: Security group 7fa08142-6faf-4414-b56e-e1201efbb186 does not exist Oct 12 13:33:31.061536 n-d-861076-2 devstack@n-api.service[120932]: Neutron server returns request_ids: ['req-25fe21d5-7b6b-4d4a-8689-75ccd68804c1'] Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ab736482-711f-4f07-a590-8e3a9a8b7598 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] Request method failure captured: Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: request: DELETE /compute/v2.1/os-security-groups/7fa08142-6faf-4414-b56e-e1201efbb186 HTTP/1.1 Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsIpG5fAkQNcXy-Mbol1uPzhpYLY9BL_lfyWpmelpIkBjSeLuM9GN23AxBFD0jyLO22BAOx2UusVR47QPa6s5qml1L1yLHEfAHysj3yZpQBAhO99hB6kNd7ZT1T0TlaPa1-ELXZCCaa-6NzrgotSEiCSH076T8xe06iCpG45rax4Pfo Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 7088d35ce8fc474e8892d3d436473b2b Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1555724702 Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7088d35ce8fc474e8892d3d436473b2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7088d35ce8fc474e8892d3d436473b2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7088d35ce8fc474e8892d3d436473b2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7088d35ce8fc474e8892d3d436473b2b"}]}] Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1555724702 Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 7088d35ce8fc474e8892d3d436473b2b Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1555724702 Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-SecurityGroupsNegativeTestJSON-1555724702-project Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: f8d9a4ea7efe4636b5450049f05bffb2 Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1555724702-project Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: exception: Security group 7fa08142-6faf-4414-b56e-e1201efbb186 does not exist Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: Neutron server returns request_ids: ['req-25fe21d5-7b6b-4d4a-8689-75ccd68804c1'] Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '7fa08142-6faf-4414-b56e-e1201efbb186'} Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 13:33:31.063856 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7fa08142-6faf-4414-b56e-e1201efbb186 does not exist Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25fe21d5-7b6b-4d4a-8689-75ccd68804c1'] Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7fa08142-6faf-4414-b56e-e1201efbb186 does not exist Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25fe21d5-7b6b-4d4a-8689-75ccd68804c1'] Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7fa08142-6faf-4414-b56e-e1201efbb186 does not exist Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25fe21d5-7b6b-4d4a-8689-75ccd68804c1'] Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7fa08142-6faf-4414-b56e-e1201efbb186 does not exist Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25fe21d5-7b6b-4d4a-8689-75ccd68804c1'] Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ab736482-711f-4f07-a590-8e3a9a8b7598 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] Returning 404 to user: Security group 7fa08142-6faf-4414-b56e-e1201efbb186 does not exist Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: Neutron server returns request_ids: ['req-25fe21d5-7b6b-4d4a-8689-75ccd68804c1'] {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ab736482-711f-4f07-a590-8e3a9a8b7598 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/7fa08142-6faf-4414-b56e-e1201efbb186" status: 404 len: 194 microversion: 2.1 time: 1.355600 Oct 12 13:33:31.078243 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 936/1899] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:33:29 2022] DELETE /compute/v2.1/os-security-groups/7fa08142-6faf-4414-b56e-e1201efbb186 => generated 194 bytes in 1357 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:33:31.085661 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-33c0cffd-84dd-4d0d-a089-b7cc5e7af264 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004011 Oct 12 13:33:31.085661 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 964/1900] 10.222.0.52 () {58 vars in 1164 bytes} [Wed Oct 12 13:33:31 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 12 13:33:31.087702 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6aff41a0-f777-4886-9864-b2b70a8f1709 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] Calling method '.version_select at 0x7f8aa3e3b430>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:33:31.690002 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6aff41a0-f777-4886-9864-b2b70a8f1709 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.607863 Oct 12 13:33:31.690822 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 937/1901] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 12 13:33:31 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:33:31.701542 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:33:31.703250 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:33:31.709049 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9fc0ed37-2a00-4ec1-97ed-21ba0009ad5e tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] Calling method '.version_select at 0x7f8a9ba07160>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:33:32.070492 n-d-861076-2 devstack@n-api.service[120933]: DEBUG neutronclient.v2_0.client [None req-9fc0ed37-2a00-4ec1-97ed-21ba0009ad5e tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120933) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 13:33:32.073393 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-9fc0ed37-2a00-4ec1-97ed-21ba0009ad5e tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 12 13:33:32.073393 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-91144e24-c7ef-4af8-8a93-f20fa655592b'] Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9fc0ed37-2a00-4ec1-97ed-21ba0009ad5e tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] Request method failure captured: Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: request: DELETE /compute/v2.1/os-security-groups/a1aa8739-c396-4254-9479-066a98dacb33 HTTP/1.1 Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsIpG5fAkQNcXy-Mbol1uPzhpYLY9BL_lfyWpmelpIkBjSeLuM9GN23AxBFD0jyLO22BAOx2UusVR47QPa6s5qml1L1yLHEfAHysj3yZpQBAhO99hB6kNd7ZT1T0TlaPa1-ELXZCCaa-6NzrgotSEiCSH076T8xe06iCpG45rax4Pfo Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 7088d35ce8fc474e8892d3d436473b2b Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1555724702 Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7088d35ce8fc474e8892d3d436473b2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7088d35ce8fc474e8892d3d436473b2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7088d35ce8fc474e8892d3d436473b2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7088d35ce8fc474e8892d3d436473b2b"}]}] Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1555724702 Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 7088d35ce8fc474e8892d3d436473b2b Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1555724702 Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-SecurityGroupsNegativeTestJSON-1555724702-project Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: f8d9a4ea7efe4636b5450049f05bffb2 Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1555724702-project Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: exception: Insufficient rights for removing default security group. Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-91144e24-c7ef-4af8-8a93-f20fa655592b'] Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'a1aa8739-c396-4254-9479-066a98dacb33'} Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 13:33:32.077595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91144e24-c7ef-4af8-8a93-f20fa655592b'] Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91144e24-c7ef-4af8-8a93-f20fa655592b'] Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91144e24-c7ef-4af8-8a93-f20fa655592b'] Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91144e24-c7ef-4af8-8a93-f20fa655592b'] Oct 12 13:33:32.081592 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:33:32.100218 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9fc0ed37-2a00-4ec1-97ed-21ba0009ad5e tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 12 13:33:32.100218 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-91144e24-c7ef-4af8-8a93-f20fa655592b'] {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:33:32.103966 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9fc0ed37-2a00-4ec1-97ed-21ba0009ad5e tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/a1aa8739-c396-4254-9479-066a98dacb33" status: 400 len: 182 microversion: 2.1 time: 0.402215 Oct 12 13:33:32.106843 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 965/1902] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:33:31 2022] DELETE /compute/v2.1/os-security-groups/a1aa8739-c396-4254-9479-066a98dacb33 => generated 182 bytes in 406 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 13:33:32.123452 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cc759c25-5032-4d92-b243-3d26e642d3b0 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] Calling method '.version_select at 0x7f8a9b3cb310>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:33:32.163551 n-d-861076-2 devstack@n-api.service[120932]: DEBUG neutronclient.v2_0.client [None req-cc759c25-5032-4d92-b243-3d26e642d3b0 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8ad3f243-3450-4622-9553-712a4a2fcdb1 does not exist", "detail": ""}} {{(pid=120932) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 13:33:32.165573 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.security_group_api [None req-cc759c25-5032-4d92-b243-3d26e642d3b0 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] Neutron security group 8ad3f243-3450-4622-9553-712a4a2fcdb1 not found {{(pid=120932) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 13:33:32.166803 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-cc759c25-5032-4d92-b243-3d26e642d3b0 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] HTTP exception thrown: Security group 8ad3f243-3450-4622-9553-712a4a2fcdb1 does not exist Oct 12 13:33:32.166803 n-d-861076-2 devstack@n-api.service[120932]: Neutron server returns request_ids: ['req-7448e028-0ef7-41c9-b376-42fb0e1a38a1'] Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cc759c25-5032-4d92-b243-3d26e642d3b0 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] Request method failure captured: Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/os-security-groups/8ad3f243-3450-4622-9553-712a4a2fcdb1 HTTP/1.1 Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsIpG5fAkQNcXy-Mbol1uPzhpYLY9BL_lfyWpmelpIkBjSeLuM9GN23AxBFD0jyLO22BAOx2UusVR47QPa6s5qml1L1yLHEfAHysj3yZpQBAhO99hB6kNd7ZT1T0TlaPa1-ELXZCCaa-6NzrgotSEiCSH076T8xe06iCpG45rax4Pfo Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 7088d35ce8fc474e8892d3d436473b2b Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1555724702 Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7088d35ce8fc474e8892d3d436473b2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7088d35ce8fc474e8892d3d436473b2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7088d35ce8fc474e8892d3d436473b2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7088d35ce8fc474e8892d3d436473b2b"}]}] Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1555724702 Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 7088d35ce8fc474e8892d3d436473b2b Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1555724702 Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-SecurityGroupsNegativeTestJSON-1555724702-project Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: f8d9a4ea7efe4636b5450049f05bffb2 Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1555724702-project Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: exception: Security group 8ad3f243-3450-4622-9553-712a4a2fcdb1 does not exist Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: Neutron server returns request_ids: ['req-7448e028-0ef7-41c9-b376-42fb0e1a38a1'] Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '8ad3f243-3450-4622-9553-712a4a2fcdb1'} Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 13:33:32.169512 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8ad3f243-3450-4622-9553-712a4a2fcdb1 does not exist Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7448e028-0ef7-41c9-b376-42fb0e1a38a1'] Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8ad3f243-3450-4622-9553-712a4a2fcdb1 does not exist Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7448e028-0ef7-41c9-b376-42fb0e1a38a1'] Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8ad3f243-3450-4622-9553-712a4a2fcdb1 does not exist Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7448e028-0ef7-41c9-b376-42fb0e1a38a1'] Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8ad3f243-3450-4622-9553-712a4a2fcdb1 does not exist Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7448e028-0ef7-41c9-b376-42fb0e1a38a1'] Oct 12 13:33:32.173426 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:32.179011 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cc759c25-5032-4d92-b243-3d26e642d3b0 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] Returning 404 to user: Security group 8ad3f243-3450-4622-9553-712a4a2fcdb1 does not exist Oct 12 13:33:32.179011 n-d-861076-2 devstack@n-api.service[120932]: Neutron server returns request_ids: ['req-7448e028-0ef7-41c9-b376-42fb0e1a38a1'] {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:33:32.180217 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cc759c25-5032-4d92-b243-3d26e642d3b0 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/8ad3f243-3450-4622-9553-712a4a2fcdb1" status: 404 len: 194 microversion: 2.1 time: 0.066446 Oct 12 13:33:32.181475 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 938/1903] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 12 13:33:32 2022] GET /compute/v2.1/os-security-groups/8ad3f243-3450-4622-9553-712a4a2fcdb1 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:33:32.194312 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3a78a10d-39a1-4229-bcff-71520eca3440 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] Action: 'update', calling method: .version_select at 0x7f8a9ba07790>, body: {"security_group": {"name": "tempest-sg-224488539", "description": "tempest-description-246998426"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:33:32.230100 n-d-861076-2 devstack@n-api.service[120933]: DEBUG neutronclient.v2_0.client [None req-3a78a10d-39a1-4229-bcff-71520eca3440 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8973bb90-f9a1-4085-8e92-291e95e4d89b does not exist", "detail": ""}} {{(pid=120933) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 13:33:32.230100 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.security_group_api [None req-3a78a10d-39a1-4229-bcff-71520eca3440 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] Neutron security group 8973bb90-f9a1-4085-8e92-291e95e4d89b not found {{(pid=120933) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 13:33:32.231121 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-3a78a10d-39a1-4229-bcff-71520eca3440 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] HTTP exception thrown: Security group 8973bb90-f9a1-4085-8e92-291e95e4d89b does not exist Oct 12 13:33:32.231121 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-fa5d495e-ad30-4412-b17d-393fdc47057f'] Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3a78a10d-39a1-4229-bcff-71520eca3440 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] Request method failure captured: Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: request: PUT /compute/v2.1/os-security-groups/8973bb90-f9a1-4085-8e92-291e95e4d89b HTTP/1.1 Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 100 Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsIpG5fAkQNcXy-Mbol1uPzhpYLY9BL_lfyWpmelpIkBjSeLuM9GN23AxBFD0jyLO22BAOx2UusVR47QPa6s5qml1L1yLHEfAHysj3yZpQBAhO99hB6kNd7ZT1T0TlaPa1-ELXZCCaa-6NzrgotSEiCSH076T8xe06iCpG45rax4Pfo Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 7088d35ce8fc474e8892d3d436473b2b Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1555724702 Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7088d35ce8fc474e8892d3d436473b2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7088d35ce8fc474e8892d3d436473b2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7088d35ce8fc474e8892d3d436473b2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7088d35ce8fc474e8892d3d436473b2b"}]}] Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1555724702 Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 7088d35ce8fc474e8892d3d436473b2b Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1555724702 Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-SecurityGroupsNegativeTestJSON-1555724702-project Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: f8d9a4ea7efe4636b5450049f05bffb2 Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1555724702-project Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: {"security_group": {"name": "tempest-sg-224488539", "description": "tempest-description-246998426"}} Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: exception: Security group 8973bb90-f9a1-4085-8e92-291e95e4d89b does not exist Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-fa5d495e-ad30-4412-b17d-393fdc47057f'] Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '8973bb90-f9a1-4085-8e92-291e95e4d89b', 'body': {'security_group': {'name': 'tempest-sg-224488539', 'description': 'tempest-description-246998426'}}} Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 13:33:32.233410 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8973bb90-f9a1-4085-8e92-291e95e4d89b does not exist Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa5d495e-ad30-4412-b17d-393fdc47057f'] Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8973bb90-f9a1-4085-8e92-291e95e4d89b does not exist Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa5d495e-ad30-4412-b17d-393fdc47057f'] Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8973bb90-f9a1-4085-8e92-291e95e4d89b does not exist Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa5d495e-ad30-4412-b17d-393fdc47057f'] Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8973bb90-f9a1-4085-8e92-291e95e4d89b does not exist Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa5d495e-ad30-4412-b17d-393fdc47057f'] Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3a78a10d-39a1-4229-bcff-71520eca3440 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] Returning 404 to user: Security group 8973bb90-f9a1-4085-8e92-291e95e4d89b does not exist Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: Neutron server returns request_ids: ['req-fa5d495e-ad30-4412-b17d-393fdc47057f'] {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3a78a10d-39a1-4229-bcff-71520eca3440 tempest-SecurityGroupsNegativeTestJSON-1555724702 tempest-SecurityGroupsNegativeTestJSON-1555724702-project] 10.222.0.52 "PUT /compute/v2.1/os-security-groups/8973bb90-f9a1-4085-8e92-291e95e4d89b" status: 404 len: 194 microversion: 2.1 time: 0.048281 Oct 12 13:33:32.238221 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 966/1904] 10.222.0.52 () {60 vars in 1290 bytes} [Wed Oct 12 13:33:32 2022] PUT /compute/v2.1/os-security-groups/8973bb90-f9a1-4085-8e92-291e95e4d89b => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 13:33:49.354465 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-938f3776-f458-42da-a040-9175e1f47760 tempest-ServerRescueNegativeTestJSON-1184591783 tempest-ServerRescueNegativeTestJSON-1184591783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1258717710", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:33:49.454115 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-938f3776-f458-42da-a040-9175e1f47760 tempest-ServerRescueNegativeTestJSON-1184591783 tempest-ServerRescueNegativeTestJSON-1184591783-project] validate_networks() for [('d651af4c-2667-49ae-a621-6404c76a00fe', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-938f3776-f458-42da-a040-9175e1f47760 tempest-ServerRescueNegativeTestJSON-1184591783 tempest-ServerRescueNegativeTestJSON-1184591783-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cba9954e-549b-4854-9713-defa10b17ca7) Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:33:50.225744 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cba9954e-549b-4854-9713-defa10b17ca7) Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-938f3776-f458-42da-a040-9175e1f47760 tempest-ServerRescueNegativeTestJSON-1184591783 tempest-ServerRescueNegativeTestJSON-1184591783-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-938f3776-f458-42da-a040-9175e1f47760 tempest-ServerRescueNegativeTestJSON-1184591783 tempest-ServerRescueNegativeTestJSON-1184591783-project] Request method failure captured: Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 246 Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsI8W8W2fl14kgMHNQOw8_SxrX9W5b0C541XC-3150gipDAsnXmsSvr3JiN1ew0JMjuomWyV90y1V3cPnhRnhuYkTFTqSV-ZzBEIVFeaYld_P11fBRgI37nWA6ArrehPKKkS_Y0aoZEAMxRqmGbYL1NqdEtX_4X3zP-7KScwxh1_lDY Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 3b6c16c5457b472488430a6beb358a93 Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1184591783 Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3b6c16c5457b472488430a6beb358a93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3b6c16c5457b472488430a6beb358a93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b6c16c5457b472488430a6beb358a93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b6c16c5457b472488430a6beb358a93"}]}] Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1184591783 Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 3b6c16c5457b472488430a6beb358a93 Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1184591783 Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServerRescueNegativeTestJSON-1184591783-project Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 4276c33292074a6a89615855daa4f6d2 Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1184591783-project Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1258717710", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "H1*Oou&TkBkmPUw", "networks": [{"uuid": "d651af4c-2667-49ae-a621-6404c76a00fe"}]}} Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:33:50.231106 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-ServerRescueNegativeTestJSON-server-1258717710', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'adminPass': 'H1*Oou&TkBkmPUw', 'networks': [{'uuid': 'd651af4c-2667-49ae-a621-6404c76a00fe'}]}}} Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:33:50.238433 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cba9954e-549b-4854-9713-defa10b17ca7) Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-938f3776-f458-42da-a040-9175e1f47760 tempest-ServerRescueNegativeTestJSON-1184591783 tempest-ServerRescueNegativeTestJSON-1184591783-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-938f3776-f458-42da-a040-9175e1f47760 tempest-ServerRescueNegativeTestJSON-1184591783 tempest-ServerRescueNegativeTestJSON-1184591783-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.494705 Oct 12 13:33:50.253863 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 939/1905] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:33:48 2022] POST /compute/v2.1/servers => generated 214 bytes in 1496 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:33:59.332176 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-7b645c30-ff69-4197-8ce2-9a839a474512 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1478695200 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1478695200-project-admin] Calling method '.version_select at 0x7f8a9b9d3ee0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:33:59.334285 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7b645c30-ff69-4197-8ce2-9a839a474512 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1478695200 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1478695200-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:33:59.334776 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7b645c30-ff69-4197-8ce2-9a839a474512 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1478695200 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1478695200-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:33:59.335388 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7b645c30-ff69-4197-8ce2-9a839a474512 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1478695200 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1478695200-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:33:59.378351 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7b645c30-ff69-4197-8ce2-9a839a474512 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1478695200 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1478695200-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:33:59.379053 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7b645c30-ff69-4197-8ce2-9a839a474512 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1478695200 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1478695200-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:33:59.381634 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7b645c30-ff69-4197-8ce2-9a839a474512 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1478695200 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1478695200-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:33:59.401069 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7b645c30-ff69-4197-8ce2-9a839a474512 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1478695200 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1478695200-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:33:59.401566 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7b645c30-ff69-4197-8ce2-9a839a474512 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1478695200 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1478695200-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:33:59.406557 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-7b645c30-ff69-4197-8ce2-9a839a474512 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1478695200 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1478695200-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:33:59.420578 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-7b645c30-ff69-4197-8ce2-9a839a474512 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1478695200 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1478695200-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.403906 Oct 12 13:33:59.428638 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 967/1906] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:33:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:34:07.139716 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:34:07.315906 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3a683ea1-8f5a-4e87-9fc5-3f94dd0d957d tempest-TaggedBootDevicesTest-888637580 tempest-TaggedBootDevicesTest-888637580-project] Action: 'create', calling method: .version_select at 0x7f8a9ba07790>, body: {"keypair": {"name": "tempest-keypair-615051422", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKX6/uHiLhtOYaV81g+NSsQQg7/KY6znlMs8j2p6Q3n/m1KyhNPdMthZ4bxC68Xb3bG8MjZiC350AwvuISquEM32uEokuKzxj6mJYdKrkV/hKdPUGBOqwGSFct6KMtjq2w=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:34:07.343113 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-3a683ea1-8f5a-4e87-9fc5-3f94dd0d957d tempest-TaggedBootDevicesTest-888637580 tempest-TaggedBootDevicesTest-888637580-project] Getting quotas for project ac649e50c1a640ee9562a48818ab616e. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:34:07.349720 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-3a683ea1-8f5a-4e87-9fc5-3f94dd0d957d tempest-TaggedBootDevicesTest-888637580 tempest-TaggedBootDevicesTest-888637580-project] Getting quotas for user 250980abb5ad448dbe92127bee7f679e and project ac649e50c1a640ee9562a48818ab616e. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:34:07.371394 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a55fc310-d812-4e13-b000-d0325233ca1f tempest-InstanceActionsNegativeTestJSON-347028748 tempest-InstanceActionsNegativeTestJSON-347028748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-250316778", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "2f9270e1-97b7-4fd3-bf89-a2a7c017acbc"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:34:07.478864 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-a55fc310-d812-4e13-b000-d0325233ca1f tempest-InstanceActionsNegativeTestJSON-347028748 tempest-InstanceActionsNegativeTestJSON-347028748-project] validate_networks() for [('2f9270e1-97b7-4fd3-bf89-a2a7c017acbc', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:34:07.485147 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3a683ea1-8f5a-4e87-9fc5-3f94dd0d957d tempest-TaggedBootDevicesTest-888637580 tempest-TaggedBootDevicesTest-888637580-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.173849 Oct 12 13:34:07.486558 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 968/1907] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Oct 12 13:34:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 176 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-a55fc310-d812-4e13-b000-d0325233ca1f tempest-InstanceActionsNegativeTestJSON-347028748 tempest-InstanceActionsNegativeTestJSON-347028748-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fed780a6-2b64-44bf-a49d-7522a70725d2) Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:34:08.048106 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fed780a6-2b64-44bf-a49d-7522a70725d2) Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-a55fc310-d812-4e13-b000-d0325233ca1f tempest-InstanceActionsNegativeTestJSON-347028748 tempest-InstanceActionsNegativeTestJSON-347028748-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a55fc310-d812-4e13-b000-d0325233ca1f tempest-InstanceActionsNegativeTestJSON-347028748 tempest-InstanceActionsNegativeTestJSON-347028748-project] Request method failure captured: Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 216 Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsJOXeNIAflSR0s1Z1gzLU0Abh8Y8aF0cUTixTFMV5cBERyhXABH0mwyvoRa4_3QSivAWsI2IGTVBqN7or62CsP2K_GuYsySE4bvpYtviWLFZgDT_tIo78RZZtmNnm9ojVo59zZ9QJ8opq0aPS6gs0KcKrdmAy3qXF_TJLdpu5a4PdU Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: a8241318ba6a455b9380ab4e998bada7 Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-347028748 Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a8241318ba6a455b9380ab4e998bada7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a8241318ba6a455b9380ab4e998bada7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a8241318ba6a455b9380ab4e998bada7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a8241318ba6a455b9380ab4e998bada7"}]}] Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-347028748 Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: a8241318ba6a455b9380ab4e998bada7 Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-347028748 Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-InstanceActionsNegativeTestJSON-347028748-project Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 23fb7037e6354985946137eb1eb5ea59 Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-347028748-project Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-250316778", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "2f9270e1-97b7-4fd3-bf89-a2a7c017acbc"}]}} Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:34:08.051905 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-InstanceActionsNegativeTestJSON-server-250316778', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '2f9270e1-97b7-4fd3-bf89-a2a7c017acbc'}]}}} Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:34:08.056142 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fed780a6-2b64-44bf-a49d-7522a70725d2) Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a55fc310-d812-4e13-b000-d0325233ca1f tempest-InstanceActionsNegativeTestJSON-347028748 tempest-InstanceActionsNegativeTestJSON-347028748-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a55fc310-d812-4e13-b000-d0325233ca1f tempest-InstanceActionsNegativeTestJSON-347028748 tempest-InstanceActionsNegativeTestJSON-347028748-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.914178 Oct 12 13:34:08.067748 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 940/1908] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:34:07 2022] POST /compute/v2.1/servers => generated 214 bytes in 924 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:34:09.701381 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=6 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:34:10.511493 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-202405b7-695c-48f7-9afa-50bb9aa1ddb8 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Action: 'create', calling method: .version_select at 0x7f8a9b9d3310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-211006809"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:34:11.523989 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-202405b7-695c-48f7-9afa-50bb9aa1ddb8 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.823260 Oct 12 13:34:11.526502 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 969/1909] 10.222.0.52 () {60 vars in 1155 bytes} [Wed Oct 12 13:34:09 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1826 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 12 13:34:11.542663 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-62fb561c-f590-4bd3-82ec-c5ff86f2c4a0 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Calling method '.version_select at 0x7f8a9b3cbaf0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:11.688676 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-62fb561c-f590-4bd3-82ec-c5ff86f2c4a0 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/0ee72e47-b402-47fa-a0b0-7a16fe7e427e" status: 200 len: 344 microversion: 2.1 time: 0.152686 Oct 12 13:34:11.689324 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 941/1910] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:34:11 2022] GET /compute/v2.1/os-volumes/0ee72e47-b402-47fa-a0b0-7a16fe7e427e => generated 344 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:34:12.706107 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6e98c56d-809f-4d87-9986-defeeeffc4ab tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Calling method '.version_select at 0x7f8a9b9398b0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:12.794422 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6e98c56d-809f-4d87-9986-defeeeffc4ab tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/0ee72e47-b402-47fa-a0b0-7a16fe7e427e" status: 200 len: 344 microversion: 2.1 time: 0.094085 Oct 12 13:34:12.801341 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 970/1911] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:34:12 2022] GET /compute/v2.1/os-volumes/0ee72e47-b402-47fa-a0b0-7a16fe7e427e => generated 344 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:34:13.809825 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f9b8d2c9-74ba-433e-aa70-c36bd1ec6d66 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Calling method '.version_select at 0x7f8aa3df6700>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:13.890915 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f9b8d2c9-74ba-433e-aa70-c36bd1ec6d66 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/0ee72e47-b402-47fa-a0b0-7a16fe7e427e" status: 200 len: 345 microversion: 2.1 time: 0.085704 Oct 12 13:34:13.892105 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 942/1912] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:34:13 2022] GET /compute/v2.1/os-volumes/0ee72e47-b402-47fa-a0b0-7a16fe7e427e => generated 345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:34:13.906862 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c069e1d8-b63c-45f9-8dbb-cae9469a8fa1 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Action: 'create', calling method: .version_select at 0x7f8a9b9395e0>, body: {"snapshot": {"volume_id": "0ee72e47-b402-47fa-a0b0-7a16fe7e427e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1855030767"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:34:14.671112 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c069e1d8-b63c-45f9-8dbb-cae9469a8fa1 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.769221 Oct 12 13:34:14.672180 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 971/1913] 10.222.0.52 () {60 vars in 1162 bytes} [Wed Oct 12 13:34:13 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:34:14.684016 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-45c4f4a3-8783-4f27-827f-e7258b766a37 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Calling method '.version_select at 0x7f8aa3e074c0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:14.757566 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-45c4f4a3-8783-4f27-827f-e7258b766a37 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/38bdd25f-d395-4540-8f4b-68855a458c92" status: 200 len: 287 microversion: 2.1 time: 0.076980 Oct 12 13:34:14.758205 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 943/1914] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 12 13:34:14 2022] GET /compute/v2.1/os-snapshots/38bdd25f-d395-4540-8f4b-68855a458c92 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:34:14.780498 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5d399f26-e5cb-4b2c-b969-d34190a0b7ff tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Calling method '.version_select at 0x7f8a9bfe3af0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:14.836732 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5d399f26-e5cb-4b2c-b969-d34190a0b7ff tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.069297 Oct 12 13:34:14.837149 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 972/1915] 10.222.0.52 () {58 vars in 1140 bytes} [Wed Oct 12 13:34:14 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:34:14.850555 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-52dbf33d-19e2-4a98-b100-98d6067832df tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Calling method '.version_select at 0x7f8a9bdb10d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:14.885518 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-52dbf33d-19e2-4a98-b100-98d6067832df tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/38bdd25f-d395-4540-8f4b-68855a458c92" status: 200 len: 287 microversion: 2.1 time: 0.040746 Oct 12 13:34:14.886271 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 944/1916] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 12 13:34:14 2022] GET /compute/v2.1/os-snapshots/38bdd25f-d395-4540-8f4b-68855a458c92 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:34:15.143887 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1842a21f-1e8e-4198-baae-a8fb54c27690 tempest-TaggedBootDevicesTest-888637580 tempest-TaggedBootDevicesTest-888637580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1227764021", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9bbbb141-c651-420f-8ff4-3484734b2e3b"}, {"port": "6c1cd5e4-714c-419a-9c8e-1ed2af5e3fd3", "tag": "port-1"}, {"port": "f7385583-e515-418e-9141-044df785c1e4", "tag": "port-2"}, {"uuid": "867068c2-2cbc-43ed-8aab-5387f0071de6", "tag": "net-1"}, {"uuid": "867068c2-2cbc-43ed-8aab-5387f0071de6"}, {"uuid": "70319778-dea1-4833-8547-b0dd027157ad", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "70319778-dea1-4833-8547-b0dd027157ad", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "a0b5d3b3-cd96-4f73-b79a-3aafd05ccd9a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "2c1f0f90-ece8-47f4-a735-252f48f5bda1", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "b5380527-5fa0-4b37-91af-0024643608e3", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1661457363"}], "key_name": "tempest-keypair-615051422", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:34:15.349312 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-1842a21f-1e8e-4198-baae-a8fb54c27690 tempest-TaggedBootDevicesTest-888637580 tempest-TaggedBootDevicesTest-888637580-project] validate_networks() for [('9bbbb141-c651-420f-8ff4-3484734b2e3b', None, None, None, None, None), (None, None, '6c1cd5e4-714c-419a-9c8e-1ed2af5e3fd3', None, None, None), (None, None, 'f7385583-e515-418e-9141-044df785c1e4', None, None, None), ('867068c2-2cbc-43ed-8aab-5387f0071de6', None, None, None, None, None), ('867068c2-2cbc-43ed-8aab-5387f0071de6', None, None, None, None, None), ('70319778-dea1-4833-8547-b0dd027157ad', '10.2.2.100', None, None, None, None), ('70319778-dea1-4833-8547-b0dd027157ad', '10.2.2.200', None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:34:15.904630 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fbc8acf8-7bea-4879-a02f-4997de9da6b3 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Calling method '.version_select at 0x7f8aa3df6d30>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:15.974493 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fbc8acf8-7bea-4879-a02f-4997de9da6b3 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/38bdd25f-d395-4540-8f4b-68855a458c92" status: 200 len: 287 microversion: 2.1 time: 0.078975 Oct 12 13:34:15.976148 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 945/1917] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 12 13:34:15 2022] GET /compute/v2.1/os-snapshots/38bdd25f-d395-4540-8f4b-68855a458c92 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-1842a21f-1e8e-4198-baae-a8fb54c27690 tempest-TaggedBootDevicesTest-888637580 tempest-TaggedBootDevicesTest-888637580-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d329dd59-f943-4e13-9903-1b77a29cf702) Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:34:16.098343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:34:16.104847 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:34:16.104847 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:34:16.104847 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:34:16.104847 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:34:16.104847 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:34:16.104847 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:34:16.104847 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:34:16.104847 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:34:16.104847 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:34:16.104847 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:34:16.104847 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:34:16.104847 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:34:16.104847 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:34:16.104847 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:34:16.104847 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d329dd59-f943-4e13-9903-1b77a29cf702) Oct 12 13:34:16.104847 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:16.104847 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-1842a21f-1e8e-4198-baae-a8fb54c27690 tempest-TaggedBootDevicesTest-888637580 tempest-TaggedBootDevicesTest-888637580-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:34:16.104847 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1842a21f-1e8e-4198-baae-a8fb54c27690 tempest-TaggedBootDevicesTest-888637580 tempest-TaggedBootDevicesTest-888637580-project] Request method failure captured: Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 1344 Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsH9suJjGunBr-1QVjUZuZdcZzuUUpXePoStaU-9SpQAT7JTR5ykp4A9IAmuCGOhUhcCuFZgzwrzZJ7JMm-Aq6_SeAr0XUpxZkTS6rBykwrlB3ec7vkqh2spPfha677a3GK6YWYRRFgvYpoevIGKJP_KKAqdkBi0UFb_CBX8HeKP4b4 Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: X-Openstack-Nova-Api-Version: 2.32 Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: ac649e50c1a640ee9562a48818ab616e Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-TaggedBootDevicesTest-888637580 Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ac649e50c1a640ee9562a48818ab616e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ac649e50c1a640ee9562a48818ab616e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ac649e50c1a640ee9562a48818ab616e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ac649e50c1a640ee9562a48818ab616e"}]}] Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-TaggedBootDevicesTest-888637580 Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: ac649e50c1a640ee9562a48818ab616e Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-TaggedBootDevicesTest-888637580 Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-TaggedBootDevicesTest-888637580-project Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 250980abb5ad448dbe92127bee7f679e Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-TaggedBootDevicesTest-888637580-project Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-device-tagging-server-1227764021", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9bbbb141-c651-420f-8ff4-3484734b2e3b"}, {"port": "6c1cd5e4-714c-419a-9c8e-1ed2af5e3fd3", "tag": "port-1"}, {"port": "f7385583-e515-418e-9141-044df785c1e4", "tag": "port-2"}, {"uuid": "867068c2-2cbc-43ed-8aab-5387f0071de6", "tag": "net-1"}, {"uuid": "867068c2-2cbc-43ed-8aab-5387f0071de6"}, {"uuid": "70319778-dea1-4833-8547-b0dd027157ad", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "70319778-dea1-4833-8547-b0dd027157ad", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "a0b5d3b3-cd96-4f73-b79a-3aafd05ccd9a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "2c1f0f90-ece8-47f4-a735-252f48f5bda1", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "b5380527-5fa0-4b37-91af-0024643608e3", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1661457363"}], "key_name": "tempest-keypair-615051422", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-device-tagging-server-1227764021', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'config_drive': True, 'networks': [{'uuid': '9bbbb141-c651-420f-8ff4-3484734b2e3b'}, {'port': '6c1cd5e4-714c-419a-9c8e-1ed2af5e3fd3', 'tag': 'port-1'}, {'port': 'f7385583-e515-418e-9141-044df785c1e4', 'tag': 'port-2'}, {'uuid': '867068c2-2cbc-43ed-8aab-5387f0071de6', 'tag': 'net-1'}, {'uuid': '867068c2-2cbc-43ed-8aab-5387f0071de6'}, {'uuid': '70319778-dea1-4833-8547-b0dd027157ad', 'fixed_ip': '10.2.2.100', 'tag': 'net-2-100'}, {'uuid': '70319778-dea1-4833-8547-b0dd027157ad', 'fixed_ip': '10.2.2.200', 'tag': 'net-2-200'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'tag': 'boot', 'volume_id': 'a0b5d3b3-cd96-4f73-b79a-3aafd05ccd9a', 'delete_on_termination': False}, {'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 1, 'tag': 'other', 'volume_id': '2c1f0f90-ece8-47f4-a735-252f48f5bda1', 'delete_on_termination': False}, {'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 2, 'volume_id': 'b5380527-5fa0-4b37-91af-0024643608e3', 'delete_on_termination': False}], 'security_groups': [{'name': 'tempest-securitygroup--1661457363'}], 'key_name': 'tempest-keypair-615051422', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:34:16.111244 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:34:16.114594 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d329dd59-f943-4e13-9903-1b77a29cf702) Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:16.120409 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:16.127613 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1842a21f-1e8e-4198-baae-a8fb54c27690 tempest-TaggedBootDevicesTest-888637580 tempest-TaggedBootDevicesTest-888637580-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:34:16.127613 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:34:16.127613 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1842a21f-1e8e-4198-baae-a8fb54c27690 tempest-TaggedBootDevicesTest-888637580 tempest-TaggedBootDevicesTest-888637580-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.32 time: 0.988645 Oct 12 13:34:16.135590 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 973/1918] 10.222.0.52 () {62 vars in 1189 bytes} [Wed Oct 12 13:34:15 2022] POST /compute/v2.1/servers => generated 214 bytes in 998 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Oct 12 13:34:16.139180 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bf3617d3-f4d9-441d-b744-1ee4401a240e tempest-TaggedBootDevicesTest-888637580 tempest-TaggedBootDevicesTest-888637580-project] Calling method '.version_select at 0x7f8a9bd59430>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:16.239052 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bf3617d3-f4d9-441d-b744-1ee4401a240e tempest-TaggedBootDevicesTest-888637580 tempest-TaggedBootDevicesTest-888637580-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-615051422" status: 204 len: 0 microversion: 2.32 time: 0.105641 Oct 12 13:34:16.240360 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 946/1919] 10.222.0.52 () {60 vars in 1259 bytes} [Wed Oct 12 13:34:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-615051422 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 12 13:34:17.001676 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0e343ec5-1cfc-49f0-928c-34e87a84224d tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Calling method '.version_select at 0x7f8a9b9fd820>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:17.107237 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0e343ec5-1cfc-49f0-928c-34e87a84224d tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/38bdd25f-d395-4540-8f4b-68855a458c92" status: 200 len: 287 microversion: 2.1 time: 0.122049 Oct 12 13:34:17.110420 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 974/1920] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 12 13:34:16 2022] GET /compute/v2.1/os-snapshots/38bdd25f-d395-4540-8f4b-68855a458c92 => generated 287 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:34:18.124311 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3b5fdfca-5d87-4ccf-846a-533836f752f1 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Calling method '.version_select at 0x7f8a9b5f5820>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:18.197348 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3b5fdfca-5d87-4ccf-846a-533836f752f1 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/38bdd25f-d395-4540-8f4b-68855a458c92" status: 200 len: 288 microversion: 2.1 time: 0.077161 Oct 12 13:34:18.198491 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 947/1921] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 12 13:34:18 2022] GET /compute/v2.1/os-snapshots/38bdd25f-d395-4540-8f4b-68855a458c92 => generated 288 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:34:18.212134 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-eb16b216-977d-4bf8-94d1-38a387242533 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Calling method '.version_select at 0x7f8a9ba07b80>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:18.244779 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:34:18.401101 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-eb16b216-977d-4bf8-94d1-38a387242533 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/38bdd25f-d395-4540-8f4b-68855a458c92" status: 202 len: 0 microversion: 2.1 time: 0.193003 Oct 12 13:34:18.401959 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 975/1922] 10.222.0.52 () {58 vars in 1254 bytes} [Wed Oct 12 13:34:18 2022] DELETE /compute/v2.1/os-snapshots/38bdd25f-d395-4540-8f4b-68855a458c92 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 13:34:18.410943 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f8da146d-62ba-4df7-8ad5-0c57d3cded75 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Calling method '.version_select at 0x7f8a9b3cb670>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:18.476409 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f8da146d-62ba-4df7-8ad5-0c57d3cded75 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/38bdd25f-d395-4540-8f4b-68855a458c92" status: 200 len: 287 microversion: 2.1 time: 0.069390 Oct 12 13:34:18.477278 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 948/1923] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 12 13:34:18 2022] GET /compute/v2.1/os-snapshots/38bdd25f-d395-4540-8f4b-68855a458c92 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:34:19.501768 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3f061a4d-15a3-4265-a17c-32d1956c2163 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Calling method '.version_select at 0x7f8a9b9d38b0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:19.557918 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3f061a4d-15a3-4265-a17c-32d1956c2163 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/38bdd25f-d395-4540-8f4b-68855a458c92" status: 200 len: 287 microversion: 2.1 time: 0.068454 Oct 12 13:34:19.564834 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 976/1924] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 12 13:34:19 2022] GET /compute/v2.1/os-snapshots/38bdd25f-d395-4540-8f4b-68855a458c92 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:34:20.571557 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cee1d2c0-7aaa-483e-a633-9a9f9af18bca tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Calling method '.version_select at 0x7f8a9b3cb940>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:20.607306 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cee1d2c0-7aaa-483e-a633-9a9f9af18bca tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/38bdd25f-d395-4540-8f4b-68855a458c92" status: 200 len: 287 microversion: 2.1 time: 0.039918 Oct 12 13:34:20.607888 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 949/1925] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 12 13:34:20 2022] GET /compute/v2.1/os-snapshots/38bdd25f-d395-4540-8f4b-68855a458c92 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:34:21.623102 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-81337439-096b-4b3e-9c8c-69509c1316e4 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Calling method '.version_select at 0x7f8a9b9fd0d0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:21.683461 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-81337439-096b-4b3e-9c8c-69509c1316e4 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] HTTP exception thrown: Snapshot 38bdd25f-d395-4540-8f4b-68855a458c92 could not be found. Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-81337439-096b-4b3e-9c8c-69509c1316e4 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Request method failure captured: Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/os-snapshots/38bdd25f-d395-4540-8f4b-68855a458c92 HTTP/1.1 Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsJRtbRuRUjO9sGKb077mtXjqhpEQZfliafmimS71nZHo2HXSypytzGJ1XUdZaqTmeDe2P9GkKvu9EpSIQ9WzD4eNkp388y0yrWAiVpYHRF9zJskSZzsOBzZenztbTxgSNnOoaAK4zpmojvIeQS7o-iqUD5kKboAnh_lC60e2NYPKL8 Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 3d8acb535e0d4b3e8da67091ed62c52c Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1517487921 Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3d8acb535e0d4b3e8da67091ed62c52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3d8acb535e0d4b3e8da67091ed62c52c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3d8acb535e0d4b3e8da67091ed62c52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3d8acb535e0d4b3e8da67091ed62c52c"}]}] Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1517487921 Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 3d8acb535e0d4b3e8da67091ed62c52c Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1517487921 Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-VolumesSnapshotsTestJSON-1517487921-project Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: afab05bc090448c08aa45ebc32452258 Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1517487921-project Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: exception: Snapshot 38bdd25f-d395-4540-8f4b-68855a458c92 could not be found. Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '38bdd25f-d395-4540-8f4b-68855a458c92'} Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 38bdd25f-d395-4540-8f4b-68855a458c92 could not be found. (HTTP 404) (Request-ID: req-0c7e1046-8949-4c6c-9e5b-c3ababe6e52d) Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 13:34:21.689717 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 38bdd25f-d395-4540-8f4b-68855a458c92 could not be found. Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 38bdd25f-d395-4540-8f4b-68855a458c92 could not be found. Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 38bdd25f-d395-4540-8f4b-68855a458c92 could not be found. Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-81337439-096b-4b3e-9c8c-69509c1316e4 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Returning 404 to user: Snapshot 38bdd25f-d395-4540-8f4b-68855a458c92 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:34:21.696635 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-81337439-096b-4b3e-9c8c-69509c1316e4 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/38bdd25f-d395-4540-8f4b-68855a458c92" status: 404 len: 111 microversion: 2.1 time: 0.071995 Oct 12 13:34:21.704648 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-83ffcafd-2d6c-4d9d-bae4-90c17e60826e tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Calling method '.version_select at 0x7f8aa3e074c0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:21.709244 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 977/1926] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 12 13:34:21 2022] GET /compute/v2.1/os-snapshots/38bdd25f-d395-4540-8f4b-68855a458c92 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:34:22.092606 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-83ffcafd-2d6c-4d9d-bae4-90c17e60826e tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/0ee72e47-b402-47fa-a0b0-7a16fe7e427e" status: 202 len: 0 microversion: 2.1 time: 0.395245 Oct 12 13:34:22.093473 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 950/1927] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 12 13:34:21 2022] DELETE /compute/v2.1/os-volumes/0ee72e47-b402-47fa-a0b0-7a16fe7e427e => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:34:22.102985 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-987e7428-b10d-403c-a1bd-c925a874dc8b tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Calling method '.version_select at 0x7f8a9bb78790>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:22.187759 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-987e7428-b10d-403c-a1bd-c925a874dc8b tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/0ee72e47-b402-47fa-a0b0-7a16fe7e427e" status: 200 len: 344 microversion: 2.1 time: 0.089064 Oct 12 13:34:22.188386 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 978/1928] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:34:22 2022] GET /compute/v2.1/os-volumes/0ee72e47-b402-47fa-a0b0-7a16fe7e427e => generated 344 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:34:23.208882 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6af0c74a-1000-41ae-98e2-43ea7c97a1b6 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Calling method '.version_select at 0x7f8a9b68e430>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:23.423730 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6af0c74a-1000-41ae-98e2-43ea7c97a1b6 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/0ee72e47-b402-47fa-a0b0-7a16fe7e427e" status: 200 len: 344 microversion: 2.1 time: 0.224315 Oct 12 13:34:23.425589 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 951/1929] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:34:23 2022] GET /compute/v2.1/os-volumes/0ee72e47-b402-47fa-a0b0-7a16fe7e427e => generated 344 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:34:24.441306 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b24a13ef-2870-4c5b-95bc-b63d99b0d357 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Calling method '.version_select at 0x7f8a9b9fd700>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:24.551284 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b24a13ef-2870-4c5b-95bc-b63d99b0d357 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/0ee72e47-b402-47fa-a0b0-7a16fe7e427e" status: 200 len: 344 microversion: 2.1 time: 0.115474 Oct 12 13:34:24.552284 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 979/1930] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:34:24 2022] GET /compute/v2.1/os-volumes/0ee72e47-b402-47fa-a0b0-7a16fe7e427e => generated 344 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:34:25.566804 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f2a743ea-0b94-4a34-bfa4-05a3180122f4 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Calling method '.version_select at 0x7f8aa3e3baf0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:25.632456 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-f2a743ea-0b94-4a34-bfa4-05a3180122f4 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] HTTP exception thrown: Volume 0ee72e47-b402-47fa-a0b0-7a16fe7e427e could not be found. Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f2a743ea-0b94-4a34-bfa4-05a3180122f4 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Request method failure captured: Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/os-volumes/0ee72e47-b402-47fa-a0b0-7a16fe7e427e HTTP/1.1 Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsJRtbRuRUjO9sGKb077mtXjqhpEQZfliafmimS71nZHo2HXSypytzGJ1XUdZaqTmeDe2P9GkKvu9EpSIQ9WzD4eNkp388y0yrWAiVpYHRF9zJskSZzsOBzZenztbTxgSNnOoaAK4zpmojvIeQS7o-iqUD5kKboAnh_lC60e2NYPKL8 Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 3d8acb535e0d4b3e8da67091ed62c52c Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1517487921 Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3d8acb535e0d4b3e8da67091ed62c52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3d8acb535e0d4b3e8da67091ed62c52c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3d8acb535e0d4b3e8da67091ed62c52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3d8acb535e0d4b3e8da67091ed62c52c"}]}] Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1517487921 Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 3d8acb535e0d4b3e8da67091ed62c52c Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1517487921 Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-VolumesSnapshotsTestJSON-1517487921-project Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: afab05bc090448c08aa45ebc32452258 Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1517487921-project Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: exception: Volume 0ee72e47-b402-47fa-a0b0-7a16fe7e427e could not be found. Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '0ee72e47-b402-47fa-a0b0-7a16fe7e427e'} Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0ee72e47-b402-47fa-a0b0-7a16fe7e427e could not be found. (HTTP 404) (Request-ID: req-10b9476e-f5ef-433c-9ccf-ca5f9b19927a) Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 13:34:25.636053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0ee72e47-b402-47fa-a0b0-7a16fe7e427e could not be found. Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0ee72e47-b402-47fa-a0b0-7a16fe7e427e could not be found. Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0ee72e47-b402-47fa-a0b0-7a16fe7e427e could not be found. Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f2a743ea-0b94-4a34-bfa4-05a3180122f4 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Returning 404 to user: Volume 0ee72e47-b402-47fa-a0b0-7a16fe7e427e could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f2a743ea-0b94-4a34-bfa4-05a3180122f4 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/0ee72e47-b402-47fa-a0b0-7a16fe7e427e" status: 404 len: 109 microversion: 2.1 time: 0.075517 Oct 12 13:34:25.643363 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 952/1931] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:34:25 2022] GET /compute/v2.1/os-volumes/0ee72e47-b402-47fa-a0b0-7a16fe7e427e => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:34:25.652786 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-dd232522-3341-4575-a951-16d4c66b8f3d tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Calling method '.version_select at 0x7f8a9ba07940>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-dd232522-3341-4575-a951-16d4c66b8f3d tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] HTTP exception thrown: Volume 0ee72e47-b402-47fa-a0b0-7a16fe7e427e could not be found. Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-dd232522-3341-4575-a951-16d4c66b8f3d tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Request method failure captured: Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: request: DELETE /compute/v2.1/os-volumes/0ee72e47-b402-47fa-a0b0-7a16fe7e427e HTTP/1.1 Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsJRtbRuRUjO9sGKb077mtXjqhpEQZfliafmimS71nZHo2HXSypytzGJ1XUdZaqTmeDe2P9GkKvu9EpSIQ9WzD4eNkp388y0yrWAiVpYHRF9zJskSZzsOBzZenztbTxgSNnOoaAK4zpmojvIeQS7o-iqUD5kKboAnh_lC60e2NYPKL8 Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 3d8acb535e0d4b3e8da67091ed62c52c Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1517487921 Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3d8acb535e0d4b3e8da67091ed62c52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3d8acb535e0d4b3e8da67091ed62c52c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3d8acb535e0d4b3e8da67091ed62c52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3d8acb535e0d4b3e8da67091ed62c52c"}]}] Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1517487921 Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 3d8acb535e0d4b3e8da67091ed62c52c Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1517487921 Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-VolumesSnapshotsTestJSON-1517487921-project Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: afab05bc090448c08aa45ebc32452258 Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1517487921-project Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: method: Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: exception: Volume 0ee72e47-b402-47fa-a0b0-7a16fe7e427e could not be found. Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': '0ee72e47-b402-47fa-a0b0-7a16fe7e427e'} Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0ee72e47-b402-47fa-a0b0-7a16fe7e427e could not be found. (HTTP 404) (Request-ID: req-a8dfe2c7-12ed-4a72-b265-c6758095211e) Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 13:34:25.722143 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0ee72e47-b402-47fa-a0b0-7a16fe7e427e could not be found. Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0ee72e47-b402-47fa-a0b0-7a16fe7e427e could not be found. Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0ee72e47-b402-47fa-a0b0-7a16fe7e427e could not be found. Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-dd232522-3341-4575-a951-16d4c66b8f3d tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Returning 404 to user: Volume 0ee72e47-b402-47fa-a0b0-7a16fe7e427e could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-dd232522-3341-4575-a951-16d4c66b8f3d tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/0ee72e47-b402-47fa-a0b0-7a16fe7e427e" status: 404 len: 109 microversion: 2.1 time: 0.072259 Oct 12 13:34:25.727444 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 980/1932] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Oct 12 13:34:25 2022] DELETE /compute/v2.1/os-volumes/0ee72e47-b402-47fa-a0b0-7a16fe7e427e => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 13:34:25.730901 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0e3d3259-bfed-4e99-9f0b-dd4e67b30512 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Calling method '.version_select at 0x7f8aa3e3b040>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:25.797141 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-0e3d3259-bfed-4e99-9f0b-dd4e67b30512 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] HTTP exception thrown: Volume 0ee72e47-b402-47fa-a0b0-7a16fe7e427e could not be found. Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0e3d3259-bfed-4e99-9f0b-dd4e67b30512 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Request method failure captured: Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/os-volumes/0ee72e47-b402-47fa-a0b0-7a16fe7e427e HTTP/1.1 Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsJRtbRuRUjO9sGKb077mtXjqhpEQZfliafmimS71nZHo2HXSypytzGJ1XUdZaqTmeDe2P9GkKvu9EpSIQ9WzD4eNkp388y0yrWAiVpYHRF9zJskSZzsOBzZenztbTxgSNnOoaAK4zpmojvIeQS7o-iqUD5kKboAnh_lC60e2NYPKL8 Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 3d8acb535e0d4b3e8da67091ed62c52c Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1517487921 Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3d8acb535e0d4b3e8da67091ed62c52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3d8acb535e0d4b3e8da67091ed62c52c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3d8acb535e0d4b3e8da67091ed62c52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3d8acb535e0d4b3e8da67091ed62c52c"}]}] Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1517487921 Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 3d8acb535e0d4b3e8da67091ed62c52c Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1517487921 Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-VolumesSnapshotsTestJSON-1517487921-project Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: afab05bc090448c08aa45ebc32452258 Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1517487921-project Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: method: Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: exception: Volume 0ee72e47-b402-47fa-a0b0-7a16fe7e427e could not be found. Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': '0ee72e47-b402-47fa-a0b0-7a16fe7e427e'} Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0ee72e47-b402-47fa-a0b0-7a16fe7e427e could not be found. (HTTP 404) (Request-ID: req-a96409f9-3da2-4d29-8bc6-494754a958bf) Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 13:34:25.799102 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0ee72e47-b402-47fa-a0b0-7a16fe7e427e could not be found. Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0ee72e47-b402-47fa-a0b0-7a16fe7e427e could not be found. Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0ee72e47-b402-47fa-a0b0-7a16fe7e427e could not be found. Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0e3d3259-bfed-4e99-9f0b-dd4e67b30512 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] Returning 404 to user: Volume 0ee72e47-b402-47fa-a0b0-7a16fe7e427e could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0e3d3259-bfed-4e99-9f0b-dd4e67b30512 tempest-VolumesSnapshotsTestJSON-1517487921 tempest-VolumesSnapshotsTestJSON-1517487921-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/0ee72e47-b402-47fa-a0b0-7a16fe7e427e" status: 404 len: 109 microversion: 2.1 time: 0.075745 Oct 12 13:34:25.804156 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 953/1933] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:34:25 2022] GET /compute/v2.1/os-volumes/0ee72e47-b402-47fa-a0b0-7a16fe7e427e => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:34:35.537381 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:34:35.918034 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-546f82d8-b88f-42ce-a412-071543c4473e tempest-ServerAddressesNegativeTestJSON-978317291 tempest-ServerAddressesNegativeTestJSON-978317291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-960575342", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "0e622990-f1a8-4a24-9a35-dfb2c3e97097"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:34:36.018066 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-546f82d8-b88f-42ce-a412-071543c4473e tempest-ServerAddressesNegativeTestJSON-978317291 tempest-ServerAddressesNegativeTestJSON-978317291-project] validate_networks() for [('0e622990-f1a8-4a24-9a35-dfb2c3e97097', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-546f82d8-b88f-42ce-a412-071543c4473e tempest-ServerAddressesNegativeTestJSON-978317291 tempest-ServerAddressesNegativeTestJSON-978317291-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3a86fb02-bcbd-4b52-a4a1-55aadb450155) Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:34:37.238542 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:34:37.243703 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:34:37.243703 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:34:37.243703 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:34:37.243703 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:34:37.243703 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:34:37.243703 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:34:37.243703 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:34:37.243703 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:34:37.243703 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:34:37.243703 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:34:37.243703 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:34:37.243703 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:34:37.243703 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:34:37.243703 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:34:37.243703 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:34:37.243703 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3a86fb02-bcbd-4b52-a4a1-55aadb450155) Oct 12 13:34:37.243703 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:37.243703 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-546f82d8-b88f-42ce-a412-071543c4473e tempest-ServerAddressesNegativeTestJSON-978317291 tempest-ServerAddressesNegativeTestJSON-978317291-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:34:37.243703 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-546f82d8-b88f-42ce-a412-071543c4473e tempest-ServerAddressesNegativeTestJSON-978317291 tempest-ServerAddressesNegativeTestJSON-978317291-project] Request method failure captured: Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 216 Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsJrgtFL43rI1bA0CALdOXbTiyVbyHaGfqv5UTuCbh8myEH40K5UTGZ4U7TD4dgSFqpznvXtrKHRd_cbT5KQCp1k221mziyC8ileps5xf9bDz0B-H3eWiqQ29Vj8FQEZs-4PttVDuoAsPjzOSnWcTqr9CGgOuMV1R0WDKxXeQjKk6l8 Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: d94a83180c874bebb1ab09a14ab552f5 Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-978317291 Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d94a83180c874bebb1ab09a14ab552f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d94a83180c874bebb1ab09a14ab552f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d94a83180c874bebb1ab09a14ab552f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d94a83180c874bebb1ab09a14ab552f5"}]}] Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-978317291 Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: d94a83180c874bebb1ab09a14ab552f5 Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-978317291 Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServerAddressesNegativeTestJSON-978317291-project Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 65850988c9cb40d8a8fb4273eb78af1b Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-978317291-project Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-960575342", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "0e622990-f1a8-4a24-9a35-dfb2c3e97097"}]}} Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-ServerAddressesNegativeTestJSON-server-960575342', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '0e622990-f1a8-4a24-9a35-dfb2c3e97097'}]}}} Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:34:37.247013 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3a86fb02-bcbd-4b52-a4a1-55aadb450155) Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:34:37.251114 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:34:37.255991 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:34:37.255991 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:37.255991 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:37.255991 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:34:37.255991 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:37.255991 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:34:37.255991 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:34:37.255991 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:34:37.255991 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:34:37.255991 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:34:37.255991 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:34:37.255991 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:37.255991 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:34:37.255991 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-546f82d8-b88f-42ce-a412-071543c4473e tempest-ServerAddressesNegativeTestJSON-978317291 tempest-ServerAddressesNegativeTestJSON-978317291-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:34:37.255991 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:34:37.255991 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-546f82d8-b88f-42ce-a412-071543c4473e tempest-ServerAddressesNegativeTestJSON-978317291 tempest-ServerAddressesNegativeTestJSON-978317291-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.718717 Oct 12 13:34:37.255991 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 981/1934] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:34:35 2022] POST /compute/v2.1/servers => generated 214 bytes in 1722 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:34:38.640455 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:34:38.647212 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-716f4422-3e80-4e1e-853e-8c4fc82efe63 tempest-VolumesTestJSON-2066399144 tempest-VolumesTestJSON-2066399144-project] Calling method '.version_select at 0x7f8a9b68e430>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:38.716047 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-716f4422-3e80-4e1e-853e-8c4fc82efe63 tempest-VolumesTestJSON-2066399144 tempest-VolumesTestJSON-2066399144-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6a5553aa-5be7-4fcb-b83b-06004d1e120a" status: 200 len: 350 microversion: 2.1 time: 0.075918 Oct 12 13:34:38.724410 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 954/1935] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:34:38 2022] GET /compute/v2.1/os-volumes/6a5553aa-5be7-4fcb-b83b-06004d1e120a => generated 350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:34:43.292415 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c1cf1d25-e540-4b3e-982d-d08b1aebf5ff tempest-VolumesTestJSON-2066399144 tempest-VolumesTestJSON-2066399144-project] Calling method '.version_select at 0x7f8a9bfe3550>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:43.364602 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c1cf1d25-e540-4b3e-982d-d08b1aebf5ff tempest-VolumesTestJSON-2066399144 tempest-VolumesTestJSON-2066399144-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/f20de513-cf17-415b-96d9-e9d33f5a968d" status: 200 len: 350 microversion: 2.1 time: 0.077383 Oct 12 13:34:43.364602 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 982/1936] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:34:43 2022] GET /compute/v2.1/os-volumes/f20de513-cf17-415b-96d9-e9d33f5a968d => generated 350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:34:46.413226 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a2622f4a-e6e0-4e95-9a30-dd1abd176e51 tempest-VolumesTestJSON-2066399144 tempest-VolumesTestJSON-2066399144-project] Calling method '.version_select at 0x7f8a9bd594c0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:46.510913 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a2622f4a-e6e0-4e95-9a30-dd1abd176e51 tempest-VolumesTestJSON-2066399144 tempest-VolumesTestJSON-2066399144-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/ba40b13c-3f6d-47e7-aa02-1b26354e1415" status: 200 len: 351 microversion: 2.1 time: 0.104234 Oct 12 13:34:46.511950 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 955/1937] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Oct 12 13:34:46 2022] GET /compute/v2.1/os-volumes/ba40b13c-3f6d-47e7-aa02-1b26354e1415 => generated 351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:34:46.527550 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-603de8cd-bb99-4d4d-905b-613103308772 tempest-VolumesTestJSON-2066399144 tempest-VolumesTestJSON-2066399144-project] Calling method '.version_select at 0x7f8a9bb78670>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:46.750114 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:34:46.755771 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-603de8cd-bb99-4d4d-905b-613103308772 tempest-VolumesTestJSON-2066399144 tempest-VolumesTestJSON-2066399144-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.232778 Oct 12 13:34:46.756841 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 983/1938] 10.222.0.52 () {58 vars in 1134 bytes} [Wed Oct 12 13:34:46 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:34:46.772484 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-60e06bb4-ae9d-4baf-a36a-4126a5866186 tempest-VolumesTestJSON-2066399144 tempest-VolumesTestJSON-2066399144-project] Calling method '.version_select at 0x7f8a9b68e310>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:46.930635 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-60e06bb4-ae9d-4baf-a36a-4126a5866186 tempest-VolumesTestJSON-2066399144 tempest-VolumesTestJSON-2066399144-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.162908 Oct 12 13:34:46.940401 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 956/1939] 10.222.0.52 () {58 vars in 1149 bytes} [Wed Oct 12 13:34:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:34:46.944857 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8ffaeb45-394d-4a11-a14d-1054aea8e8f8 tempest-VolumesTestJSON-2066399144 tempest-VolumesTestJSON-2066399144-project] Calling method '.version_select at 0x7f8a9ba07790>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:47.050191 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-8ffaeb45-394d-4a11-a14d-1054aea8e8f8 tempest-VolumesTestJSON-2066399144 tempest-VolumesTestJSON-2066399144-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.108126 Oct 12 13:34:47.050960 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 984/1940] 10.222.0.52 () {58 vars in 1134 bytes} [Wed Oct 12 13:34:46 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:34:47.065696 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a1f63d3b-5cb1-421e-b0ee-fad0bb205932 tempest-VolumesTestJSON-2066399144 tempest-VolumesTestJSON-2066399144-project] Calling method '.version_select at 0x7f8a9be6cee0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:47.165061 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a1f63d3b-5cb1-421e-b0ee-fad0bb205932 tempest-VolumesTestJSON-2066399144 tempest-VolumesTestJSON-2066399144-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.103504 Oct 12 13:34:47.168524 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 957/1941] 10.222.0.52 () {58 vars in 1167 bytes} [Wed Oct 12 13:34:47 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:34:47.182386 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-737f9377-f646-42be-ad7b-6ec947978289 tempest-VolumesTestJSON-2066399144 tempest-VolumesTestJSON-2066399144-project] Calling method '.version_select at 0x7f8a9b8e9b80>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:47.351334 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-737f9377-f646-42be-ad7b-6ec947978289 tempest-VolumesTestJSON-2066399144 tempest-VolumesTestJSON-2066399144-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.173663 Oct 12 13:34:47.361506 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 985/1942] 10.222.0.52 () {58 vars in 1170 bytes} [Wed Oct 12 13:34:47 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:34:47.371791 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2cd04d2d-d253-46a8-b665-d2d469fab59c tempest-VolumesTestJSON-2066399144 tempest-VolumesTestJSON-2066399144-project] Calling method '.version_select at 0x7f8a9ba13670>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:47.554014 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2cd04d2d-d253-46a8-b665-d2d469fab59c tempest-VolumesTestJSON-2066399144 tempest-VolumesTestJSON-2066399144-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.189102 Oct 12 13:34:47.565898 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 958/1943] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 12 13:34:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:34:47.572311 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-664c3b36-5c43-4788-a501-6c3085e956b6 tempest-VolumesTestJSON-2066399144 tempest-VolumesTestJSON-2066399144-project] Calling method '.version_select at 0x7f8aa034c550>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:47.719342 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-664c3b36-5c43-4788-a501-6c3085e956b6 tempest-VolumesTestJSON-2066399144 tempest-VolumesTestJSON-2066399144-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.151767 Oct 12 13:34:47.719914 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 986/1944] 10.222.0.52 () {58 vars in 1188 bytes} [Wed Oct 12 13:34:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:34:47.735392 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ecfc94b8-00df-4554-8af6-6912b9dd0898 tempest-VolumesTestJSON-2066399144 tempest-VolumesTestJSON-2066399144-project] Calling method '.version_select at 0x7f8a9b5f5f70>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:34:47.967656 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ecfc94b8-00df-4554-8af6-6912b9dd0898 tempest-VolumesTestJSON-2066399144 tempest-VolumesTestJSON-2066399144-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.237520 Oct 12 13:34:47.968632 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 959/1945] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 12 13:34:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:35:14.872154 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9a0dfc31-d40e-41e0-87c0-09076cbf8f70 tempest-ServerMetadataNegativeTestJSON-2036630927 tempest-ServerMetadataNegativeTestJSON-2036630927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1901906530", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "24ed0d18-05c5-4e35-8072-56bfd51a55aa"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:35:14.972636 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-9a0dfc31-d40e-41e0-87c0-09076cbf8f70 tempest-ServerMetadataNegativeTestJSON-2036630927 tempest-ServerMetadataNegativeTestJSON-2036630927-project] validate_networks() for [('24ed0d18-05c5-4e35-8072-56bfd51a55aa', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-9a0dfc31-d40e-41e0-87c0-09076cbf8f70 tempest-ServerMetadataNegativeTestJSON-2036630927 tempest-ServerMetadataNegativeTestJSON-2036630927-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ee930626-9c4f-45dc-a777-a65def8e8483) Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:35:15.817742 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:35:15.822899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:35:15.822899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:35:15.822899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:35:15.822899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:35:15.822899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:35:15.822899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:35:15.822899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:35:15.822899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:35:15.822899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:35:15.822899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:35:15.822899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:35:15.822899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:35:15.822899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:35:15.822899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:35:15.822899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:35:15.822899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ee930626-9c4f-45dc-a777-a65def8e8483) Oct 12 13:35:15.822899 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:35:15.825795 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-9a0dfc31-d40e-41e0-87c0-09076cbf8f70 tempest-ServerMetadataNegativeTestJSON-2036630927 tempest-ServerMetadataNegativeTestJSON-2036630927-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:35:15.825795 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9a0dfc31-d40e-41e0-87c0-09076cbf8f70 tempest-ServerMetadataNegativeTestJSON-2036630927 tempest-ServerMetadataNegativeTestJSON-2036630927-project] Request method failure captured: Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 232 Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsKROSOkx2HvIPjQolCcTBUupJ4bHIgWZhGbZ5mQ2IXd1D74FQcECbfeb0qeF2mFsvKSbBFYXJAa2e4Olxt3XUbV2j5kvikNNl9CbppcyglX5IiX2AXpoHIhBG5KeXvTAdBNdnvhwgUXnciZT4_ZK3ckTVjs9IXF1sGp2v9Tmq1LFwo Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 71df6700893e4532a71b20912666ee13 Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2036630927 Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/71df6700893e4532a71b20912666ee13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_71df6700893e4532a71b20912666ee13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/71df6700893e4532a71b20912666ee13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/71df6700893e4532a71b20912666ee13"}]}] Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2036630927 Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 71df6700893e4532a71b20912666ee13 Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2036630927 Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServerMetadataNegativeTestJSON-2036630927-project Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: deb2d02e973242c4a7d78b04e6aa9b29 Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2036630927-project Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1901906530", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "24ed0d18-05c5-4e35-8072-56bfd51a55aa"}]}} Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1901906530', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'metadata': {}, 'networks': [{'uuid': '24ed0d18-05c5-4e35-8072-56bfd51a55aa'}]}}} Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:35:15.828872 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ee930626-9c4f-45dc-a777-a65def8e8483) Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:35:15.834708 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:35:15.839174 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:35:15.839174 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:35:15.839174 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:35:15.839174 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:35:15.839174 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:35:15.839174 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:35:15.839174 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:35:15.839174 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:35:15.839174 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:35:15.839174 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:35:15.839174 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:35:15.839174 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:35:15.839174 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:35:15.839174 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:35:15.844776 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9a0dfc31-d40e-41e0-87c0-09076cbf8f70 tempest-ServerMetadataNegativeTestJSON-2036630927 tempest-ServerMetadataNegativeTestJSON-2036630927-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:35:15.844776 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:35:15.846393 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9a0dfc31-d40e-41e0-87c0-09076cbf8f70 tempest-ServerMetadataNegativeTestJSON-2036630927 tempest-ServerMetadataNegativeTestJSON-2036630927-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.564296 Oct 12 13:35:15.849662 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 987/1946] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:35:14 2022] POST /compute/v2.1/servers => generated 214 bytes in 1567 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:35:36.207817 n-d-861076-2 devstack@n-api.service[120932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 13:35:36.208305 n-d-861076-2 devstack@n-api.service[120932]: Wed Oct 12 13:35:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 12 13:35:36.485666 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-034ca092-0890-4fa9-b2c9-c52d62db27c1 tempest-InstanceActionsTestJSON-1452520807 tempest-InstanceActionsTestJSON-1452520807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1385550455", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "10b31c49-133f-47fc-8c40-396a7d362130"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:35:36.578045 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-034ca092-0890-4fa9-b2c9-c52d62db27c1 tempest-InstanceActionsTestJSON-1452520807 tempest-InstanceActionsTestJSON-1452520807-project] validate_networks() for [('10b31c49-133f-47fc-8c40-396a7d362130', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-034ca092-0890-4fa9-b2c9-c52d62db27c1 tempest-InstanceActionsTestJSON-1452520807 tempest-InstanceActionsTestJSON-1452520807-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-384276a3-90f2-428f-a5a3-95c68ddb4800) Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:35:37.393348 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:35:37.398278 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:35:37.398278 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:35:37.398278 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:35:37.398278 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:35:37.398278 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:35:37.398278 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:35:37.398278 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:35:37.398278 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:35:37.398278 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:35:37.398278 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:35:37.398278 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:35:37.398278 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:35:37.398278 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:35:37.398278 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:35:37.398278 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:35:37.398278 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-384276a3-90f2-428f-a5a3-95c68ddb4800) Oct 12 13:35:37.398278 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:35:37.398278 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-034ca092-0890-4fa9-b2c9-c52d62db27c1 tempest-InstanceActionsTestJSON-1452520807 tempest-InstanceActionsTestJSON-1452520807-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:35:37.398278 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-034ca092-0890-4fa9-b2c9-c52d62db27c1 tempest-InstanceActionsTestJSON-1452520807 tempest-InstanceActionsTestJSON-1452520807-project] Request method failure captured: Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 209 Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsKnPjKnPi2nQzgqmVTH2znKpkcd-4cqp5q7eBR9giF-i0GE_65oWuFz7pNg8x09aGBm9JUZnmu4mhCWfKrpoiwnuSrDVI0wgnesoeYmnok4HaztISO0V-hb4-IdLDBqEUNVJUzzyTc-Jw1m81DT9Bwy0-0XKQ6Sb7jYFvLXvr4wGM0 Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 1d671de3a01f4aa4a5f3c07951a94ea8 Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-InstanceActionsTestJSON-1452520807 Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1d671de3a01f4aa4a5f3c07951a94ea8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1d671de3a01f4aa4a5f3c07951a94ea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d671de3a01f4aa4a5f3c07951a94ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d671de3a01f4aa4a5f3c07951a94ea8"}]}] Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-InstanceActionsTestJSON-1452520807 Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 1d671de3a01f4aa4a5f3c07951a94ea8 Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1452520807 Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-InstanceActionsTestJSON-1452520807-project Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 2a372a2f4f2a4d779a4e85b07f6c1b06 Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-InstanceActionsTestJSON-1452520807-project Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1385550455", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "10b31c49-133f-47fc-8c40-396a7d362130"}]}} Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-InstanceActionsTestJSON-server-1385550455', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '10b31c49-133f-47fc-8c40-396a7d362130'}]}}} Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:35:37.400858 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-384276a3-90f2-428f-a5a3-95c68ddb4800) Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:35:37.406696 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:35:37.412666 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:35:37.412666 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:35:37.412666 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:35:37.412666 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:35:37.412666 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:35:37.412666 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:35:37.412666 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:35:37.412666 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:35:37.412666 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:35:37.412666 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:35:37.412666 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:35:37.412666 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:35:37.412666 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:35:37.412666 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-034ca092-0890-4fa9-b2c9-c52d62db27c1 tempest-InstanceActionsTestJSON-1452520807 tempest-InstanceActionsTestJSON-1452520807-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:35:37.412666 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:35:37.412666 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-034ca092-0890-4fa9-b2c9-c52d62db27c1 tempest-InstanceActionsTestJSON-1452520807 tempest-InstanceActionsTestJSON-1452520807-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.199099 Oct 12 13:35:37.414075 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 960/1947] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:35:36 2022] POST /compute/v2.1/servers => generated 214 bytes in 1208 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 12 13:35:50.386091 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:35:50.387200 n-d-861076-2 devstack@n-api.service[120933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 13:35:50.387336 n-d-861076-2 devstack@n-api.service[120933]: Wed Oct 12 13:35:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 12 13:35:51.146010 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e56b4061-771b-45f2-8161-47531d513126 tempest-ServerRescueTestJSON-70322738 tempest-ServerRescueTestJSON-70322738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1130447214", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:35:51.260624 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-e56b4061-771b-45f2-8161-47531d513126 tempest-ServerRescueTestJSON-70322738 tempest-ServerRescueTestJSON-70322738-project] validate_networks() for [('7fc72e01-aba0-4aef-a9ce-6cd8fa9e9edd', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-e56b4061-771b-45f2-8161-47531d513126 tempest-ServerRescueTestJSON-70322738 tempest-ServerRescueTestJSON-70322738-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c582d132-3585-4503-a3f9-173fb06f3d84) Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:35:52.272204 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:35:52.277195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:35:52.277195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:35:52.277195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:35:52.277195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:35:52.277195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:35:52.277195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:35:52.277195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:35:52.277195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:35:52.277195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:35:52.277195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:35:52.277195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:35:52.277195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:35:52.277195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:35:52.277195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:35:52.277195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c582d132-3585-4503-a3f9-173fb06f3d84) Oct 12 13:35:52.277195 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:35:52.277195 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-e56b4061-771b-45f2-8161-47531d513126 tempest-ServerRescueTestJSON-70322738 tempest-ServerRescueTestJSON-70322738-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:35:52.277195 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e56b4061-771b-45f2-8161-47531d513126 tempest-ServerRescueTestJSON-70322738 tempest-ServerRescueTestJSON-70322738-project] Request method failure captured: Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 238 Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsK2u2tqF7G2bcIWs1PQhhl8TAhj4lLxIv3vORJ_NofjMC6pLJ5mFPjmXy3SyesyHBI37AmJgGPP3RmaQd-5w74Jb0ROaCbWKybHEVL6f40hNLIzQs7SsefN-nPU-9DThmC-zg_La8pSqVqkMfXBxx-K09MUF8CtQS9qXrLvkBoGwMk Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: f4be56b1ada248c58132f49af0ffae11 Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServerRescueTestJSON-70322738 Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f4be56b1ada248c58132f49af0ffae11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f4be56b1ada248c58132f49af0ffae11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4be56b1ada248c58132f49af0ffae11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4be56b1ada248c58132f49af0ffae11"}]}] Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServerRescueTestJSON-70322738 Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: f4be56b1ada248c58132f49af0ffae11 Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServerRescueTestJSON-70322738 Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServerRescueTestJSON-70322738-project Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 0bb365c0b90a448ba1d5aefcc0bd665a Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServerRescueTestJSON-70322738-project Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-ServerRescueTestJSON-server-1130447214", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "Q9%VCR^EatVOBzK", "networks": [{"uuid": "7fc72e01-aba0-4aef-a9ce-6cd8fa9e9edd"}]}} Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-ServerRescueTestJSON-server-1130447214', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'adminPass': 'Q9%VCR^EatVOBzK', 'networks': [{'uuid': '7fc72e01-aba0-4aef-a9ce-6cd8fa9e9edd'}]}}} Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:35:52.282549 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c582d132-3585-4503-a3f9-173fb06f3d84) Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:35:52.287755 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:35:52.293299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:35:52.293299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:35:52.293299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:35:52.293299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:35:52.293299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:35:52.293299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:35:52.293299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:35:52.293299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:35:52.293299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:35:52.293299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:35:52.293299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:35:52.293299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:35:52.293299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:35:52.295949 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e56b4061-771b-45f2-8161-47531d513126 tempest-ServerRescueTestJSON-70322738 tempest-ServerRescueTestJSON-70322738-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:35:52.295949 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:35:52.297993 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e56b4061-771b-45f2-8161-47531d513126 tempest-ServerRescueTestJSON-70322738 tempest-ServerRescueTestJSON-70322738-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.916762 Oct 12 13:35:52.306496 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 988/1948] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:35:50 2022] POST /compute/v2.1/servers => generated 214 bytes in 1926 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:36:07.516658 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-034ca092-0890-4fa9-b2c9-c52d62db27c1 tempest-InstanceActionsTestJSON-1452520807 tempest-InstanceActionsTestJSON-1452520807-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:36:07.516658 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-034ca092-0890-4fa9-b2c9-c52d62db27c1 tempest-InstanceActionsTestJSON-1452520807 tempest-InstanceActionsTestJSON-1452520807-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002182 Oct 12 13:36:07.516658 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 961/1949] 10.222.0.52 () {56 vars in 886 bytes} [Wed Oct 12 13:36:07 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 12 13:36:12.092593 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:36:12.804196 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-06b5722a-b119-4a0b-9ad6-06e779ee307a tempest-ListServersNegativeTestJSON-13558617 tempest-ListServersNegativeTestJSON-13558617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-925590767", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "7138da94-83a1-4085-be84-443683ac6810"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:36:12.924464 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-06b5722a-b119-4a0b-9ad6-06e779ee307a tempest-ListServersNegativeTestJSON-13558617 tempest-ListServersNegativeTestJSON-13558617-project] validate_networks() for [('7138da94-83a1-4085-be84-443683ac6810', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-06b5722a-b119-4a0b-9ad6-06e779ee307a tempest-ListServersNegativeTestJSON-13558617 tempest-ListServersNegativeTestJSON-13558617-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-07823e45-2945-4a4b-9a0c-64f55680acbf) Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:36:13.554380 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-07823e45-2945-4a4b-9a0c-64f55680acbf) Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-06b5722a-b119-4a0b-9ad6-06e779ee307a tempest-ListServersNegativeTestJSON-13558617 tempest-ListServersNegativeTestJSON-13558617-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-06b5722a-b119-4a0b-9ad6-06e779ee307a tempest-ListServersNegativeTestJSON-13558617 tempest-ListServersNegativeTestJSON-13558617-project] Request method failure captured: Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 228 Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsLLkoT2lETah-15aTb9RM191lGEzsbI9ujFut-Tx72-B5WDk0nWqkb3qoolFPzWqDtJ0X3v-QesjYZaJ6z9esNx9UgAGUXc75xhvl2c6jqACu8JBKSN45PA98rCW59yFR9RDR2kpRpvs14ySFaFVvF9hAgREl6_MqrxLjVC3YBatKY Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: e8f2ee6a6e934d2094517ff2766a506a Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ListServersNegativeTestJSON-13558617 Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e8f2ee6a6e934d2094517ff2766a506a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e8f2ee6a6e934d2094517ff2766a506a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e8f2ee6a6e934d2094517ff2766a506a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e8f2ee6a6e934d2094517ff2766a506a"}]}] Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ListServersNegativeTestJSON-13558617 Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: e8f2ee6a6e934d2094517ff2766a506a Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-13558617 Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ListServersNegativeTestJSON-13558617-project Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: ee6fcc4e30e54654975787e44ddb57ff Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ListServersNegativeTestJSON-13558617-project Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-925590767", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "7138da94-83a1-4085-be84-443683ac6810"}]}} Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:36:13.559586 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-ListServersNegativeTestJSON-server-925590767', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'min_count': 3, 'networks': [{'uuid': '7138da94-83a1-4085-be84-443683ac6810'}]}}} Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:36:13.566808 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-07823e45-2945-4a4b-9a0c-64f55680acbf) Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-06b5722a-b119-4a0b-9ad6-06e779ee307a tempest-ListServersNegativeTestJSON-13558617 tempest-ListServersNegativeTestJSON-13558617-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-06b5722a-b119-4a0b-9ad6-06e779ee307a tempest-ListServersNegativeTestJSON-13558617 tempest-ListServersNegativeTestJSON-13558617-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.473698 Oct 12 13:36:13.581781 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 989/1950] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:36:12 2022] POST /compute/v2.1/servers => generated 214 bytes in 1481 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:36:46.006868 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:36:46.375212 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f02ac266-d34f-4139-9c4a-5f28390eca49 tempest-ServerRescueTestJSONUnderV235-1359710350 tempest-ServerRescueTestJSONUnderV235-1359710350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-2038098784", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:36:47.413310 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-f02ac266-d34f-4139-9c4a-5f28390eca49 tempest-ServerRescueTestJSONUnderV235-1359710350 tempest-ServerRescueTestJSONUnderV235-1359710350-project] validate_networks() for [('145c88b5-b0ab-41e9-94c2-705c19760cc5', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-f02ac266-d34f-4139-9c4a-5f28390eca49 tempest-ServerRescueTestJSONUnderV235-1359710350 tempest-ServerRescueTestJSONUnderV235-1359710350-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cec69aca-3d05-438d-a311-b849f45e1814) Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:36:48.658363 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:36:48.662012 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:36:48.662012 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:36:48.662012 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:36:48.662012 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:36:48.662012 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:36:48.662012 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:36:48.662012 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:36:48.662012 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:36:48.662012 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:36:48.662012 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:36:48.662012 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:36:48.662012 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:36:48.662012 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:36:48.662012 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:36:48.662012 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:36:48.662012 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cec69aca-3d05-438d-a311-b849f45e1814) Oct 12 13:36:48.662012 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:36:48.662012 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-f02ac266-d34f-4139-9c4a-5f28390eca49 tempest-ServerRescueTestJSONUnderV235-1359710350 tempest-ServerRescueTestJSONUnderV235-1359710350-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:36:48.662012 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f02ac266-d34f-4139-9c4a-5f28390eca49 tempest-ServerRescueTestJSONUnderV235-1359710350 tempest-ServerRescueTestJSONUnderV235-1359710350-project] Request method failure captured: Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 247 Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsLtos2ewnAT3CK_8IW_zSIaS_fUUoVbQe5tDFCUpcnQ-YwrTbkxMHaWWFrYmW2iTJnlO-_hrIIga0X5iClGa_id3Nt3dwL0m0ptiz4qb7oSTy3PFMUS40I72PALqmktBWCD8aZwro3OzEshz1C1ja3z8VeoyY4je7M0luLQ00Pik6Q Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 26315c14913a4bd8bb8a157f1e2e98d1 Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1359710350 Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/26315c14913a4bd8bb8a157f1e2e98d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_26315c14913a4bd8bb8a157f1e2e98d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/26315c14913a4bd8bb8a157f1e2e98d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/26315c14913a4bd8bb8a157f1e2e98d1"}]}] Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1359710350 Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 26315c14913a4bd8bb8a157f1e2e98d1 Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1359710350 Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServerRescueTestJSONUnderV235-1359710350-project Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: f707178a16254e44a5a2abb1fd1f7c2a Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1359710350-project Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-2038098784", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "Z0+l#_kVDoZwRAD", "networks": [{"uuid": "145c88b5-b0ab-41e9-94c2-705c19760cc5"}]}} Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-ServerRescueTestJSONUnderV235-server-2038098784', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'adminPass': 'Z0+l#_kVDoZwRAD', 'networks': [{'uuid': '145c88b5-b0ab-41e9-94c2-705c19760cc5'}]}}} Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:36:48.664445 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cec69aca-3d05-438d-a311-b849f45e1814) Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:36:48.668250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:36:48.671634 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:36:48.671634 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:36:48.671634 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:36:48.671634 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:36:48.671634 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:36:48.671634 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:36:48.671634 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:36:48.671634 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:36:48.671634 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:36:48.671634 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:36:48.671634 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:36:48.671634 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:36:48.671634 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:36:48.671634 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:36:48.671634 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f02ac266-d34f-4139-9c4a-5f28390eca49 tempest-ServerRescueTestJSONUnderV235-1359710350 tempest-ServerRescueTestJSONUnderV235-1359710350-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:36:48.671634 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:36:48.671634 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f02ac266-d34f-4139-9c4a-5f28390eca49 tempest-ServerRescueTestJSONUnderV235-1359710350 tempest-ServerRescueTestJSONUnderV235-1359710350-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.665748 Oct 12 13:36:48.672715 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 962/1951] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:36:46 2022] POST /compute/v2.1/servers => generated 214 bytes in 2669 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:37:20.531721 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:37:20.532702 n-d-861076-2 devstack@n-api.service[120933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 13:37:20.532942 n-d-861076-2 devstack@n-api.service[120933]: Wed Oct 12 13:37:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 12 13:37:20.534002 n-d-861076-2 devstack@n-api.service[120933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 13:37:20.534125 n-d-861076-2 devstack@n-api.service[120933]: Wed Oct 12 13:37:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 12 13:37:21.382180 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-453df6ff-7358-4d5b-bd6f-879dff735dfa tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-2026326917", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "48356e8a-1e09-4e20-a0e0-f257851bb733"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:37:22.414260 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-453df6ff-7358-4d5b-bd6f-879dff735dfa tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] validate_networks() for [('48356e8a-1e09-4e20-a0e0-f257851bb733', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-453df6ff-7358-4d5b-bd6f-879dff735dfa tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dcc067bb-74e9-4690-8262-59517346b1cf) Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:37:23.091333 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:37:23.094840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:37:23.094840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:37:23.094840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:37:23.094840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:37:23.094840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:37:23.094840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:37:23.094840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:37:23.094840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:37:23.094840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:37:23.094840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:37:23.094840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:37:23.094840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:37:23.094840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:37:23.094840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:37:23.094840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dcc067bb-74e9-4690-8262-59517346b1cf) Oct 12 13:37:23.094840 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:23.096218 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-453df6ff-7358-4d5b-bd6f-879dff735dfa tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:23.096218 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-453df6ff-7358-4d5b-bd6f-879dff735dfa tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Request method failure captured: Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 185 Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsMQy6wPrsJ2kMtP3gJmDju4pVmBSBbRXnOQbKUxmmMq_DULE8U02caZM1VdHvG2b8jcYx-k5ZI3DmIOlhqeDzlpbT2Y4L_PmILtZyaJwuGhxnQGPje3QLflFTEmWHyYPVW0dC2qAX1Ysr0eodrLU0PbxO1mB-Uj9n7u6mGXjkVnPko Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 5b24a04b60dc41abb94f4696b281dfec Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServersTestJSON-2097061306 Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b24a04b60dc41abb94f4696b281dfec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b24a04b60dc41abb94f4696b281dfec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b24a04b60dc41abb94f4696b281dfec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b24a04b60dc41abb94f4696b281dfec"}]}] Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServersTestJSON-2097061306 Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 5b24a04b60dc41abb94f4696b281dfec Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServersTestJSON-2097061306 Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServersTestJSON-2097061306-project Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: a341a09e90ea46dbb8c6ffb1a8f7d3cc Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServersTestJSON-2097061306-project Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-\u20a1-2026326917", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "48356e8a-1e09-4e20-a0e0-f257851bb733"}]}} Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-₡-2026326917', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '48356e8a-1e09-4e20-a0e0-f257851bb733'}]}}} Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:37:23.098809 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dcc067bb-74e9-4690-8262-59517346b1cf) Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:37:23.102760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:23.110694 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:23.110694 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:23.110694 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:37:23.110694 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:23.110694 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:23.110694 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:37:23.110694 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:37:23.110694 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:37:23.110694 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:37:23.110694 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:23.110694 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:23.110694 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:23.110694 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-453df6ff-7358-4d5b-bd6f-879dff735dfa tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:23.110694 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:37:23.110694 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-453df6ff-7358-4d5b-bd6f-879dff735dfa tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.576374 Oct 12 13:37:23.110694 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 990/1952] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:37:20 2022] POST /compute/v2.1/servers => generated 214 bytes in 2578 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:37:23.792150 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1c1bd39b-6f92-4e7e-b8be-d3fc3a998868 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1679446536", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:37:23.822151 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:37:23.846872 n-d-861076-2 devstack@n-api.service[120932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 13:37:23.846872 n-d-861076-2 devstack@n-api.service[120932]: Wed Oct 12 13:37:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 12 13:37:23.846872 n-d-861076-2 devstack@n-api.service[120932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 13:37:23.846872 n-d-861076-2 devstack@n-api.service[120932]: Wed Oct 12 13:37:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 12 13:37:23.986780 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-1c1bd39b-6f92-4e7e-b8be-d3fc3a998868 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] validate_networks() for [('48356e8a-1e09-4e20-a0e0-f257851bb733', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-1c1bd39b-6f92-4e7e-b8be-d3fc3a998868 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-45943dfa-fb9f-492c-ab0b-6bfc89962a5f) Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:37:24.879459 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-45943dfa-fb9f-492c-ab0b-6bfc89962a5f) Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-1c1bd39b-6f92-4e7e-b8be-d3fc3a998868 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1c1bd39b-6f92-4e7e-b8be-d3fc3a998868 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Request method failure captured: Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 230 Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsMQy6wPrsJ2kMtP3gJmDju4pVmBSBbRXnOQbKUxmmMq_DULE8U02caZM1VdHvG2b8jcYx-k5ZI3DmIOlhqeDzlpbT2Y4L_PmILtZyaJwuGhxnQGPje3QLflFTEmWHyYPVW0dC2qAX1Ysr0eodrLU0PbxO1mB-Uj9n7u6mGXjkVnPko Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 5b24a04b60dc41abb94f4696b281dfec Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServersTestJSON-2097061306 Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b24a04b60dc41abb94f4696b281dfec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b24a04b60dc41abb94f4696b281dfec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b24a04b60dc41abb94f4696b281dfec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b24a04b60dc41abb94f4696b281dfec"}]}] Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServersTestJSON-2097061306 Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 5b24a04b60dc41abb94f4696b281dfec Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServersTestJSON-2097061306 Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServersTestJSON-2097061306-project Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: a341a09e90ea46dbb8c6ffb1a8f7d3cc Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServersTestJSON-2097061306-project Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-ServersTestJSON-server-1679446536", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "testpassword", "networks": [{"uuid": "48356e8a-1e09-4e20-a0e0-f257851bb733"}]}} Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-1679446536', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'adminPass': 'testpassword', 'networks': [{'uuid': '48356e8a-1e09-4e20-a0e0-f257851bb733'}]}}} Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:37:24.883416 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:37:24.886534 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-45943dfa-fb9f-492c-ab0b-6bfc89962a5f) Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1c1bd39b-6f92-4e7e-b8be-d3fc3a998868 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1c1bd39b-6f92-4e7e-b8be-d3fc3a998868 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.089062 Oct 12 13:37:24.891451 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 963/1953] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:37:23 2022] POST /compute/v2.1/servers => generated 214 bytes in 1099 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:37:25.545112 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-27f3e2ce-ecc9-495c-8328-ab3fdce6ddd5 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1340189616", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "48356e8a-1e09-4e20-a0e0-f257851bb733"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:37:25.667779 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-27f3e2ce-ecc9-495c-8328-ab3fdce6ddd5 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] validate_networks() for [('48356e8a-1e09-4e20-a0e0-f257851bb733', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-27f3e2ce-ecc9-495c-8328-ab3fdce6ddd5 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d3b80fec-ce36-4d66-92e2-986b1e5af416) Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:37:27.919806 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:37:27.923824 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:37:27.923824 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:37:27.923824 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:37:27.923824 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:37:27.923824 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:37:27.923824 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:37:27.923824 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:37:27.923824 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:37:27.923824 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:37:27.923824 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:37:27.923824 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:37:27.923824 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:37:27.923824 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:37:27.923824 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:37:27.923824 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d3b80fec-ce36-4d66-92e2-986b1e5af416) Oct 12 13:37:27.923824 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:27.923824 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-27f3e2ce-ecc9-495c-8328-ab3fdce6ddd5 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:27.923824 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-27f3e2ce-ecc9-495c-8328-ab3fdce6ddd5 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Request method failure captured: Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 231 Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsMQy6wPrsJ2kMtP3gJmDju4pVmBSBbRXnOQbKUxmmMq_DULE8U02caZM1VdHvG2b8jcYx-k5ZI3DmIOlhqeDzlpbT2Y4L_PmILtZyaJwuGhxnQGPje3QLflFTEmWHyYPVW0dC2qAX1Ysr0eodrLU0PbxO1mB-Uj9n7u6mGXjkVnPko Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 5b24a04b60dc41abb94f4696b281dfec Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServersTestJSON-2097061306 Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b24a04b60dc41abb94f4696b281dfec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b24a04b60dc41abb94f4696b281dfec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b24a04b60dc41abb94f4696b281dfec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b24a04b60dc41abb94f4696b281dfec"}]}] Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServersTestJSON-2097061306 Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 5b24a04b60dc41abb94f4696b281dfec Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServersTestJSON-2097061306 Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServersTestJSON-2097061306-project Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: a341a09e90ea46dbb8c6ffb1a8f7d3cc Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServersTestJSON-2097061306-project Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-ServersTestJSON-server-1340189616", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "48356e8a-1e09-4e20-a0e0-f257851bb733"}]}} Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-1340189616', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '48356e8a-1e09-4e20-a0e0-f257851bb733'}]}}} Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:37:27.926165 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d3b80fec-ce36-4d66-92e2-986b1e5af416) Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:37:27.931516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:37:27.944104 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:27.944104 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:27.944104 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:27.944104 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:37:27.944104 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:27.944104 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:27.944104 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:37:27.944104 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:37:27.944104 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:37:27.944104 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:37:27.944104 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:27.944104 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:27.944104 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:27.944104 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-27f3e2ce-ecc9-495c-8328-ab3fdce6ddd5 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:27.944104 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:37:27.944104 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-27f3e2ce-ecc9-495c-8328-ab3fdce6ddd5 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.405839 Oct 12 13:37:27.945792 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7507cf4a-e2c2-4d02-84d2-566e32cc52ef tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Action: 'create', calling method: .version_select at 0x7f8aa3e00790>, body: {"keypair": {"name": "tempest-key-828014794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApOGeYEWjB7qvAXpSg5wbCqSCmK0dU9xVEo9gQT3ElWLjloDeMLk87OG93hhHh7PUBo4a7qyYYlPnyCOa/o13SKLym7bNDyc8ceQ+nLDHbKD16V/aYL6G3JPtW3FKDT0w=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:37:27.946230 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 991/1954] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:37:25 2022] POST /compute/v2.1/servers => generated 214 bytes in 2426 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:37:27.966997 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-7507cf4a-e2c2-4d02-84d2-566e32cc52ef tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Getting quotas for project 5b24a04b60dc41abb94f4696b281dfec. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:37:27.976211 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-7507cf4a-e2c2-4d02-84d2-566e32cc52ef tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Getting quotas for user a341a09e90ea46dbb8c6ffb1a8f7d3cc and project 5b24a04b60dc41abb94f4696b281dfec. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:37:28.108609 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7507cf4a-e2c2-4d02-84d2-566e32cc52ef tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.171928 Oct 12 13:37:28.110878 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 964/1955] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:37:27 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:37:28.129106 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8dd25f1e-07ae-4db2-ab2e-4eebaa7310b7 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Calling method '.version_select at 0x7f8a9bb78820>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:37:28.135432 n-d-861076-2 devstack@n-api.service[120933]: WARNING oslo_db.sqlalchemy.utils [None req-8dd25f1e-07ae-4db2-ab2e-4eebaa7310b7 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 13:37:28.155717 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-8dd25f1e-07ae-4db2-ab2e-4eebaa7310b7 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.031923 Oct 12 13:37:28.175186 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 992/1956] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Oct 12 13:37:28 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:37:28.672287 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a887eb8f-5ce3-4079-8ad8-57a6aef6003f tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1688953689", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "key_name": "tempest-key-828014794", "networks": [{"uuid": "48356e8a-1e09-4e20-a0e0-f257851bb733"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:37:28.763929 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-a887eb8f-5ce3-4079-8ad8-57a6aef6003f tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] validate_networks() for [('48356e8a-1e09-4e20-a0e0-f257851bb733', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-a887eb8f-5ce3-4079-8ad8-57a6aef6003f tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a3870f0c-0abc-4075-9970-660f848019ae) Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:37:29.487340 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a3870f0c-0abc-4075-9970-660f848019ae) Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-a887eb8f-5ce3-4079-8ad8-57a6aef6003f tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a887eb8f-5ce3-4079-8ad8-57a6aef6003f tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Request method failure captured: Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 238 Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsMQy6wPrsJ2kMtP3gJmDju4pVmBSBbRXnOQbKUxmmMq_DULE8U02caZM1VdHvG2b8jcYx-k5ZI3DmIOlhqeDzlpbT2Y4L_PmILtZyaJwuGhxnQGPje3QLflFTEmWHyYPVW0dC2qAX1Ysr0eodrLU0PbxO1mB-Uj9n7u6mGXjkVnPko Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 5b24a04b60dc41abb94f4696b281dfec Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServersTestJSON-2097061306 Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b24a04b60dc41abb94f4696b281dfec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b24a04b60dc41abb94f4696b281dfec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b24a04b60dc41abb94f4696b281dfec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b24a04b60dc41abb94f4696b281dfec"}]}] Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServersTestJSON-2097061306 Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 5b24a04b60dc41abb94f4696b281dfec Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServersTestJSON-2097061306 Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServersTestJSON-2097061306-project Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: a341a09e90ea46dbb8c6ffb1a8f7d3cc Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServersTestJSON-2097061306-project Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-ServersTestJSON-server-1688953689", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "key_name": "tempest-key-828014794", "networks": [{"uuid": "48356e8a-1e09-4e20-a0e0-f257851bb733"}]}} Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-1688953689', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'key_name': 'tempest-key-828014794', 'networks': [{'uuid': '48356e8a-1e09-4e20-a0e0-f257851bb733'}]}}} Oct 12 13:37:29.490806 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:37:29.494139 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a3870f0c-0abc-4075-9970-660f848019ae) Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a887eb8f-5ce3-4079-8ad8-57a6aef6003f tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a887eb8f-5ce3-4079-8ad8-57a6aef6003f tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.824059 Oct 12 13:37:29.500806 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 965/1957] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:37:28 2022] POST /compute/v2.1/servers => generated 214 bytes in 825 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:37:29.505941 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a2461fe4-3726-48a4-b4dc-d284cdb15178 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Calling method '.version_select at 0x7f8a9bb239d0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:37:29.627236 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a2461fe4-3726-48a4-b4dc-d284cdb15178 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-key-828014794" status: 202 len: 0 microversion: 2.1 time: 0.130499 Oct 12 13:37:29.627823 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 993/1958] 10.222.0.52 () {58 vars in 1206 bytes} [Wed Oct 12 13:37:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-828014794 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:37:30.166544 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3f776cc8-1c33-4fd8-9dff-ff2f7a0262f3 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1636343860", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "48356e8a-1e09-4e20-a0e0-f257851bb733"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:37:30.250514 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-3f776cc8-1c33-4fd8-9dff-ff2f7a0262f3 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] validate_networks() for [('48356e8a-1e09-4e20-a0e0-f257851bb733', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-3f776cc8-1c33-4fd8-9dff-ff2f7a0262f3 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-882651ca-9106-4e3d-9560-b31739813b26) Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:37:30.951783 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-882651ca-9106-4e3d-9560-b31739813b26) Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-3f776cc8-1c33-4fd8-9dff-ff2f7a0262f3 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3f776cc8-1c33-4fd8-9dff-ff2f7a0262f3 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Request method failure captured: Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 201 Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsMQy6wPrsJ2kMtP3gJmDju4pVmBSBbRXnOQbKUxmmMq_DULE8U02caZM1VdHvG2b8jcYx-k5ZI3DmIOlhqeDzlpbT2Y4L_PmILtZyaJwuGhxnQGPje3QLflFTEmWHyYPVW0dC2qAX1Ysr0eodrLU0PbxO1mB-Uj9n7u6mGXjkVnPko Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 5b24a04b60dc41abb94f4696b281dfec Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServersTestJSON-2097061306 Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b24a04b60dc41abb94f4696b281dfec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b24a04b60dc41abb94f4696b281dfec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b24a04b60dc41abb94f4696b281dfec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b24a04b60dc41abb94f4696b281dfec"}]}] Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServersTestJSON-2097061306 Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 5b24a04b60dc41abb94f4696b281dfec Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServersTestJSON-2097061306 Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServersTestJSON-2097061306-project Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: a341a09e90ea46dbb8c6ffb1a8f7d3cc Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServersTestJSON-2097061306-project Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-ServersTestJSON-server-1636343860", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "48356e8a-1e09-4e20-a0e0-f257851bb733"}]}} Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-1636343860', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '48356e8a-1e09-4e20-a0e0-f257851bb733'}]}}} Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:37:30.962980 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:37:30.966943 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-882651ca-9106-4e3d-9560-b31739813b26) Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3f776cc8-1c33-4fd8-9dff-ff2f7a0262f3 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3f776cc8-1c33-4fd8-9dff-ff2f7a0262f3 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.796282 Oct 12 13:37:30.974899 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 966/1959] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:37:30 2022] POST /compute/v2.1/servers => generated 214 bytes in 798 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:37:31.636567 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f2a99745-4b38-4b99-93bb-1433d02d9845 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1344081610", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "48356e8a-1e09-4e20-a0e0-f257851bb733"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:37:31.726721 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-f2a99745-4b38-4b99-93bb-1433d02d9845 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] validate_networks() for [('48356e8a-1e09-4e20-a0e0-f257851bb733', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-f2a99745-4b38-4b99-93bb-1433d02d9845 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-34a7d1dd-091a-4bf5-92b0-775d5f3f393b) Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:37:32.474830 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-34a7d1dd-091a-4bf5-92b0-775d5f3f393b) Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-f2a99745-4b38-4b99-93bb-1433d02d9845 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f2a99745-4b38-4b99-93bb-1433d02d9845 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Request method failure captured: Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 201 Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsMQy6wPrsJ2kMtP3gJmDju4pVmBSBbRXnOQbKUxmmMq_DULE8U02caZM1VdHvG2b8jcYx-k5ZI3DmIOlhqeDzlpbT2Y4L_PmILtZyaJwuGhxnQGPje3QLflFTEmWHyYPVW0dC2qAX1Ysr0eodrLU0PbxO1mB-Uj9n7u6mGXjkVnPko Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 5b24a04b60dc41abb94f4696b281dfec Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServersTestJSON-2097061306 Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b24a04b60dc41abb94f4696b281dfec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b24a04b60dc41abb94f4696b281dfec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b24a04b60dc41abb94f4696b281dfec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b24a04b60dc41abb94f4696b281dfec"}]}] Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServersTestJSON-2097061306 Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 5b24a04b60dc41abb94f4696b281dfec Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServersTestJSON-2097061306 Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServersTestJSON-2097061306-project Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: a341a09e90ea46dbb8c6ffb1a8f7d3cc Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServersTestJSON-2097061306-project Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-ServersTestJSON-server-1344081610", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "48356e8a-1e09-4e20-a0e0-f257851bb733"}]}} Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-1344081610', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '48356e8a-1e09-4e20-a0e0-f257851bb733'}]}}} Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:37:32.481760 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:37:32.497134 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-34a7d1dd-091a-4bf5-92b0-775d5f3f393b) Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f2a99745-4b38-4b99-93bb-1433d02d9845 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f2a99745-4b38-4b99-93bb-1433d02d9845 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.848594 Oct 12 13:37:32.503811 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 994/1960] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:37:31 2022] POST /compute/v2.1/servers => generated 214 bytes in 860 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:37:32.909383 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-047c32fd-fc17-4054-b4a3-f9e364f40e96 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-121176360", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "48356e8a-1e09-4e20-a0e0-f257851bb733"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:37:33.007319 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-047c32fd-fc17-4054-b4a3-f9e364f40e96 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] validate_networks() for [('48356e8a-1e09-4e20-a0e0-f257851bb733', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-047c32fd-fc17-4054-b4a3-f9e364f40e96 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0ec10662-6b28-44cf-a018-de4ffb515ba6) Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:37:33.724872 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:37:33.727902 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:37:33.727902 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:37:33.727902 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:37:33.727902 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:37:33.727902 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:37:33.727902 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:37:33.727902 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:37:33.727902 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:37:33.727902 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:37:33.727902 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:37:33.727902 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:37:33.727902 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:37:33.727902 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:37:33.727902 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:37:33.727902 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0ec10662-6b28-44cf-a018-de4ffb515ba6) Oct 12 13:37:33.727902 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:33.734915 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-047c32fd-fc17-4054-b4a3-f9e364f40e96 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:33.734915 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-047c32fd-fc17-4054-b4a3-f9e364f40e96 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Request method failure captured: Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 200 Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsMQy6wPrsJ2kMtP3gJmDju4pVmBSBbRXnOQbKUxmmMq_DULE8U02caZM1VdHvG2b8jcYx-k5ZI3DmIOlhqeDzlpbT2Y4L_PmILtZyaJwuGhxnQGPje3QLflFTEmWHyYPVW0dC2qAX1Ysr0eodrLU0PbxO1mB-Uj9n7u6mGXjkVnPko Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 5b24a04b60dc41abb94f4696b281dfec Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServersTestJSON-2097061306 Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b24a04b60dc41abb94f4696b281dfec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b24a04b60dc41abb94f4696b281dfec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b24a04b60dc41abb94f4696b281dfec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b24a04b60dc41abb94f4696b281dfec"}]}] Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServersTestJSON-2097061306 Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 5b24a04b60dc41abb94f4696b281dfec Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServersTestJSON-2097061306 Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServersTestJSON-2097061306-project Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: a341a09e90ea46dbb8c6ffb1a8f7d3cc Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServersTestJSON-2097061306-project Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-ServersTestJSON-server-121176360", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "48356e8a-1e09-4e20-a0e0-f257851bb733"}]}} Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-121176360', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '48356e8a-1e09-4e20-a0e0-f257851bb733'}]}}} Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:37:33.738493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0ec10662-6b28-44cf-a018-de4ffb515ba6) Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:37:33.743335 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:33.762502 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:33.762502 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:33.762502 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:37:33.762502 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:33.762502 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:37:33.762502 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:37:33.762502 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:37:33.762502 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:37:33.762502 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:37:33.762502 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:33.762502 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:33.762502 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:37:33.762502 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-047c32fd-fc17-4054-b4a3-f9e364f40e96 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:37:33.762502 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:37:33.762502 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-047c32fd-fc17-4054-b4a3-f9e364f40e96 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.853867 Oct 12 13:37:33.762502 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 967/1961] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:37:32 2022] POST /compute/v2.1/servers => generated 214 bytes in 856 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:38:00.013830 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f2a99745-4b38-4b99-93bb-1433d02d9845 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:38:00.015199 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f2a99745-4b38-4b99-93bb-1433d02d9845 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001785 Oct 12 13:38:00.015549 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 995/1962] 10.222.0.52 () {56 vars in 886 bytes} [Wed Oct 12 13:38:00 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 12 13:38:15.168737 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-047c32fd-fc17-4054-b4a3-f9e364f40e96 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:38:15.173333 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-047c32fd-fc17-4054-b4a3-f9e364f40e96 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002213 Oct 12 13:38:15.173333 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 968/1963] 10.222.0.52 () {56 vars in 886 bytes} [Wed Oct 12 13:38:15 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 12 13:38:15.181130 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f2a99745-4b38-4b99-93bb-1433d02d9845 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:38:15.183046 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f2a99745-4b38-4b99-93bb-1433d02d9845 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] 10.222.0.52 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002535 Oct 12 13:38:15.183644 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 996/1964] 10.222.0.52 () {54 vars in 1035 bytes} [Wed Oct 12 13:38:15 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 12 13:38:15.191712 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-047c32fd-fc17-4054-b4a3-f9e364f40e96 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:38:15.192686 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-047c32fd-fc17-4054-b4a3-f9e364f40e96 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 12 13:38:15.193422 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 969/1965] 10.222.0.52 () {54 vars in 1041 bytes} [Wed Oct 12 13:38:15 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:38:15.201957 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f2a99745-4b38-4b99-93bb-1433d02d9845 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:38:15.202922 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f2a99745-4b38-4b99-93bb-1433d02d9845 tempest-ServersTestJSON-2097061306 tempest-ServersTestJSON-2097061306-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001306 Oct 12 13:38:15.211014 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 997/1966] 10.222.0.52 () {56 vars in 886 bytes} [Wed Oct 12 13:38:15 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 12 13:38:34.555670 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:38:34.557352 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:38:34.947314 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b26466df-78e4-4bee-ae08-b8f9d2015185 tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] Action: 'create', calling method: .version_select at 0x7f8aa3dfb700>, body: {"keypair": {"name": "tempest-keypair-1006631319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkOyVIKGbW1wju5PZHL/ZGhsuhjnL/SxP0198oECZPCihQIwmGeh8oXnScMJCP3SsDIWx9nE85uqO4DqFik748P3W1GGu/+h5yEhIAqeKWkzOUzkjbvdcLeo5QtG0e18w=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:38:34.997562 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-b26466df-78e4-4bee-ae08-b8f9d2015185 tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] Getting quotas for project 34e41907be6e43f6bf1915da796b64de. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:38:35.016355 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-b26466df-78e4-4bee-ae08-b8f9d2015185 tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] Getting quotas for user 061547450d6d454d8a7036ce5e578c6c and project 34e41907be6e43f6bf1915da796b64de. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:38:35.142032 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b26466df-78e4-4bee-ae08-b8f9d2015185 tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.588979 Oct 12 13:38:35.143520 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 970/1967] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:38:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:38:37.404576 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:38:37.975106 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-726c4574-0015-47ba-b86b-19545fbc6724 tempest-PortsAdminExtendedAttrsTestJSON-669233497 tempest-PortsAdminExtendedAttrsTestJSON-669233497-project-admin] Calling method '.version_select at 0x7f8a9ba2d0d0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:38:37.977046 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-726c4574-0015-47ba-b86b-19545fbc6724 tempest-PortsAdminExtendedAttrsTestJSON-669233497 tempest-PortsAdminExtendedAttrsTestJSON-669233497-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:38:37.977739 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-726c4574-0015-47ba-b86b-19545fbc6724 tempest-PortsAdminExtendedAttrsTestJSON-669233497 tempest-PortsAdminExtendedAttrsTestJSON-669233497-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:38:37.978874 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-726c4574-0015-47ba-b86b-19545fbc6724 tempest-PortsAdminExtendedAttrsTestJSON-669233497 tempest-PortsAdminExtendedAttrsTestJSON-669233497-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:38:37.998224 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-726c4574-0015-47ba-b86b-19545fbc6724 tempest-PortsAdminExtendedAttrsTestJSON-669233497 tempest-PortsAdminExtendedAttrsTestJSON-669233497-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:38:37.999778 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-726c4574-0015-47ba-b86b-19545fbc6724 tempest-PortsAdminExtendedAttrsTestJSON-669233497 tempest-PortsAdminExtendedAttrsTestJSON-669233497-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:38:38.000386 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-726c4574-0015-47ba-b86b-19545fbc6724 tempest-PortsAdminExtendedAttrsTestJSON-669233497 tempest-PortsAdminExtendedAttrsTestJSON-669233497-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:38:38.016821 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-726c4574-0015-47ba-b86b-19545fbc6724 tempest-PortsAdminExtendedAttrsTestJSON-669233497 tempest-PortsAdminExtendedAttrsTestJSON-669233497-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:38:38.017534 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-726c4574-0015-47ba-b86b-19545fbc6724 tempest-PortsAdminExtendedAttrsTestJSON-669233497 tempest-PortsAdminExtendedAttrsTestJSON-669233497-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:38:38.022651 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-726c4574-0015-47ba-b86b-19545fbc6724 tempest-PortsAdminExtendedAttrsTestJSON-669233497 tempest-PortsAdminExtendedAttrsTestJSON-669233497-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:38:38.027437 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-726c4574-0015-47ba-b86b-19545fbc6724 tempest-PortsAdminExtendedAttrsTestJSON-669233497 tempest-PortsAdminExtendedAttrsTestJSON-669233497-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.623415 Oct 12 13:38:38.031033 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 998/1968] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:38:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:38:41.871040 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-605a3cfd-d842-4e5a-bae8-6c9cea17111e tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-994986067", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "44a6e9ec-1273-4790-b45a-b43585b9943c"}], "security_groups": [{"name": "tempest-securitygroup--874497810"}], "key_name": "tempest-keypair-1006631319", "user_data": "}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:38:42.046786 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-605a3cfd-d842-4e5a-bae8-6c9cea17111e tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] validate_networks() for [('44a6e9ec-1273-4790-b45a-b43585b9943c', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-605a3cfd-d842-4e5a-bae8-6c9cea17111e tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dd7a863e-86fa-4a74-95d4-4aa3b0c92461) Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:38:42.339250 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dd7a863e-86fa-4a74-95d4-4aa3b0c92461) Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-605a3cfd-d842-4e5a-bae8-6c9cea17111e tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-605a3cfd-d842-4e5a-bae8-6c9cea17111e tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] Request method failure captured: Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 484 Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsNak78Fdlaw9azK8xuW4XrSYv9BIZGskvuHW9zsoAKwBM0xKjwDhypk6WjYYYEFUWmJW6pAyhdKUzBSnakutd6s-zEwzX3tSPD8wvuGo5ES_TEX81E3dJhzQGIhKaTIaL-SFNJgyqB7eXbyVqcyXzbwvmnt-y8PLlWV_qNY4fYKt6c Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 34e41907be6e43f6bf1915da796b64de Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-AttachVolumeTestJSON-15037237 Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34e41907be6e43f6bf1915da796b64de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34e41907be6e43f6bf1915da796b64de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34e41907be6e43f6bf1915da796b64de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34e41907be6e43f6bf1915da796b64de"}]}] Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-AttachVolumeTestJSON-15037237 Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 34e41907be6e43f6bf1915da796b64de Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-AttachVolumeTestJSON-15037237 Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-AttachVolumeTestJSON-15037237-project Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 061547450d6d454d8a7036ce5e578c6c Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-AttachVolumeTestJSON-15037237-project Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-AttachVolumeTestJSON-server-994986067", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "44a6e9ec-1273-4790-b45a-b43585b9943c"}], "security_groups": [{"name": "tempest-securitygroup--874497810"}], "key_name": "tempest-keypair-1006631319", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:38:42.342622 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeTestJSON-server-994986067', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': '44a6e9ec-1273-4790-b45a-b43585b9943c'}], 'security_groups': [{'name': 'tempest-securitygroup--874497810'}], 'key_name': 'tempest-keypair-1006631319', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:38:42.347090 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dd7a863e-86fa-4a74-95d4-4aa3b0c92461) Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-605a3cfd-d842-4e5a-bae8-6c9cea17111e tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-605a3cfd-d842-4e5a-bae8-6c9cea17111e tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.477941 Oct 12 13:38:42.357377 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 971/1969] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:38:41 2022] POST /compute/v2.1/servers => generated 214 bytes in 488 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:38:42.367843 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fc3707a2-6285-4a78-893b-fcf9ddf3cca5 tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] Calling method '.version_select at 0x7f8a9baf2f70>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:38:42.481143 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fc3707a2-6285-4a78-893b-fcf9ddf3cca5 tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006631319" status: 202 len: 0 microversion: 2.1 time: 0.125130 Oct 12 13:38:42.482165 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 999/1970] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 12 13:38:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006631319 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 13:38:44.370754 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ef62eca6-e53d-4e34-88d0-7a9d658d6868 tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] Action: 'create', calling method: .version_select at 0x7f8aa3df6a60>, body: {"keypair": {"name": "tempest-keypair-1565969202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEF+5ogrACX2hb0/wN995IGKTsCjHNx4HxG3DanCvx//gNcTtCss2eTjC0aFQokJrFb/PZdwz/THHAN95+qB8oFe0oCxRQhIyIeP5SfjYT0Ja/4Yxia708C2ZrHOH2fXA=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:38:44.430702 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-ef62eca6-e53d-4e34-88d0-7a9d658d6868 tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] Getting quotas for project 34e41907be6e43f6bf1915da796b64de. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:38:44.470228 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-ef62eca6-e53d-4e34-88d0-7a9d658d6868 tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] Getting quotas for user 061547450d6d454d8a7036ce5e578c6c and project 34e41907be6e43f6bf1915da796b64de. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:38:44.597630 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ef62eca6-e53d-4e34-88d0-7a9d658d6868 tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.230796 Oct 12 13:38:44.598236 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 972/1971] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:38:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:38:53.314838 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=6 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:38:53.315720 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:38:53.322956 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4bcfadd1-ab39-4f23-aa4d-ca31c6f56f84 tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2120154252", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "44a6e9ec-1273-4790-b45a-b43585b9943c"}], "security_groups": [{"name": "tempest-securitygroup--496269095"}], "key_name": "tempest-keypair-1565969202", "user_data": "}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:38:54.207724 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-4bcfadd1-ab39-4f23-aa4d-ca31c6f56f84 tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] validate_networks() for [('44a6e9ec-1273-4790-b45a-b43585b9943c', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-4bcfadd1-ab39-4f23-aa4d-ca31c6f56f84 tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f537d0a1-16a5-4813-9f92-7a3fe80913b3) Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:38:55.344677 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:38:55.350695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:38:55.350695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:38:55.350695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:38:55.350695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:38:55.350695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:38:55.350695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:38:55.350695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:38:55.350695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:38:55.350695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:38:55.350695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:38:55.350695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:38:55.350695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:38:55.350695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:38:55.350695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:38:55.350695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f537d0a1-16a5-4813-9f92-7a3fe80913b3) Oct 12 13:38:55.350695 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:38:55.350695 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-4bcfadd1-ab39-4f23-aa4d-ca31c6f56f84 tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:38:55.350695 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4bcfadd1-ab39-4f23-aa4d-ca31c6f56f84 tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] Request method failure captured: Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 485 Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsNak78Fdlaw9azK8xuW4XrSYv9BIZGskvuHW9zsoAKwBM0xKjwDhypk6WjYYYEFUWmJW6pAyhdKUzBSnakutd6s-zEwzX3tSPD8wvuGo5ES_TEX81E3dJhzQGIhKaTIaL-SFNJgyqB7eXbyVqcyXzbwvmnt-y8PLlWV_qNY4fYKt6c Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 34e41907be6e43f6bf1915da796b64de Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-AttachVolumeTestJSON-15037237 Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34e41907be6e43f6bf1915da796b64de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34e41907be6e43f6bf1915da796b64de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34e41907be6e43f6bf1915da796b64de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34e41907be6e43f6bf1915da796b64de"}]}] Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-AttachVolumeTestJSON-15037237 Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 34e41907be6e43f6bf1915da796b64de Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-AttachVolumeTestJSON-15037237 Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-AttachVolumeTestJSON-15037237-project Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 061547450d6d454d8a7036ce5e578c6c Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-AttachVolumeTestJSON-15037237-project Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2120154252", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "44a6e9ec-1273-4790-b45a-b43585b9943c"}], "security_groups": [{"name": "tempest-securitygroup--496269095"}], "key_name": "tempest-keypair-1565969202", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeTestJSON-server-2120154252', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': '44a6e9ec-1273-4790-b45a-b43585b9943c'}], 'security_groups': [{'name': 'tempest-securitygroup--496269095'}], 'key_name': 'tempest-keypair-1565969202', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:38:55.352732 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f537d0a1-16a5-4813-9f92-7a3fe80913b3) Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:38:55.358171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:38:55.368827 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:38:55.368827 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:38:55.368827 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:38:55.368827 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:38:55.368827 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:38:55.368827 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:38:55.368827 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:38:55.368827 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:38:55.368827 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:38:55.368827 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:38:55.368827 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:38:55.368827 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:38:55.368827 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:38:55.368827 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:38:55.368827 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:38:55.368827 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:38:55.368827 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:38:55.368827 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:38:55.368827 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4bcfadd1-ab39-4f23-aa4d-ca31c6f56f84 tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:38:55.368827 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:38:55.368827 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4bcfadd1-ab39-4f23-aa4d-ca31c6f56f84 tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.050122 Oct 12 13:38:55.372739 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7158c24e-af20-4c8e-8e76-1489f5c0b716 tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] Calling method '.version_select at 0x7f8a9be264c0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:38:55.380239 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1000/1972] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:38:53 2022] POST /compute/v2.1/servers => generated 214 bytes in 2065 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:38:55.380711 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=8 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:38:55.381537 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:38:55.515366 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7158c24e-af20-4c8e-8e76-1489f5c0b716 tempest-AttachVolumeTestJSON-15037237 tempest-AttachVolumeTestJSON-15037237-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1565969202" status: 202 len: 0 microversion: 2.1 time: 0.146530 Oct 12 13:38:55.515968 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 973/1973] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 12 13:38:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1565969202 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:38:57.053230 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-eb465543-8def-4865-91e8-45ce5985132e tempest-VolumesActionsTest-567831947 tempest-VolumesActionsTest-567831947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1536173810", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "4bfd9b69-d4a8-4be8-8259-afa5587a5cb7"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:38:57.139119 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-eb465543-8def-4865-91e8-45ce5985132e tempest-VolumesActionsTest-567831947 tempest-VolumesActionsTest-567831947-project] validate_networks() for [('4bfd9b69-d4a8-4be8-8259-afa5587a5cb7', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-eb465543-8def-4865-91e8-45ce5985132e tempest-VolumesActionsTest-567831947 tempest-VolumesActionsTest-567831947-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5ba6de83-acaf-484e-9bc4-36a2ef1fd01e) Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:38:58.719061 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5ba6de83-acaf-484e-9bc4-36a2ef1fd01e) Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-eb465543-8def-4865-91e8-45ce5985132e tempest-VolumesActionsTest-567831947 tempest-VolumesActionsTest-567831947-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-eb465543-8def-4865-91e8-45ce5985132e tempest-VolumesActionsTest-567831947 tempest-VolumesActionsTest-567831947-project] Request method failure captured: Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 206 Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsNsztIG6Nz9Cw9tnrsCMQuXBU7A4qbzaMm-bAyWTxTSCNi6kcqpYF1R-A8Koe0QBOI-EpBS53xXwKtivH7BDK0Clhw-NcdD8ntvTJEOLqF4IUmIgTYAk4uYq2xRbR4-4gJztNCJqsLs-d7ZUdp6yYvvhUut34Zmc2vo9hcx6lVgGUI Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 02ea94e70ad546f492cddaf0a92d9ace Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-VolumesActionsTest-567831947 Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/02ea94e70ad546f492cddaf0a92d9ace"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_02ea94e70ad546f492cddaf0a92d9ace"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/02ea94e70ad546f492cddaf0a92d9ace"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/02ea94e70ad546f492cddaf0a92d9ace"}]}] Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-VolumesActionsTest-567831947 Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 02ea94e70ad546f492cddaf0a92d9ace Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-VolumesActionsTest-567831947 Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-VolumesActionsTest-567831947-project Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 162c9bd0ae0e4ea18a7bbeedf6dc6e8f Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-VolumesActionsTest-567831947-project Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-VolumesActionsTest-instance-1536173810", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "4bfd9b69-d4a8-4be8-8259-afa5587a5cb7"}]}} Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-VolumesActionsTest-instance-1536173810', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '4bfd9b69-d4a8-4be8-8259-afa5587a5cb7'}]}}} Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:38:58.725503 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:38:58.734678 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5ba6de83-acaf-484e-9bc4-36a2ef1fd01e) Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-eb465543-8def-4865-91e8-45ce5985132e tempest-VolumesActionsTest-567831947 tempest-VolumesActionsTest-567831947-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-eb465543-8def-4865-91e8-45ce5985132e tempest-VolumesActionsTest-567831947 tempest-VolumesActionsTest-567831947-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.001316 Oct 12 13:38:58.749648 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1001/1974] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:38:56 2022] POST /compute/v2.1/servers => generated 214 bytes in 2004 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:40:28.348731 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fc867b51-4095-4783-ba15-c5f475ef3ed0 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-267242819", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:40:28.396295 n-d-861076-2 devstack@n-api.service[120932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 13:40:28.396492 n-d-861076-2 devstack@n-api.service[120932]: Wed Oct 12 13:40:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 12 13:40:28.413260 n-d-861076-2 devstack@n-api.service[120932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 13:40:28.413404 n-d-861076-2 devstack@n-api.service[120932]: Wed Oct 12 13:40:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 12 13:40:28.593241 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-fc867b51-4095-4783-ba15-c5f475ef3ed0 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] validate_networks() for None {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:40:29.489927 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-fc867b51-4095-4783-ba15-c5f475ef3ed0 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:40:29.499973 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-fc867b51-4095-4783-ba15-c5f475ef3ed0 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:40:29.501343 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-fc867b51-4095-4783-ba15-c5f475ef3ed0 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:40:29.501978 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-fc867b51-4095-4783-ba15-c5f475ef3ed0 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:40:29.502606 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-fc867b51-4095-4783-ba15-c5f475ef3ed0 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:40:29.528965 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc867b51-4095-4783-ba15-c5f475ef3ed0 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:29.535684 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc867b51-4095-4783-ba15-c5f475ef3ed0 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:29.536254 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc867b51-4095-4783-ba15-c5f475ef3ed0 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:29.537147 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc867b51-4095-4783-ba15-c5f475ef3ed0 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:29.537619 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc867b51-4095-4783-ba15-c5f475ef3ed0 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:29.545539 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc867b51-4095-4783-ba15-c5f475ef3ed0 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:29.616673 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-fc867b51-4095-4783-ba15-c5f475ef3ed0 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Getting quotas for project 5718f8b72bec46ce9a25b15f44f6a0c5. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:40:29.637277 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-fc867b51-4095-4783-ba15-c5f475ef3ed0 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Getting quotas for user e3ae27e6bf3a44f2933a34d40923a2df and project 5718f8b72bec46ce9a25b15f44f6a0c5. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:40:29.711513 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fc867b51-4095-4783-ba15-c5f475ef3ed0 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:40:29.715684 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fc867b51-4095-4783-ba15-c5f475ef3ed0 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:40:29.958641 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fc867b51-4095-4783-ba15-c5f475ef3ed0 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.608080 Oct 12 13:40:29.962170 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 974/1975] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:40:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 13:40:29.965326 n-d-861076-2 devstack@n-api.service[120933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 13:40:29.966068 n-d-861076-2 devstack@n-api.service[120933]: Wed Oct 12 13:40:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 (ip 10.222.0.52) !!! Oct 12 13:40:29.969012 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=6 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:40:29.971273 n-d-861076-2 devstack@n-api.service[120933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 13:40:29.971562 n-d-861076-2 devstack@n-api.service[120933]: Wed Oct 12 13:40:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 (ip 10.222.0.52) !!! Oct 12 13:40:29.982052 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b95fa725-b451-47c6-8151-bc81e6a9e438 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:40:29.998325 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-b95fa725-b451-47c6-8151-bc81e6a9e438 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:40:30.616350 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-b95fa725-b451-47c6-8151-bc81e6a9e438 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae27e6bf3a44f2933a34d40923a2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5718f8b72bec46ce9a25b15f44f6a0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:40:30.624828 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b95fa725-b451-47c6-8151-bc81e6a9e438 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] 10.222.0.52 "GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6" status: 200 len: 1214 microversion: 2.1 time: 0.661395 Oct 12 13:40:30.643094 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1002/1976] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:40:29 2022] GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 => generated 1214 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:40:31.661578 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d415044e-3b85-4010-9c59-28a071bde097 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:40:31.662216 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d415044e-3b85-4010-9c59-28a071bde097 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:40:31.840314 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d415044e-3b85-4010-9c59-28a071bde097 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae27e6bf3a44f2933a34d40923a2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5718f8b72bec46ce9a25b15f44f6a0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:40:31.851242 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d415044e-3b85-4010-9c59-28a071bde097 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] 10.222.0.52 "GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6" status: 200 len: 1214 microversion: 2.1 time: 0.199826 Oct 12 13:40:31.854472 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 975/1977] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:40:31 2022] GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 => generated 1214 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:40:32.878517 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0fbcfd56-495d-491e-a50c-0b220206ccf4 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:40:32.880488 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-0fbcfd56-495d-491e-a50c-0b220206ccf4 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:40:32.894884 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0fbcfd56-495d-491e-a50c-0b220206ccf4 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:32.896663 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0fbcfd56-495d-491e-a50c-0b220206ccf4 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:32.897161 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0fbcfd56-495d-491e-a50c-0b220206ccf4 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:32.897896 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0fbcfd56-495d-491e-a50c-0b220206ccf4 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:32.898360 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0fbcfd56-495d-491e-a50c-0b220206ccf4 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:32.898787 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-0fbcfd56-495d-491e-a50c-0b220206ccf4 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:33.012558 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-0fbcfd56-495d-491e-a50c-0b220206ccf4 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae27e6bf3a44f2933a34d40923a2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5718f8b72bec46ce9a25b15f44f6a0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:40:33.020528 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0fbcfd56-495d-491e-a50c-0b220206ccf4 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] 10.222.0.52 "GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6" status: 200 len: 1218 microversion: 2.1 time: 0.145829 Oct 12 13:40:33.025691 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1003/1978] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:40:32 2022] GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 => generated 1218 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:40:34.048074 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b02639c8-cc3f-44cf-ab92-c3a8799c4a44 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:40:34.052175 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b02639c8-cc3f-44cf-ab92-c3a8799c4a44 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:40:34.075690 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b02639c8-cc3f-44cf-ab92-c3a8799c4a44 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:34.076445 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b02639c8-cc3f-44cf-ab92-c3a8799c4a44 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:34.080019 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b02639c8-cc3f-44cf-ab92-c3a8799c4a44 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:34.081100 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b02639c8-cc3f-44cf-ab92-c3a8799c4a44 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:34.082863 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b02639c8-cc3f-44cf-ab92-c3a8799c4a44 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:34.084351 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b02639c8-cc3f-44cf-ab92-c3a8799c4a44 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:34.651102 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-b02639c8-cc3f-44cf-ab92-c3a8799c4a44 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae27e6bf3a44f2933a34d40923a2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5718f8b72bec46ce9a25b15f44f6a0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:40:34.680239 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b02639c8-cc3f-44cf-ab92-c3a8799c4a44 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] 10.222.0.52 "GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6" status: 200 len: 1274 microversion: 2.1 time: 0.630352 Oct 12 13:40:34.692936 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 976/1979] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:40:34 2022] GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 => generated 1274 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:40:35.709292 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-3301b4b7-9d8e-444b-9bbc-e66340af96ee tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:40:35.709979 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-3301b4b7-9d8e-444b-9bbc-e66340af96ee tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:40:35.732118 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3301b4b7-9d8e-444b-9bbc-e66340af96ee tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:35.732627 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3301b4b7-9d8e-444b-9bbc-e66340af96ee tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:35.737468 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3301b4b7-9d8e-444b-9bbc-e66340af96ee tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:35.740681 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3301b4b7-9d8e-444b-9bbc-e66340af96ee tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:35.748607 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3301b4b7-9d8e-444b-9bbc-e66340af96ee tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:35.749135 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-3301b4b7-9d8e-444b-9bbc-e66340af96ee tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:36.001736 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-3301b4b7-9d8e-444b-9bbc-e66340af96ee tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae27e6bf3a44f2933a34d40923a2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5718f8b72bec46ce9a25b15f44f6a0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:40:36.041071 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-3301b4b7-9d8e-444b-9bbc-e66340af96ee tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] 10.222.0.52 "GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6" status: 200 len: 1272 microversion: 2.1 time: 0.335792 Oct 12 13:40:36.042554 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1004/1980] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:40:35 2022] GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 => generated 1272 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:40:37.070485 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e2b35d7e-7f46-45d7-a339-7dc8b2d39808 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:40:37.071964 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e2b35d7e-7f46-45d7-a339-7dc8b2d39808 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:40:37.097105 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2b35d7e-7f46-45d7-a339-7dc8b2d39808 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:37.097795 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2b35d7e-7f46-45d7-a339-7dc8b2d39808 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:37.105437 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2b35d7e-7f46-45d7-a339-7dc8b2d39808 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:37.106147 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2b35d7e-7f46-45d7-a339-7dc8b2d39808 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:37.109156 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2b35d7e-7f46-45d7-a339-7dc8b2d39808 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:37.109594 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2b35d7e-7f46-45d7-a339-7dc8b2d39808 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:37.553029 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-e2b35d7e-7f46-45d7-a339-7dc8b2d39808 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae27e6bf3a44f2933a34d40923a2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5718f8b72bec46ce9a25b15f44f6a0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:40:37.568569 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e2b35d7e-7f46-45d7-a339-7dc8b2d39808 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] 10.222.0.52 "GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6" status: 200 len: 1314 microversion: 2.1 time: 0.503282 Oct 12 13:40:37.571527 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 977/1981] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:40:37 2022] GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:40:38.600331 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-40bfb444-6171-470f-abad-61efcbbf40f9 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:40:38.600331 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-40bfb444-6171-470f-abad-61efcbbf40f9 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:40:38.617066 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-40bfb444-6171-470f-abad-61efcbbf40f9 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:38.641083 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-40bfb444-6171-470f-abad-61efcbbf40f9 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:38.641912 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-40bfb444-6171-470f-abad-61efcbbf40f9 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:38.642908 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-40bfb444-6171-470f-abad-61efcbbf40f9 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:38.643620 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-40bfb444-6171-470f-abad-61efcbbf40f9 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:38.644860 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-40bfb444-6171-470f-abad-61efcbbf40f9 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:39.001067 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-40bfb444-6171-470f-abad-61efcbbf40f9 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae27e6bf3a44f2933a34d40923a2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5718f8b72bec46ce9a25b15f44f6a0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:40:39.018084 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-40bfb444-6171-470f-abad-61efcbbf40f9 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] 10.222.0.52 "GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6" status: 200 len: 1314 microversion: 2.1 time: 0.424685 Oct 12 13:40:39.029420 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1005/1982] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:40:38 2022] GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:40:40.044838 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-962f184e-225c-471a-8765-fd1d0704e35c tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:40:40.046683 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-962f184e-225c-471a-8765-fd1d0704e35c tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:40:40.050085 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:40:40.068168 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-962f184e-225c-471a-8765-fd1d0704e35c tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:40.068732 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-962f184e-225c-471a-8765-fd1d0704e35c tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:40.082102 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-962f184e-225c-471a-8765-fd1d0704e35c tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:40.083004 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-962f184e-225c-471a-8765-fd1d0704e35c tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:40.083505 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-962f184e-225c-471a-8765-fd1d0704e35c tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:40.092038 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-962f184e-225c-471a-8765-fd1d0704e35c tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:41.724630 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-962f184e-225c-471a-8765-fd1d0704e35c tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae27e6bf3a44f2933a34d40923a2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5718f8b72bec46ce9a25b15f44f6a0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:40:41.733389 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-962f184e-225c-471a-8765-fd1d0704e35c tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] 10.222.0.52 "GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6" status: 200 len: 1314 microversion: 2.1 time: 1.693533 Oct 12 13:40:41.745306 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 978/1983] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:40:40 2022] GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 => generated 1314 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:40:42.204588 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:40:42.618227 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-829a1815-1dd0-4682-ba33-70488487283d req-8f424e71-ac2d-4ff5-85b3-dbc20bde6e44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83ecb98-4d20-429a-8b55-98496a10dbe6", "tag": "eba90c7d-6513-461d-96dc-31db34d4ac3c"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:40:42.643695 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-829a1815-1dd0-4682-ba33-70488487283d req-8f424e71-ac2d-4ff5-85b3-dbc20bde6e44 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:42.645651 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-829a1815-1dd0-4682-ba33-70488487283d req-8f424e71-ac2d-4ff5-85b3-dbc20bde6e44 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:42.648598 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-829a1815-1dd0-4682-ba33-70488487283d req-8f424e71-ac2d-4ff5-85b3-dbc20bde6e44 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:42.697882 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-829a1815-1dd0-4682-ba33-70488487283d req-8f424e71-ac2d-4ff5-85b3-dbc20bde6e44 service nova] Creating event network-changed:eba90c7d-6513-461d-96dc-31db34d4ac3c for instance b83ecb98-4d20-429a-8b55-98496a10dbe6 on n-h1-861076-2 Oct 12 13:40:42.720238 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-829a1815-1dd0-4682-ba33-70488487283d req-8f424e71-ac2d-4ff5-85b3-dbc20bde6e44 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.520187 Oct 12 13:40:42.724474 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1006/1984] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:40:42.765598 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f81576bd-2220-4b8d-98eb-d3c1cb23cfe5 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:40:42.766542 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f81576bd-2220-4b8d-98eb-d3c1cb23cfe5 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:40:42.773331 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=8 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:40:42.781225 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f81576bd-2220-4b8d-98eb-d3c1cb23cfe5 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:42.781722 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f81576bd-2220-4b8d-98eb-d3c1cb23cfe5 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:42.783886 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f81576bd-2220-4b8d-98eb-d3c1cb23cfe5 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:42.784600 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f81576bd-2220-4b8d-98eb-d3c1cb23cfe5 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:42.795449 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f81576bd-2220-4b8d-98eb-d3c1cb23cfe5 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:42.796269 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f81576bd-2220-4b8d-98eb-d3c1cb23cfe5 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:43.240862 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f81576bd-2220-4b8d-98eb-d3c1cb23cfe5 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae27e6bf3a44f2933a34d40923a2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5718f8b72bec46ce9a25b15f44f6a0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:40:43.243887 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f81576bd-2220-4b8d-98eb-d3c1cb23cfe5 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] 10.222.0.52 "GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6" status: 200 len: 1314 microversion: 2.1 time: 0.483836 Oct 12 13:40:43.248122 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 979/1985] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:40:42 2022] GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:40:44.276206 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a429fe44-9050-4234-805d-16e3401426ea tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:40:44.276973 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a429fe44-9050-4234-805d-16e3401426ea tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:40:44.295425 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a429fe44-9050-4234-805d-16e3401426ea tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:44.296544 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a429fe44-9050-4234-805d-16e3401426ea tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:44.299876 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a429fe44-9050-4234-805d-16e3401426ea tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:44.301338 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a429fe44-9050-4234-805d-16e3401426ea tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:44.301985 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a429fe44-9050-4234-805d-16e3401426ea tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:44.303132 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a429fe44-9050-4234-805d-16e3401426ea tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:44.892737 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a429fe44-9050-4234-805d-16e3401426ea tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae27e6bf3a44f2933a34d40923a2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5718f8b72bec46ce9a25b15f44f6a0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:40:44.915458 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a429fe44-9050-4234-805d-16e3401426ea tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] 10.222.0.52 "GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6" status: 200 len: 1314 microversion: 2.1 time: 0.642532 Oct 12 13:40:44.947819 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1007/1986] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:40:44 2022] GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 => generated 1314 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:40:45.976867 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ff6100a4-612b-4a62-a50e-ef61d371e4fd tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:40:45.977633 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ff6100a4-612b-4a62-a50e-ef61d371e4fd tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:40:45.997846 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff6100a4-612b-4a62-a50e-ef61d371e4fd tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:45.998436 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff6100a4-612b-4a62-a50e-ef61d371e4fd tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:45.998774 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff6100a4-612b-4a62-a50e-ef61d371e4fd tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:45.999488 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff6100a4-612b-4a62-a50e-ef61d371e4fd tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:45.999938 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff6100a4-612b-4a62-a50e-ef61d371e4fd tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:46.000359 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff6100a4-612b-4a62-a50e-ef61d371e4fd tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:47.182733 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-ff6100a4-612b-4a62-a50e-ef61d371e4fd tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae27e6bf3a44f2933a34d40923a2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5718f8b72bec46ce9a25b15f44f6a0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:40:47.195504 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ff6100a4-612b-4a62-a50e-ef61d371e4fd tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] 10.222.0.52 "GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6" status: 200 len: 1314 microversion: 2.1 time: 1.223368 Oct 12 13:40:47.197068 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 980/1987] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:40:45 2022] GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 => generated 1314 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:40:48.224146 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c6a50518-b2c1-4cdb-a689-2e7e23ab3870 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:40:48.225792 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c6a50518-b2c1-4cdb-a689-2e7e23ab3870 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:40:48.246029 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c6a50518-b2c1-4cdb-a689-2e7e23ab3870 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:48.247130 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c6a50518-b2c1-4cdb-a689-2e7e23ab3870 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:48.247740 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c6a50518-b2c1-4cdb-a689-2e7e23ab3870 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:48.250003 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c6a50518-b2c1-4cdb-a689-2e7e23ab3870 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:48.252166 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c6a50518-b2c1-4cdb-a689-2e7e23ab3870 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:48.252765 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c6a50518-b2c1-4cdb-a689-2e7e23ab3870 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:48.878221 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-c6a50518-b2c1-4cdb-a689-2e7e23ab3870 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae27e6bf3a44f2933a34d40923a2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5718f8b72bec46ce9a25b15f44f6a0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:40:48.891554 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c6a50518-b2c1-4cdb-a689-2e7e23ab3870 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] 10.222.0.52 "GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6" status: 200 len: 1314 microversion: 2.1 time: 0.672564 Oct 12 13:40:48.903828 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1008/1988] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:40:48 2022] GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 => generated 1314 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:40:49.945589 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f1ad061c-d024-4efa-8fdb-d01b90e8e989 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:40:49.947033 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f1ad061c-d024-4efa-8fdb-d01b90e8e989 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:40:49.973216 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1ad061c-d024-4efa-8fdb-d01b90e8e989 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:49.973950 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1ad061c-d024-4efa-8fdb-d01b90e8e989 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:49.977607 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1ad061c-d024-4efa-8fdb-d01b90e8e989 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:49.981397 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1ad061c-d024-4efa-8fdb-d01b90e8e989 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:49.983246 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1ad061c-d024-4efa-8fdb-d01b90e8e989 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:49.983750 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1ad061c-d024-4efa-8fdb-d01b90e8e989 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:50.505531 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f1ad061c-d024-4efa-8fdb-d01b90e8e989 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae27e6bf3a44f2933a34d40923a2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5718f8b72bec46ce9a25b15f44f6a0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:40:50.515013 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f1ad061c-d024-4efa-8fdb-d01b90e8e989 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] 10.222.0.52 "GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6" status: 200 len: 1314 microversion: 2.1 time: 0.592207 Oct 12 13:40:50.536685 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 981/1989] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:40:49 2022] GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 => generated 1314 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:40:51.576277 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d2ed061f-07ad-406b-826a-7e4033b3a19a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:40:51.576277 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-d2ed061f-07ad-406b-826a-7e4033b3a19a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:40:51.581363 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d2ed061f-07ad-406b-826a-7e4033b3a19a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:51.582243 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d2ed061f-07ad-406b-826a-7e4033b3a19a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:51.582643 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d2ed061f-07ad-406b-826a-7e4033b3a19a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:51.583605 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d2ed061f-07ad-406b-826a-7e4033b3a19a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:51.584465 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d2ed061f-07ad-406b-826a-7e4033b3a19a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:51.585125 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d2ed061f-07ad-406b-826a-7e4033b3a19a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:53.736667 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d2ed061f-07ad-406b-826a-7e4033b3a19a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae27e6bf3a44f2933a34d40923a2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5718f8b72bec46ce9a25b15f44f6a0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:40:53.746190 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d2ed061f-07ad-406b-826a-7e4033b3a19a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] 10.222.0.52 "GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6" status: 200 len: 1314 microversion: 2.1 time: 2.191486 Oct 12 13:40:53.750770 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1009/1990] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:40:51 2022] GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 => generated 1314 bytes in 2197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:40:53.987779 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-d1914634-88f1-4cdc-bbc4-dd874daf7d24 req-a318b6f0-dff8-492d-ab37-efa86833628a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83ecb98-4d20-429a-8b55-98496a10dbe6", "name": "network-vif-plugged", "status": "completed", "tag": "eba90c7d-6513-461d-96dc-31db34d4ac3c"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:40:54.025759 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-d1914634-88f1-4cdc-bbc4-dd874daf7d24 req-a318b6f0-dff8-492d-ab37-efa86833628a service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:54.029245 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-d1914634-88f1-4cdc-bbc4-dd874daf7d24 req-a318b6f0-dff8-492d-ab37-efa86833628a service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:54.029780 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-d1914634-88f1-4cdc-bbc4-dd874daf7d24 req-a318b6f0-dff8-492d-ab37-efa86833628a service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:54.077720 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-d1914634-88f1-4cdc-bbc4-dd874daf7d24 req-a318b6f0-dff8-492d-ab37-efa86833628a service nova] Creating event network-vif-plugged:eba90c7d-6513-461d-96dc-31db34d4ac3c for instance b83ecb98-4d20-429a-8b55-98496a10dbe6 on n-h1-861076-2 Oct 12 13:40:54.103088 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-d1914634-88f1-4cdc-bbc4-dd874daf7d24 req-a318b6f0-dff8-492d-ab37-efa86833628a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281809 Oct 12 13:40:54.107776 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 982/1991] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:40:54.772169 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8f1cc2f3-c53e-423d-8724-bac51ed85404 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:40:54.774032 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-8f1cc2f3-c53e-423d-8724-bac51ed85404 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:40:54.792791 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8f1cc2f3-c53e-423d-8724-bac51ed85404 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:54.797066 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8f1cc2f3-c53e-423d-8724-bac51ed85404 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:54.799758 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8f1cc2f3-c53e-423d-8724-bac51ed85404 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:54.803504 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8f1cc2f3-c53e-423d-8724-bac51ed85404 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:54.806602 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8f1cc2f3-c53e-423d-8724-bac51ed85404 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:54.809162 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-8f1cc2f3-c53e-423d-8724-bac51ed85404 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:55.335954 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-8f1cc2f3-c53e-423d-8724-bac51ed85404 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae27e6bf3a44f2933a34d40923a2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5718f8b72bec46ce9a25b15f44f6a0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:40:55.370860 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-8f1cc2f3-c53e-423d-8724-bac51ed85404 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] 10.222.0.52 "GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6" status: 200 len: 1314 microversion: 2.1 time: 0.602686 Oct 12 13:40:55.371473 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1010/1992] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:40:54 2022] GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:40:56.416668 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1341543e-0f96-454c-a237-f45f2809dcc3 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:40:56.418240 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1341543e-0f96-454c-a237-f45f2809dcc3 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:40:56.431097 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1341543e-0f96-454c-a237-f45f2809dcc3 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:56.433165 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1341543e-0f96-454c-a237-f45f2809dcc3 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:56.433759 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1341543e-0f96-454c-a237-f45f2809dcc3 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:56.436475 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1341543e-0f96-454c-a237-f45f2809dcc3 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:56.437145 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1341543e-0f96-454c-a237-f45f2809dcc3 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:56.438557 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1341543e-0f96-454c-a237-f45f2809dcc3 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:56.956014 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-1341543e-0f96-454c-a237-f45f2809dcc3 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae27e6bf3a44f2933a34d40923a2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5718f8b72bec46ce9a25b15f44f6a0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:40:56.981904 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1341543e-0f96-454c-a237-f45f2809dcc3 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] 10.222.0.52 "GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6" status: 200 len: 1464 microversion: 2.1 time: 0.561715 Oct 12 13:40:56.990752 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 983/1993] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:40:56 2022] GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 => generated 1464 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:40:57.141099 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f1b12fd0-7741-43af-ac00-701725c54a24 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:40:57.142214 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f1b12fd0-7741-43af-ac00-701725c54a24 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:40:57.149176 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1b12fd0-7741-43af-ac00-701725c54a24 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:57.149673 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1b12fd0-7741-43af-ac00-701725c54a24 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:57.150638 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1b12fd0-7741-43af-ac00-701725c54a24 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:57.171263 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1b12fd0-7741-43af-ac00-701725c54a24 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:57.171789 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1b12fd0-7741-43af-ac00-701725c54a24 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:57.173673 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f1b12fd0-7741-43af-ac00-701725c54a24 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:57.333402 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f1b12fd0-7741-43af-ac00-701725c54a24 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] Going to try to terminate instance {{(pid=120933) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:40:58.136705 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f1b12fd0-7741-43af-ac00-701725c54a24 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6" status: 204 len: 0 microversion: 2.1 time: 0.999502 Oct 12 13:40:58.137923 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1011/1994] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:40:57 2022] DELETE /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 => generated 0 bytes in 1001 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:40:58.162539 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fef616a7-fbeb-40e9-9c1d-6f685a1244f4 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:40:58.170106 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fef616a7-fbeb-40e9-9c1d-6f685a1244f4 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:40:58.205561 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fef616a7-fbeb-40e9-9c1d-6f685a1244f4 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:58.206454 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fef616a7-fbeb-40e9-9c1d-6f685a1244f4 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:58.207322 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fef616a7-fbeb-40e9-9c1d-6f685a1244f4 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:58.208483 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fef616a7-fbeb-40e9-9c1d-6f685a1244f4 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:40:58.209175 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fef616a7-fbeb-40e9-9c1d-6f685a1244f4 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:40:58.209771 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fef616a7-fbeb-40e9-9c1d-6f685a1244f4 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:40:59.146625 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-fef616a7-fbeb-40e9-9c1d-6f685a1244f4 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae27e6bf3a44f2933a34d40923a2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5718f8b72bec46ce9a25b15f44f6a0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:40:59.157411 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=51 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:40:59.160412 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fef616a7-fbeb-40e9-9c1d-6f685a1244f4 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] 10.222.0.52 "GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6" status: 200 len: 1470 microversion: 2.1 time: 1.006619 Oct 12 13:40:59.175908 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 984/1995] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:40:58 2022] GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 => generated 1470 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:41:00.189494 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d858671f-4d11-40e2-9edb-ab22e2519aba tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:41:00.190911 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-d858671f-4d11-40e2-9edb-ab22e2519aba tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:41:00.199225 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d858671f-4d11-40e2-9edb-ab22e2519aba tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:41:00.201978 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d858671f-4d11-40e2-9edb-ab22e2519aba tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:41:00.204293 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d858671f-4d11-40e2-9edb-ab22e2519aba tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:41:00.205139 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d858671f-4d11-40e2-9edb-ab22e2519aba tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:41:00.210748 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d858671f-4d11-40e2-9edb-ab22e2519aba tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:41:00.211165 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-d858671f-4d11-40e2-9edb-ab22e2519aba tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:41:00.235772 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:41:01.115012 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-d858671f-4d11-40e2-9edb-ab22e2519aba tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae27e6bf3a44f2933a34d40923a2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5718f8b72bec46ce9a25b15f44f6a0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:41:01.130043 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d858671f-4d11-40e2-9edb-ab22e2519aba tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] 10.222.0.52 "GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6" status: 200 len: 1470 microversion: 2.1 time: 0.939731 Oct 12 13:41:01.149856 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1012/1996] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:41:00 2022] GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 => generated 1470 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:41:02.170607 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fd4ab9d9-d1b0-4e53-af47-781c7efbbf21 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:41:02.171917 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fd4ab9d9-d1b0-4e53-af47-781c7efbbf21 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:41:02.199976 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:41:02.205535 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fd4ab9d9-d1b0-4e53-af47-781c7efbbf21 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:41:02.210614 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fd4ab9d9-d1b0-4e53-af47-781c7efbbf21 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:41:02.215266 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fd4ab9d9-d1b0-4e53-af47-781c7efbbf21 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:41:02.220072 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fd4ab9d9-d1b0-4e53-af47-781c7efbbf21 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:41:02.220926 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fd4ab9d9-d1b0-4e53-af47-781c7efbbf21 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:41:02.221647 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fd4ab9d9-d1b0-4e53-af47-781c7efbbf21 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:41:02.511500 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-fd4ab9d9-d1b0-4e53-af47-781c7efbbf21 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae27e6bf3a44f2933a34d40923a2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5718f8b72bec46ce9a25b15f44f6a0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:41:02.530705 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-c6a518c3-8a95-437d-9316-a59cd8c04e64 req-94bd4f7a-a7c2-44f8-919e-b7df93945ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83ecb98-4d20-429a-8b55-98496a10dbe6", "name": "network-vif-deleted", "tag": "eba90c7d-6513-461d-96dc-31db34d4ac3c"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:41:02.553331 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fd4ab9d9-d1b0-4e53-af47-781c7efbbf21 tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] 10.222.0.52 "GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6" status: 200 len: 1428 microversion: 2.1 time: 0.392213 Oct 12 13:41:02.557253 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 985/1997] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:41:02 2022] GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 => generated 1428 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:41:02.561050 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:41:02.563437 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-c6a518c3-8a95-437d-9316-a59cd8c04e64 req-94bd4f7a-a7c2-44f8-919e-b7df93945ee1 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:41:02.566164 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-c6a518c3-8a95-437d-9316-a59cd8c04e64 req-94bd4f7a-a7c2-44f8-919e-b7df93945ee1 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:41:02.566935 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-c6a518c3-8a95-437d-9316-a59cd8c04e64 req-94bd4f7a-a7c2-44f8-919e-b7df93945ee1 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:41:02.614127 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-c6a518c3-8a95-437d-9316-a59cd8c04e64 req-94bd4f7a-a7c2-44f8-919e-b7df93945ee1 service nova] Creating event network-vif-deleted:eba90c7d-6513-461d-96dc-31db34d4ac3c for instance b83ecb98-4d20-429a-8b55-98496a10dbe6 on n-h1-861076-2 Oct 12 13:41:02.641431 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-c6a518c3-8a95-437d-9316-a59cd8c04e64 req-94bd4f7a-a7c2-44f8-919e-b7df93945ee1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115530 Oct 12 13:41:02.643485 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1013/1998] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:41:03.582974 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7c58ee3b-9465-43d0-9e9d-611dde61726a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:41:03.584238 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7c58ee3b-9465-43d0-9e9d-611dde61726a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:41:03.601487 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7c58ee3b-9465-43d0-9e9d-611dde61726a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:41:03.603909 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7c58ee3b-9465-43d0-9e9d-611dde61726a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:41:03.605787 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7c58ee3b-9465-43d0-9e9d-611dde61726a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:41:03.606749 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7c58ee3b-9465-43d0-9e9d-611dde61726a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:41:03.608319 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7c58ee3b-9465-43d0-9e9d-611dde61726a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:41:03.611228 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7c58ee3b-9465-43d0-9e9d-611dde61726a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:41:03.740945 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7c58ee3b-9465-43d0-9e9d-611dde61726a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:41:03.745677 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7c58ee3b-9465-43d0-9e9d-611dde61726a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:41:03.747873 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7c58ee3b-9465-43d0-9e9d-611dde61726a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:41:03.748778 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-7c58ee3b-9465-43d0-9e9d-611dde61726a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lazy-loading 'fault' on Instance uuid b83ecb98-4d20-429a-8b55-98496a10dbe6 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:41:04.297635 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-7c58ee3b-9465-43d0-9e9d-611dde61726a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ae27e6bf3a44f2933a34d40923a2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5718f8b72bec46ce9a25b15f44f6a0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:41:04.312173 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7c58ee3b-9465-43d0-9e9d-611dde61726a tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] 10.222.0.52 "GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6" status: 200 len: 1304 microversion: 2.1 time: 0.733716 Oct 12 13:41:04.314378 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 986/1999] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:41:03 2022] GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 => generated 1304 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:41:05.347337 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4ebde55b-5a6b-4bdc-bba9-4bfb4fdfb8ac tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:41:05.352338 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-4ebde55b-5a6b-4bdc-bba9-4bfb4fdfb8ac tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] [instance: b83ecb98-4d20-429a-8b55-98496a10dbe6] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:41:05.368400 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4ebde55b-5a6b-4bdc-bba9-4bfb4fdfb8ac tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:41:05.370424 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4ebde55b-5a6b-4bdc-bba9-4bfb4fdfb8ac tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:41:05.372329 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4ebde55b-5a6b-4bdc-bba9-4bfb4fdfb8ac tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:41:05.383721 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4ebde55b-5a6b-4bdc-bba9-4bfb4fdfb8ac tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:41:05.384542 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4ebde55b-5a6b-4bdc-bba9-4bfb4fdfb8ac tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:41:05.385180 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-4ebde55b-5a6b-4bdc-bba9-4bfb4fdfb8ac tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:41:05.417595 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-4ebde55b-5a6b-4bdc-bba9-4bfb4fdfb8ac tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] HTTP exception thrown: Instance b83ecb98-4d20-429a-8b55-98496a10dbe6 could not be found. Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4ebde55b-5a6b-4bdc-bba9-4bfb4fdfb8ac tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Request method failure captured: Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: request: GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 HTTP/1.1 Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 0 Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsPGqmJ9u_W-uapH47oBe3r6Mmaxvs8t75Iew5WaZAtTstq3u-lRS9HeL3BKv2akyIRYWsOJjUq7z3HnVC84NSBQTDez1yUIcmsKyxhTrr4pPrEqeRGzl-oefatub3U6gzyWFJnGe39nryH56gW-RQmWEuCRgu4yecXvVLlGRcIpDZQ Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 5718f8b72bec46ce9a25b15f44f6a0c5 Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-VolumesNegativeTest-1152821558 Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5718f8b72bec46ce9a25b15f44f6a0c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5718f8b72bec46ce9a25b15f44f6a0c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5718f8b72bec46ce9a25b15f44f6a0c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5718f8b72bec46ce9a25b15f44f6a0c5"}]}] Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-VolumesNegativeTest-1152821558 Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 5718f8b72bec46ce9a25b15f44f6a0c5 Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-VolumesNegativeTest-1152821558 Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-VolumesNegativeTest-1152821558-project Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: e3ae27e6bf3a44f2933a34d40923a2df Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-VolumesNegativeTest-1152821558-project Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: exception: Instance b83ecb98-4d20-429a-8b55-98496a10dbe6 could not be found. Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'b83ecb98-4d20-429a-8b55-98496a10dbe6'} Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b83ecb98-4d20-429a-8b55-98496a10dbe6 could not be found. Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b83ecb98-4d20-429a-8b55-98496a10dbe6 could not be found. Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:41:05.422343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:41:05.433041 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:41:05.433041 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:41:05.433041 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:41:05.433041 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:41:05.433041 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:41:05.433041 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b83ecb98-4d20-429a-8b55-98496a10dbe6 could not be found. Oct 12 13:41:05.433041 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:41:05.454670 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4ebde55b-5a6b-4bdc-bba9-4bfb4fdfb8ac tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] Returning 404 to user: Instance b83ecb98-4d20-429a-8b55-98496a10dbe6 could not be found. {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:41:05.456405 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4ebde55b-5a6b-4bdc-bba9-4bfb4fdfb8ac tempest-VolumesNegativeTest-1152821558 tempest-VolumesNegativeTest-1152821558-project] 10.222.0.52 "GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6" status: 404 len: 111 microversion: 2.1 time: 0.117851 Oct 12 13:41:05.465889 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1014/2000] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:41:05 2022] GET /compute/v2.1/servers/b83ecb98-4d20-429a-8b55-98496a10dbe6 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:41:44.239100 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=15 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:41:44.624639 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-77aadfec-dc90-4ed3-af59-2425168a0ee5 tempest-TestSecurityGroupsBasicOps-859623916 tempest-TestSecurityGroupsBasicOps-859623916-project] Action: 'create', calling method: .version_select at 0x7f8a9b5f13a0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1889242381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyE/rGQOvWXcfculwGq3Q/sFnEFmO/0TynL0fop5Vl0/ihQa4kMj/SAHds/MRVvedPMmQ8AFEYdeo8tBXzzMuBRuQQL211YgvYlDSUE/GoMtNb4xs6XZzjckHdSKEOsIg=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:41:44.663805 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-77aadfec-dc90-4ed3-af59-2425168a0ee5 tempest-TestSecurityGroupsBasicOps-859623916 tempest-TestSecurityGroupsBasicOps-859623916-project] Getting quotas for project a64398cb42aa41dea8b733994955adaa. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:41:44.674514 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-77aadfec-dc90-4ed3-af59-2425168a0ee5 tempest-TestSecurityGroupsBasicOps-859623916 tempest-TestSecurityGroupsBasicOps-859623916-project] Getting quotas for user 7a5df8ad64bd444494af72f9abc171d9 and project a64398cb42aa41dea8b733994955adaa. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:41:44.708644 n-d-861076-2 devstack@n-api.service[120932]: ERROR oslo.messaging._drivers.impl_rabbit [None req-77aadfec-dc90-4ed3-af59-2425168a0ee5 tempest-TestSecurityGroupsBasicOps-859623916 tempest-TestSecurityGroupsBasicOps-859623916-project] [3fb7f634-086b-4dd4-b65a-3f3c6c31b792] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 13:41:45.717769 n-d-861076-2 devstack@n-api.service[120932]: INFO oslo.messaging._drivers.impl_rabbit [None req-77aadfec-dc90-4ed3-af59-2425168a0ee5 tempest-TestSecurityGroupsBasicOps-859623916 tempest-TestSecurityGroupsBasicOps-859623916-project] [3fb7f634-086b-4dd4-b65a-3f3c6c31b792] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 45324. Oct 12 13:41:45.819028 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-77aadfec-dc90-4ed3-af59-2425168a0ee5 tempest-TestSecurityGroupsBasicOps-859623916 tempest-TestSecurityGroupsBasicOps-859623916-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.588420 Oct 12 13:41:45.819582 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 987/2001] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:41:44 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:42:11.091973 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=9 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:42:11.093137 n-d-861076-2 devstack@n-api.service[120933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 13:42:11.093391 n-d-861076-2 devstack@n-api.service[120933]: Wed Oct 12 13:42:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-aggregates (ip 10.222.0.52) !!! Oct 12 13:42:11.399529 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d64fb7f4-d14a-49a3-b39d-3e332aa18976 tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-444812024", "availability_zone": "foo_zone"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:42:11.404838 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.aggregate [None req-d64fb7f4-d14a-49a3-b39d-3e332aa18976 tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Generated uuid 646a5ef7-02ab-4ab0-8279-13dec43e359b for aggregate {{(pid=120933) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 13:42:11.551631 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d64fb7f4-d14a-49a3-b39d-3e332aa18976 tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.466041 Oct 12 13:42:11.552263 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1015/2002] 10.222.0.52 () {60 vars in 1164 bytes} [Wed Oct 12 13:42:11 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:42:11.562806 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:42:11.566002 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:42:11.574587 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0b599f55-6b08-4c63-afb6-7a1fb3ca449f tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:42:11.802846 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0b599f55-6b08-4c63-afb6-7a1fb3ca449f tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.242064 Oct 12 13:42:11.804095 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 988/2003] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 12 13:42:11 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:42:11.817535 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-71e12e87-33b9-430a-b60a-9e3e533aa97e tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:42:11.824021 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-71e12e87-33b9-430a-b60a-9e3e533aa97e tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:42:11.826582 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-71e12e87-33b9-430a-b60a-9e3e533aa97e tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:42:11.828049 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-71e12e87-33b9-430a-b60a-9e3e533aa97e tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:42:11.829040 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-71e12e87-33b9-430a-b60a-9e3e533aa97e tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:42:11.875578 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-71e12e87-33b9-430a-b60a-9e3e533aa97e tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.046s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:42:11.877572 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-71e12e87-33b9-430a-b60a-9e3e533aa97e tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:42:11.987837 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-71e12e87-33b9-430a-b60a-9e3e533aa97e tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.173364 Oct 12 13:42:11.989268 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1016/2004] 10.222.0.52 () {58 vars in 1176 bytes} [Wed Oct 12 13:42:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:42:12.001530 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d402b5a4-9858-4367-8f9a-8053a24c562a tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:42:12.035802 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d402b5a4-9858-4367-8f9a-8053a24c562a tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.037335 Oct 12 13:42:12.037732 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 989/2005] 10.222.0.52 () {58 vars in 1143 bytes} [Wed Oct 12 13:42:11 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:42:12.058255 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-15ecb847-6234-494c-8fb9-3143272c4bc5 tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-861076-2"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:42:12.079212 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-15ecb847-6234-494c-8fb9-3143272c4bc5 tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:42:12.086525 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-15ecb847-6234-494c-8fb9-3143272c4bc5 tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:42:12.087550 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-15ecb847-6234-494c-8fb9-3143272c4bc5 tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:42:12.868553 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-15ecb847-6234-494c-8fb9-3143272c4bc5 tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.824073 Oct 12 13:42:12.875925 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1017/2006] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 12 13:42:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:42:12.885048 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-af11fff8-d880-4a5f-8991-b1ab63a3eccb tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:42:12.911718 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-af11fff8-d880-4a5f-8991-b1ab63a3eccb tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.031901 Oct 12 13:42:12.914564 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 990/2007] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:42:12 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:42:12.926370 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9e8b6993-f73c-4249-ae5b-a4bfbdb9eaac tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1373809770", "availability_zone": "foo_zone"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:42:13.143173 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9e8b6993-f73c-4249-ae5b-a4bfbdb9eaac tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.211524 Oct 12 13:42:13.143173 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1018/2008] 10.222.0.52 () {60 vars in 1173 bytes} [Wed Oct 12 13:42:12 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:42:13.155908 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e6421832-ee0c-4a98-ac41-cba716b0c23c tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:42:13.255817 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e6421832-ee0c-4a98-ac41-cba716b0c23c tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.104733 Oct 12 13:42:13.263288 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 991/2009] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 12 13:42:13 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:42:13.275423 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8af3a14b-f62a-456d-bbc3-f031cb697940 tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:42:13.292636 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-8af3a14b-f62a-456d-bbc3-f031cb697940 tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.020286 Oct 12 13:42:13.303631 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1019/2010] 10.222.0.52 () {58 vars in 1152 bytes} [Wed Oct 12 13:42:13 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:42:13.307795 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ba455b07-6c62-4927-aeca-77e2acd5a00b tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-861076-2"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:42:13.337851 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba455b07-6c62-4927-aeca-77e2acd5a00b tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:42:13.342936 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba455b07-6c62-4927-aeca-77e2acd5a00b tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:42:13.343659 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba455b07-6c62-4927-aeca-77e2acd5a00b tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:42:13.936592 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fdeac08f-805c-4ad1-971b-4456289dc426 tempest-TestSecurityGroupsBasicOps-859623916 tempest-TestSecurityGroupsBasicOps-859623916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-859623916-access_point-1512663678", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "25da61cc-5c96-42d1-84b4-4b65bd037c14"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1889242381", "security_groups": [{"name": "tempest-secgroup_access--739331770"}, {"name": "tempest-secgroup_general--697038814"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:42:14.072855 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ba455b07-6c62-4927-aeca-77e2acd5a00b tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.769226 Oct 12 13:42:14.073515 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 992/2011] 10.222.0.52 () {60 vars in 1194 bytes} [Wed Oct 12 13:42:13 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:42:14.089770 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f4126b0a-7409-433a-ba5e-74363b72bfc9 tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:42:14.221049 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f4126b0a-7409-433a-ba5e-74363b72bfc9 tempest-TestAggregatesBasicOps-1691123317 tempest-TestAggregatesBasicOps-1691123317-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.139794 Oct 12 13:42:14.223430 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 993/2012] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Oct 12 13:42:14 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 13:42:15.787215 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-fdeac08f-805c-4ad1-971b-4456289dc426 tempest-TestSecurityGroupsBasicOps-859623916 tempest-TestSecurityGroupsBasicOps-859623916-project] validate_networks() for [('25da61cc-5c96-42d1-84b4-4b65bd037c14', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-fdeac08f-805c-4ad1-971b-4456289dc426 tempest-TestSecurityGroupsBasicOps-859623916 tempest-TestSecurityGroupsBasicOps-859623916-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d72160e5-7dc2-4520-907e-097f0185cc80) Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:42:17.989606 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:42:17.994608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:42:17.994608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:42:17.994608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:42:17.994608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:42:17.994608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:42:17.994608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:42:17.994608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:42:17.994608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:42:17.994608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:42:17.994608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:42:17.994608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:42:17.994608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:42:17.994608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:42:17.994608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:42:17.994608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:42:17.994608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d72160e5-7dc2-4520-907e-097f0185cc80) Oct 12 13:42:17.994608 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:42:17.994608 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-fdeac08f-805c-4ad1-971b-4456289dc426 tempest-TestSecurityGroupsBasicOps-859623916 tempest-TestSecurityGroupsBasicOps-859623916-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:42:17.994608 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fdeac08f-805c-4ad1-971b-4456289dc426 tempest-TestSecurityGroupsBasicOps-859623916 tempest-TestSecurityGroupsBasicOps-859623916-project] Request method failure captured: Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 468 Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsQVJU1x_r2u2FTjADZljiNRsRxHc063mFpkEt9TkeZg5atbmbstBByWRn7gd3ClQLXJnJhVXVqNQkm3wiDlOzplOe937aD3mBK-GHxTQXyyVRsrnKu-NtC-ZLdGNUA-Rnn8J0AlpbRALjEta05GU8cKVVCRWAd46kN2DIV2R1571IQ Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: a64398cb42aa41dea8b733994955adaa Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-859623916 Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a64398cb42aa41dea8b733994955adaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a64398cb42aa41dea8b733994955adaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a64398cb42aa41dea8b733994955adaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a64398cb42aa41dea8b733994955adaa"}]}] Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-TestSecurityGroupsBasicOps-859623916 Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: a64398cb42aa41dea8b733994955adaa Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-859623916 Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-TestSecurityGroupsBasicOps-859623916-project Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 7a5df8ad64bd444494af72f9abc171d9 Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-TestSecurityGroupsBasicOps-859623916-project Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-859623916-access_point-1512663678", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "25da61cc-5c96-42d1-84b4-4b65bd037c14"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1889242381", "security_groups": [{"name": "tempest-secgroup_access--739331770"}, {"name": "tempest-secgroup_general--697038814"}]}, "os:scheduler_hints": {"different_host": []}} Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-server-tempest-TestSecurityGroupsBasicOps-859623916-access_point-1512663678', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '25da61cc-5c96-42d1-84b4-4b65bd037c14'}], 'key_name': 'tempest-TestSecurityGroupsBasicOps-1889242381', 'security_groups': [{'name': 'tempest-secgroup_access--739331770'}, {'name': 'tempest-secgroup_general--697038814'}]}, 'os:scheduler_hints': {'different_host': []}}} Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:42:17.996550 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d72160e5-7dc2-4520-907e-097f0185cc80) Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:42:18.002341 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:42:18.015012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:42:18.015012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:42:18.015012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:42:18.015012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:42:18.015012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:42:18.015012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:42:18.015012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:42:18.015012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:42:18.015012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:42:18.015012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:42:18.015012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:42:18.015012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:42:18.015012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:42:18.015012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:42:18.015012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:42:18.015012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:42:18.015012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:42:18.015012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:42:18.015012 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fdeac08f-805c-4ad1-971b-4456289dc426 tempest-TestSecurityGroupsBasicOps-859623916 tempest-TestSecurityGroupsBasicOps-859623916-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:42:18.015012 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:42:18.015012 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fdeac08f-805c-4ad1-971b-4456289dc426 tempest-TestSecurityGroupsBasicOps-859623916 tempest-TestSecurityGroupsBasicOps-859623916-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 4.076766 Oct 12 13:42:18.015012 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1020/2013] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:42:13 2022] POST /compute/v2.1/servers => generated 214 bytes in 4081 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 12 13:42:34.327721 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ce98ba97-df91-4d9e-8572-b96180b41182 tempest-TestSecurityGroupsBasicOps-859623916 tempest-TestSecurityGroupsBasicOps-859623916-project] Calling method '.version_select at 0x7f8aa3e3b430>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:42:34.384398 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:42:34.391091 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:42:34.560685 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ce98ba97-df91-4d9e-8572-b96180b41182 tempest-TestSecurityGroupsBasicOps-859623916 tempest-TestSecurityGroupsBasicOps-859623916-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1889242381" status: 202 len: 0 microversion: 2.1 time: 0.244601 Oct 12 13:42:34.564167 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 994/2014] 10.222.0.52 () {58 vars in 1278 bytes} [Wed Oct 12 13:42:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1889242381 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:42:58.381142 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:42:58.381933 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=6 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:42:58.382576 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:42:58.669530 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-24d3de55-34c3-4fe5-9268-0644e01ae8a2 tempest-TestServerAdvancedOps-314397531 tempest-TestServerAdvancedOps-314397531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-70398489", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "da5a4e07-e8aa-4ee2-8510-e7586ab761ad"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:42:59.108068 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-24d3de55-34c3-4fe5-9268-0644e01ae8a2 tempest-TestServerAdvancedOps-314397531 tempest-TestServerAdvancedOps-314397531-project] validate_networks() for [('da5a4e07-e8aa-4ee2-8510-e7586ab761ad', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-24d3de55-34c3-4fe5-9268-0644e01ae8a2 tempest-TestServerAdvancedOps-314397531 tempest-TestServerAdvancedOps-314397531-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bd94b040-dde9-4b9a-9b6d-1a222979ae5d) Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:43:00.536342 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bd94b040-dde9-4b9a-9b6d-1a222979ae5d) Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-24d3de55-34c3-4fe5-9268-0644e01ae8a2 tempest-TestServerAdvancedOps-314397531 tempest-TestServerAdvancedOps-314397531-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-24d3de55-34c3-4fe5-9268-0644e01ae8a2 tempest-TestServerAdvancedOps-314397531 tempest-TestServerAdvancedOps-314397531-project] Request method failure captured: Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 205 Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsRaLWFs2-PfdH7VJ6LKGzHT-gd7YnrrFc0CVLqRWviXtJIBaOxXGfJFffjH3ZTMkUg_qtyM9CC_-eoEYekGjzeS-r0INwtKnMO300U0IHkttSjxDcLxvql3MLPUMrMF7Wc6bHOVPLI-bSV8b5Kt69BQpit9BTgpiYmI2pZAkk4HsZw Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: da73b8b9c79a4e758636e13a5cc35e60 Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-TestServerAdvancedOps-314397531 Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/da73b8b9c79a4e758636e13a5cc35e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_da73b8b9c79a4e758636e13a5cc35e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/da73b8b9c79a4e758636e13a5cc35e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/da73b8b9c79a4e758636e13a5cc35e60"}]}] Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-TestServerAdvancedOps-314397531 Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: da73b8b9c79a4e758636e13a5cc35e60 Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-TestServerAdvancedOps-314397531 Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-TestServerAdvancedOps-314397531-project Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 40c4c2b6205948beba79b471783768c8 Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-TestServerAdvancedOps-314397531-project Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-TestServerAdvancedOps-server-70398489", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "da5a4e07-e8aa-4ee2-8510-e7586ab761ad"}]}} Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-TestServerAdvancedOps-server-70398489', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': 'da5a4e07-e8aa-4ee2-8510-e7586ab761ad'}]}}} Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:43:00.551456 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:43:00.556353 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bd94b040-dde9-4b9a-9b6d-1a222979ae5d) Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-24d3de55-34c3-4fe5-9268-0644e01ae8a2 tempest-TestServerAdvancedOps-314397531 tempest-TestServerAdvancedOps-314397531-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-24d3de55-34c3-4fe5-9268-0644e01ae8a2 tempest-TestServerAdvancedOps-314397531 tempest-TestServerAdvancedOps-314397531-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.160562 Oct 12 13:43:00.566954 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1021/2015] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:42:58 2022] POST /compute/v2.1/servers => generated 214 bytes in 2162 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:44:44.780979 n-d-861076-2 devstack@n-api.service[120932]: ERROR oslo.messaging._drivers.impl_rabbit [-] [218a9a61-6610-4e2e-83a8-c73fc80d21fe] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 13:44:44.781865 n-d-861076-2 devstack@n-api.service[120932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 13:44:44.782002 n-d-861076-2 devstack@n-api.service[120932]: Wed Oct 12 13:44:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 12 13:44:44.783845 n-d-861076-2 devstack@n-api.service[120932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 13:44:44.783961 n-d-861076-2 devstack@n-api.service[120932]: Wed Oct 12 13:44:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 12 13:44:44.804756 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-da5fb822-bd7e-4c32-831f-4fd690bee04b tempest-VolumesSnapshotTestJSON-367680922 tempest-VolumesSnapshotTestJSON-367680922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1673179270", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "247488f5-aedb-4a51-a03e-ddc20b0de85f"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:44:45.266937 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-da5fb822-bd7e-4c32-831f-4fd690bee04b tempest-VolumesSnapshotTestJSON-367680922 tempest-VolumesSnapshotTestJSON-367680922-project] validate_networks() for [('247488f5-aedb-4a51-a03e-ddc20b0de85f', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-da5fb822-bd7e-4c32-831f-4fd690bee04b tempest-VolumesSnapshotTestJSON-367680922 tempest-VolumesSnapshotTestJSON-367680922-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-66dd649d-deb6-4e8c-a5e7-25c6123d9241) Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:44:45.726003 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:44:45.729747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:44:45.729747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:44:45.729747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:44:45.729747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:44:45.729747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:44:45.729747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:44:45.729747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:44:45.729747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:44:45.729747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:44:45.729747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:44:45.729747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:44:45.729747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:44:45.729747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:44:45.729747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:44:45.729747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-66dd649d-deb6-4e8c-a5e7-25c6123d9241) Oct 12 13:44:45.729747 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:44:45.729747 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-da5fb822-bd7e-4c32-831f-4fd690bee04b tempest-VolumesSnapshotTestJSON-367680922 tempest-VolumesSnapshotTestJSON-367680922-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:44:45.729747 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-da5fb822-bd7e-4c32-831f-4fd690bee04b tempest-VolumesSnapshotTestJSON-367680922 tempest-VolumesSnapshotTestJSON-367680922-project] Request method failure captured: Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 211 Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsQwPIwDopeQLjR9YteqJnuW0SyDNUWLMsNjuZwtZ92LimfGAvr8--ilreQ8uyfxepCJeCSmBK0sH_HBUtUwaSXJa32a3Fmu-txYZfeersod2XUudFDJge4w9QvNykRoya8ihkEd3Gkl0wa2y2ChXjVMhwmqXByS3HoP3ONVRfmTfRo Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: a97f544ffeb44097a4ad8b2e41ace754 Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-VolumesSnapshotTestJSON-367680922 Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a97f544ffeb44097a4ad8b2e41ace754"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a97f544ffeb44097a4ad8b2e41ace754"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a97f544ffeb44097a4ad8b2e41ace754"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a97f544ffeb44097a4ad8b2e41ace754"}]}] Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-VolumesSnapshotTestJSON-367680922 Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: a97f544ffeb44097a4ad8b2e41ace754 Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-367680922 Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-VolumesSnapshotTestJSON-367680922-project Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: c5e364a80a0946c594c996b319e799ab Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-VolumesSnapshotTestJSON-367680922-project Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1673179270", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "247488f5-aedb-4a51-a03e-ddc20b0de85f"}]}} Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-VolumesSnapshotTestJSON-instance-1673179270', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '247488f5-aedb-4a51-a03e-ddc20b0de85f'}]}}} Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:44:45.735041 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-66dd649d-deb6-4e8c-a5e7-25c6123d9241) Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:44:45.741162 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:44:45.750670 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:44:45.750670 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:44:45.750670 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:44:45.750670 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:44:45.750670 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:44:45.750670 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:44:45.750670 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:44:45.750670 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:44:45.750670 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:44:45.750670 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:44:45.750670 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:44:45.750670 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:44:45.750670 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:44:45.781319 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-da5fb822-bd7e-4c32-831f-4fd690bee04b tempest-VolumesSnapshotTestJSON-367680922 tempest-VolumesSnapshotTestJSON-367680922-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:44:45.781319 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:44:45.781319 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-da5fb822-bd7e-4c32-831f-4fd690bee04b tempest-VolumesSnapshotTestJSON-367680922 tempest-VolumesSnapshotTestJSON-367680922-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.981915 Oct 12 13:44:45.790143 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 995/2016] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:44:44 2022] POST /compute/v2.1/servers => generated 214 bytes in 1012 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:45:01.625764 n-d-861076-2 devstack@n-api.service[120933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 13:45:01.626234 n-d-861076-2 devstack@n-api.service[120933]: Wed Oct 12 13:45:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 12 13:45:01.627332 n-d-861076-2 devstack@n-api.service[120933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 13:45:01.627594 n-d-861076-2 devstack@n-api.service[120933]: Wed Oct 12 13:45:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 12 13:45:01.637042 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a434498f-702b-4aef-8c30-d9e22c87e28d tempest-VolumesSnapshotTestJSON-367680922 tempest-VolumesSnapshotTestJSON-367680922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-788326706", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "247488f5-aedb-4a51-a03e-ddc20b0de85f"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:45:01.726513 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-a434498f-702b-4aef-8c30-d9e22c87e28d tempest-VolumesSnapshotTestJSON-367680922 tempest-VolumesSnapshotTestJSON-367680922-project] validate_networks() for [('247488f5-aedb-4a51-a03e-ddc20b0de85f', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-a434498f-702b-4aef-8c30-d9e22c87e28d tempest-VolumesSnapshotTestJSON-367680922 tempest-VolumesSnapshotTestJSON-367680922-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3c2c4030-5b19-4f96-95a9-ec19245b84e0) Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:45:02.429987 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3c2c4030-5b19-4f96-95a9-ec19245b84e0) Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-a434498f-702b-4aef-8c30-d9e22c87e28d tempest-VolumesSnapshotTestJSON-367680922 tempest-VolumesSnapshotTestJSON-367680922-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a434498f-702b-4aef-8c30-d9e22c87e28d tempest-VolumesSnapshotTestJSON-367680922 tempest-VolumesSnapshotTestJSON-367680922-project] Request method failure captured: Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 210 Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsQwPIwDopeQLjR9YteqJnuW0SyDNUWLMsNjuZwtZ92LimfGAvr8--ilreQ8uyfxepCJeCSmBK0sH_HBUtUwaSXJa32a3Fmu-txYZfeersod2XUudFDJge4w9QvNykRoya8ihkEd3Gkl0wa2y2ChXjVMhwmqXByS3HoP3ONVRfmTfRo Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: a97f544ffeb44097a4ad8b2e41ace754 Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-VolumesSnapshotTestJSON-367680922 Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a97f544ffeb44097a4ad8b2e41ace754"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a97f544ffeb44097a4ad8b2e41ace754"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a97f544ffeb44097a4ad8b2e41ace754"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a97f544ffeb44097a4ad8b2e41ace754"}]}] Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-VolumesSnapshotTestJSON-367680922 Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: a97f544ffeb44097a4ad8b2e41ace754 Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-367680922 Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-VolumesSnapshotTestJSON-367680922-project Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: c5e364a80a0946c594c996b319e799ab Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-VolumesSnapshotTestJSON-367680922-project Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-788326706", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "247488f5-aedb-4a51-a03e-ddc20b0de85f"}]}} Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-VolumesSnapshotTestJSON-instance-788326706', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '247488f5-aedb-4a51-a03e-ddc20b0de85f'}]}}} Oct 12 13:45:02.436431 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:45:02.439237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3c2c4030-5b19-4f96-95a9-ec19245b84e0) Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a434498f-702b-4aef-8c30-d9e22c87e28d tempest-VolumesSnapshotTestJSON-367680922 tempest-VolumesSnapshotTestJSON-367680922-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a434498f-702b-4aef-8c30-d9e22c87e28d tempest-VolumesSnapshotTestJSON-367680922 tempest-VolumesSnapshotTestJSON-367680922-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.809849 Oct 12 13:45:02.442536 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1022/2017] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:45:01 2022] POST /compute/v2.1/servers => generated 214 bytes in 811 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:45:44.317969 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e6d8fa3b-5416-4c5f-b497-78b85ffd7a03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1839240947", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:45:44.352097 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:45:44.369243 n-d-861076-2 devstack@n-api.service[120932]: INFO oslo.messaging._drivers.impl_rabbit [-] [218a9a61-6610-4e2e-83a8-c73fc80d21fe] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 53012. Oct 12 13:45:44.406830 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-e6d8fa3b-5416-4c5f-b497-78b85ffd7a03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] validate_networks() for None {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:45:44.718141 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-e6d8fa3b-5416-4c5f-b497-78b85ffd7a03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:45:44.719350 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-e6d8fa3b-5416-4c5f-b497-78b85ffd7a03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:45:44.720016 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-e6d8fa3b-5416-4c5f-b497-78b85ffd7a03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:45:44.720574 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-e6d8fa3b-5416-4c5f-b497-78b85ffd7a03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:45:44.721176 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-e6d8fa3b-5416-4c5f-b497-78b85ffd7a03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:45:44.731944 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6d8fa3b-5416-4c5f-b497-78b85ffd7a03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:45:44.732726 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6d8fa3b-5416-4c5f-b497-78b85ffd7a03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:45:44.733268 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6d8fa3b-5416-4c5f-b497-78b85ffd7a03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:45:44.734216 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6d8fa3b-5416-4c5f-b497-78b85ffd7a03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:45:44.734840 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6d8fa3b-5416-4c5f-b497-78b85ffd7a03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:45:44.735412 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6d8fa3b-5416-4c5f-b497-78b85ffd7a03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:45:44.800247 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-e6d8fa3b-5416-4c5f-b497-78b85ffd7a03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Getting quotas for project e516f5849f3b4442b4bbfcd62cea8605. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:45:44.817122 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-e6d8fa3b-5416-4c5f-b497-78b85ffd7a03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Getting quotas for user 8308997c446d4d80ae49b3088c380cc1 and project e516f5849f3b4442b4bbfcd62cea8605. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:45:44.848218 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e6d8fa3b-5416-4c5f-b497-78b85ffd7a03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:45:44.854335 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e6d8fa3b-5416-4c5f-b497-78b85ffd7a03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:45:45.087797 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e6d8fa3b-5416-4c5f-b497-78b85ffd7a03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.772658 Oct 12 13:45:45.090837 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 996/2018] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:45:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 13:45:45.097961 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:45:45.104473 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5f702a5f-dba6-4548-b912-092a36903efc tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:45:45.105668 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-5f702a5f-dba6-4548-b912-092a36903efc tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:45:45.224327 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-5f702a5f-dba6-4548-b912-092a36903efc tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8308997c446d4d80ae49b3088c380cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e516f5849f3b4442b4bbfcd62cea8605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:45:45.239638 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5f702a5f-dba6-4548-b912-092a36903efc tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf" status: 200 len: 1214 microversion: 2.1 time: 0.143677 Oct 12 13:45:45.244771 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1023/2019] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:45:45 2022] GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf => generated 1214 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:45:46.268513 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b288c022-e7fd-469e-940d-971e4b269830 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:45:46.269280 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b288c022-e7fd-469e-940d-971e4b269830 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:45:46.414198 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-b288c022-e7fd-469e-940d-971e4b269830 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8308997c446d4d80ae49b3088c380cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e516f5849f3b4442b4bbfcd62cea8605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:45:46.423417 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b288c022-e7fd-469e-940d-971e4b269830 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf" status: 200 len: 1214 microversion: 2.1 time: 0.160028 Oct 12 13:45:46.425193 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 997/2020] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:45:46 2022] GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:45:47.447425 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6db0c1c7-39b4-46ca-915a-f17845a58ece tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:45:47.447925 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-6db0c1c7-39b4-46ca-915a-f17845a58ece tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:45:47.471788 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6db0c1c7-39b4-46ca-915a-f17845a58ece tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:45:47.471788 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6db0c1c7-39b4-46ca-915a-f17845a58ece tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:45:47.471788 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6db0c1c7-39b4-46ca-915a-f17845a58ece tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:45:47.471788 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6db0c1c7-39b4-46ca-915a-f17845a58ece tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:45:47.471788 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6db0c1c7-39b4-46ca-915a-f17845a58ece tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:45:47.471788 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6db0c1c7-39b4-46ca-915a-f17845a58ece tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:45:47.634206 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-6db0c1c7-39b4-46ca-915a-f17845a58ece tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8308997c446d4d80ae49b3088c380cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e516f5849f3b4442b4bbfcd62cea8605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:45:47.643171 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6db0c1c7-39b4-46ca-915a-f17845a58ece tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf" status: 200 len: 1218 microversion: 2.1 time: 0.200508 Oct 12 13:45:47.655023 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1024/2021] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:45:47 2022] GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf => generated 1218 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:45:48.671208 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0d7eba0d-ccc4-4a84-abb6-bef1c64afd02 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:45:48.672497 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0d7eba0d-ccc4-4a84-abb6-bef1c64afd02 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:45:48.691633 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0d7eba0d-ccc4-4a84-abb6-bef1c64afd02 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:45:48.692133 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0d7eba0d-ccc4-4a84-abb6-bef1c64afd02 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:45:48.695528 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0d7eba0d-ccc4-4a84-abb6-bef1c64afd02 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:45:48.695528 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0d7eba0d-ccc4-4a84-abb6-bef1c64afd02 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:45:48.695528 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0d7eba0d-ccc4-4a84-abb6-bef1c64afd02 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:45:48.695528 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0d7eba0d-ccc4-4a84-abb6-bef1c64afd02 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:45:49.730615 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-0d7eba0d-ccc4-4a84-abb6-bef1c64afd02 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8308997c446d4d80ae49b3088c380cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e516f5849f3b4442b4bbfcd62cea8605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:45:49.771033 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0d7eba0d-ccc4-4a84-abb6-bef1c64afd02 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf" status: 200 len: 1266 microversion: 2.1 time: 1.079541 Oct 12 13:45:49.772425 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 998/2022] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:45:48 2022] GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf => generated 1266 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:45:50.802462 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1eb0f43c-ec64-4f00-a375-9bd6c7627784 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:45:50.803235 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-1eb0f43c-ec64-4f00-a375-9bd6c7627784 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:45:50.820476 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1eb0f43c-ec64-4f00-a375-9bd6c7627784 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:45:50.821156 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1eb0f43c-ec64-4f00-a375-9bd6c7627784 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:45:50.821608 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1eb0f43c-ec64-4f00-a375-9bd6c7627784 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:45:50.822361 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1eb0f43c-ec64-4f00-a375-9bd6c7627784 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:45:50.822812 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1eb0f43c-ec64-4f00-a375-9bd6c7627784 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:45:50.825012 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1eb0f43c-ec64-4f00-a375-9bd6c7627784 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:45:51.059934 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-1eb0f43c-ec64-4f00-a375-9bd6c7627784 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8308997c446d4d80ae49b3088c380cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e516f5849f3b4442b4bbfcd62cea8605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:45:51.078330 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1eb0f43c-ec64-4f00-a375-9bd6c7627784 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf" status: 200 len: 1272 microversion: 2.1 time: 0.278935 Oct 12 13:45:51.078937 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1025/2023] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:45:50 2022] GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf => generated 1272 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:45:52.103974 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0e952b9d-c255-4fcb-9f7e-c78d0f2d487a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:45:52.104584 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0e952b9d-c255-4fcb-9f7e-c78d0f2d487a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:45:52.136915 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0e952b9d-c255-4fcb-9f7e-c78d0f2d487a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:45:52.145148 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0e952b9d-c255-4fcb-9f7e-c78d0f2d487a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:45:52.151476 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0e952b9d-c255-4fcb-9f7e-c78d0f2d487a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:45:52.152353 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0e952b9d-c255-4fcb-9f7e-c78d0f2d487a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:45:52.152943 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0e952b9d-c255-4fcb-9f7e-c78d0f2d487a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:45:52.155056 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0e952b9d-c255-4fcb-9f7e-c78d0f2d487a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:45:52.504309 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-0e952b9d-c255-4fcb-9f7e-c78d0f2d487a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8308997c446d4d80ae49b3088c380cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e516f5849f3b4442b4bbfcd62cea8605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:45:52.519583 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0e952b9d-c255-4fcb-9f7e-c78d0f2d487a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf" status: 200 len: 1272 microversion: 2.1 time: 0.419177 Oct 12 13:45:52.520923 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 999/2024] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:45:52 2022] GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf => generated 1272 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:45:53.550082 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-42cfa309-b0d5-4ac7-82ba-7ec3289fbb03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:45:53.552224 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-42cfa309-b0d5-4ac7-82ba-7ec3289fbb03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:45:53.573912 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42cfa309-b0d5-4ac7-82ba-7ec3289fbb03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:45:53.575363 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42cfa309-b0d5-4ac7-82ba-7ec3289fbb03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:45:53.576078 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42cfa309-b0d5-4ac7-82ba-7ec3289fbb03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:45:53.577325 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42cfa309-b0d5-4ac7-82ba-7ec3289fbb03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:45:53.578735 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42cfa309-b0d5-4ac7-82ba-7ec3289fbb03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:45:53.579893 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42cfa309-b0d5-4ac7-82ba-7ec3289fbb03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:45:53.951361 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-42cfa309-b0d5-4ac7-82ba-7ec3289fbb03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8308997c446d4d80ae49b3088c380cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e516f5849f3b4442b4bbfcd62cea8605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:45:53.967904 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-42cfa309-b0d5-4ac7-82ba-7ec3289fbb03 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf" status: 200 len: 1314 microversion: 2.1 time: 0.425533 Oct 12 13:45:53.968731 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1026/2025] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:45:53 2022] GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:45:54.999164 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cd731c0e-1dd1-4e55-8497-971d16c33243 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:45:54.999958 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cd731c0e-1dd1-4e55-8497-971d16c33243 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:45:55.007188 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:45:55.023345 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cd731c0e-1dd1-4e55-8497-971d16c33243 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:45:55.029478 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cd731c0e-1dd1-4e55-8497-971d16c33243 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:45:55.030324 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cd731c0e-1dd1-4e55-8497-971d16c33243 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:45:55.033185 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cd731c0e-1dd1-4e55-8497-971d16c33243 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:45:55.033998 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cd731c0e-1dd1-4e55-8497-971d16c33243 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:45:55.039240 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cd731c0e-1dd1-4e55-8497-971d16c33243 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:45:55.634098 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-cd731c0e-1dd1-4e55-8497-971d16c33243 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8308997c446d4d80ae49b3088c380cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e516f5849f3b4442b4bbfcd62cea8605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:45:55.647428 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cd731c0e-1dd1-4e55-8497-971d16c33243 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf" status: 200 len: 1314 microversion: 2.1 time: 0.655743 Oct 12 13:45:55.648037 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1000/2026] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:45:54 2022] GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf => generated 1314 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:45:56.138232 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:45:56.680195 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-854d8e7a-8bd6-48b8-9795-d2a739301c5b tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:45:56.685999 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-854d8e7a-8bd6-48b8-9795-d2a739301c5b tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:45:56.685999 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=8 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:45:56.696741 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-854d8e7a-8bd6-48b8-9795-d2a739301c5b tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:45:56.697387 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-247d6ae5-0b9d-4672-a8a7-bb92de5dbedb req-fa65ead8-42a6-4d62-bd24-0dabf8bf0780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbfd2474-0d28-43fa-825d-4db0724dafdf", "tag": "6294e345-51e8-4e63-aaaa-7d9fff4305bb"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:45:56.699358 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-854d8e7a-8bd6-48b8-9795-d2a739301c5b tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:45:56.700027 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-854d8e7a-8bd6-48b8-9795-d2a739301c5b tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:45:56.701003 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-854d8e7a-8bd6-48b8-9795-d2a739301c5b tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:45:56.702908 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-854d8e7a-8bd6-48b8-9795-d2a739301c5b tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:45:56.705206 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-854d8e7a-8bd6-48b8-9795-d2a739301c5b tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:45:56.713708 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-247d6ae5-0b9d-4672-a8a7-bb92de5dbedb req-fa65ead8-42a6-4d62-bd24-0dabf8bf0780 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:45:56.718117 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-247d6ae5-0b9d-4672-a8a7-bb92de5dbedb req-fa65ead8-42a6-4d62-bd24-0dabf8bf0780 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:45:56.718117 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-247d6ae5-0b9d-4672-a8a7-bb92de5dbedb req-fa65ead8-42a6-4d62-bd24-0dabf8bf0780 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:45:56.746164 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-247d6ae5-0b9d-4672-a8a7-bb92de5dbedb req-fa65ead8-42a6-4d62-bd24-0dabf8bf0780 service nova] Creating event network-changed:6294e345-51e8-4e63-aaaa-7d9fff4305bb for instance cbfd2474-0d28-43fa-825d-4db0724dafdf on n-h1-861076-2 Oct 12 13:45:56.767056 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-247d6ae5-0b9d-4672-a8a7-bb92de5dbedb req-fa65ead8-42a6-4d62-bd24-0dabf8bf0780 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.636907 Oct 12 13:45:56.772008 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1027/2027] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:45:57.445027 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-854d8e7a-8bd6-48b8-9795-d2a739301c5b tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8308997c446d4d80ae49b3088c380cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e516f5849f3b4442b4bbfcd62cea8605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:45:57.456836 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-854d8e7a-8bd6-48b8-9795-d2a739301c5b tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf" status: 200 len: 1314 microversion: 2.1 time: 0.780667 Oct 12 13:45:57.457829 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1001/2028] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:45:56 2022] GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf => generated 1314 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:45:58.490834 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c6c7f34d-c18d-41f8-b8ce-c33e019d9dee tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:45:58.492404 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-c6c7f34d-c18d-41f8-b8ce-c33e019d9dee tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:45:58.505352 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c6c7f34d-c18d-41f8-b8ce-c33e019d9dee tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:45:58.509104 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c6c7f34d-c18d-41f8-b8ce-c33e019d9dee tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:45:58.515116 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c6c7f34d-c18d-41f8-b8ce-c33e019d9dee tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:45:58.515116 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c6c7f34d-c18d-41f8-b8ce-c33e019d9dee tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:45:58.515116 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c6c7f34d-c18d-41f8-b8ce-c33e019d9dee tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:45:58.515116 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-c6c7f34d-c18d-41f8-b8ce-c33e019d9dee tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:45:58.899576 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-c6c7f34d-c18d-41f8-b8ce-c33e019d9dee tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8308997c446d4d80ae49b3088c380cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e516f5849f3b4442b4bbfcd62cea8605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:45:58.916957 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c6c7f34d-c18d-41f8-b8ce-c33e019d9dee tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf" status: 200 len: 1314 microversion: 2.1 time: 0.431082 Oct 12 13:45:58.930511 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1028/2029] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:45:58 2022] GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:45:59.953576 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f33cbe90-27e2-4fa9-a503-33fe28d339f9 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:45:59.954215 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f33cbe90-27e2-4fa9-a503-33fe28d339f9 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:45:59.965428 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f33cbe90-27e2-4fa9-a503-33fe28d339f9 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:45:59.965923 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f33cbe90-27e2-4fa9-a503-33fe28d339f9 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:45:59.973363 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f33cbe90-27e2-4fa9-a503-33fe28d339f9 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:45:59.979342 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f33cbe90-27e2-4fa9-a503-33fe28d339f9 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:45:59.980782 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f33cbe90-27e2-4fa9-a503-33fe28d339f9 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:45:59.982650 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f33cbe90-27e2-4fa9-a503-33fe28d339f9 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:46:00.576567 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-f33cbe90-27e2-4fa9-a503-33fe28d339f9 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8308997c446d4d80ae49b3088c380cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e516f5849f3b4442b4bbfcd62cea8605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:46:00.589774 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f33cbe90-27e2-4fa9-a503-33fe28d339f9 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf" status: 200 len: 1314 microversion: 2.1 time: 0.638104 Oct 12 13:46:00.591065 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1002/2030] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:45:59 2022] GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf => generated 1314 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:46:01.617052 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1cd60067-3f4c-4de1-89e1-6067eb5257d6 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:46:01.618307 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-1cd60067-3f4c-4de1-89e1-6067eb5257d6 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:46:01.627030 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1cd60067-3f4c-4de1-89e1-6067eb5257d6 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:46:01.635857 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1cd60067-3f4c-4de1-89e1-6067eb5257d6 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:46:01.636479 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1cd60067-3f4c-4de1-89e1-6067eb5257d6 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:46:01.637406 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1cd60067-3f4c-4de1-89e1-6067eb5257d6 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:46:01.638021 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1cd60067-3f4c-4de1-89e1-6067eb5257d6 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:46:01.638677 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-1cd60067-3f4c-4de1-89e1-6067eb5257d6 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:46:02.030151 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-1cd60067-3f4c-4de1-89e1-6067eb5257d6 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8308997c446d4d80ae49b3088c380cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e516f5849f3b4442b4bbfcd62cea8605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:46:02.042284 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1cd60067-3f4c-4de1-89e1-6067eb5257d6 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf" status: 200 len: 1314 microversion: 2.1 time: 0.429051 Oct 12 13:46:02.042884 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1029/2031] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:46:01 2022] GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:46:03.065739 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a1b7c916-4d87-464a-a21b-3458a296c8d6 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:46:03.066347 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a1b7c916-4d87-464a-a21b-3458a296c8d6 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:46:03.075731 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a1b7c916-4d87-464a-a21b-3458a296c8d6 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:46:03.076292 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a1b7c916-4d87-464a-a21b-3458a296c8d6 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:46:03.076736 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a1b7c916-4d87-464a-a21b-3458a296c8d6 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:46:03.077506 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a1b7c916-4d87-464a-a21b-3458a296c8d6 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:46:03.078079 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a1b7c916-4d87-464a-a21b-3458a296c8d6 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:46:03.078561 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a1b7c916-4d87-464a-a21b-3458a296c8d6 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:46:03.240546 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-a1b7c916-4d87-464a-a21b-3458a296c8d6 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8308997c446d4d80ae49b3088c380cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e516f5849f3b4442b4bbfcd62cea8605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:46:03.251421 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a1b7c916-4d87-464a-a21b-3458a296c8d6 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf" status: 200 len: 1314 microversion: 2.1 time: 0.189471 Oct 12 13:46:03.252182 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1003/2032] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:46:03 2022] GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:46:04.280022 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6a65a069-82dd-499e-b5e4-8507704eece3 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:46:04.280781 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-6a65a069-82dd-499e-b5e4-8507704eece3 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:46:04.307520 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6a65a069-82dd-499e-b5e4-8507704eece3 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:46:04.307520 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6a65a069-82dd-499e-b5e4-8507704eece3 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:46:04.307520 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6a65a069-82dd-499e-b5e4-8507704eece3 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:46:04.307520 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6a65a069-82dd-499e-b5e4-8507704eece3 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:46:04.307520 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6a65a069-82dd-499e-b5e4-8507704eece3 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:46:04.307520 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-6a65a069-82dd-499e-b5e4-8507704eece3 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:46:04.692735 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-6a65a069-82dd-499e-b5e4-8507704eece3 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8308997c446d4d80ae49b3088c380cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e516f5849f3b4442b4bbfcd62cea8605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:46:04.705556 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6a65a069-82dd-499e-b5e4-8507704eece3 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf" status: 200 len: 1314 microversion: 2.1 time: 0.434443 Oct 12 13:46:04.719606 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1030/2033] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:46:04 2022] GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:46:05.095266 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-01a496a7-57cd-48a1-95e5-80431f0ebdc9 req-01883a62-960e-48b3-a842-39299a39d780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbfd2474-0d28-43fa-825d-4db0724dafdf", "name": "network-vif-plugged", "status": "completed", "tag": "6294e345-51e8-4e63-aaaa-7d9fff4305bb"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:46:05.109979 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-01a496a7-57cd-48a1-95e5-80431f0ebdc9 req-01883a62-960e-48b3-a842-39299a39d780 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:46:05.110474 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-01a496a7-57cd-48a1-95e5-80431f0ebdc9 req-01883a62-960e-48b3-a842-39299a39d780 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:46:05.110911 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-01a496a7-57cd-48a1-95e5-80431f0ebdc9 req-01883a62-960e-48b3-a842-39299a39d780 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:46:05.147473 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-01a496a7-57cd-48a1-95e5-80431f0ebdc9 req-01883a62-960e-48b3-a842-39299a39d780 service nova] Creating event network-vif-plugged:6294e345-51e8-4e63-aaaa-7d9fff4305bb for instance cbfd2474-0d28-43fa-825d-4db0724dafdf on n-h1-861076-2 Oct 12 13:46:05.164648 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-01a496a7-57cd-48a1-95e5-80431f0ebdc9 req-01883a62-960e-48b3-a842-39299a39d780 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.347837 Oct 12 13:46:05.174226 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1004/2034] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:46:05.739635 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-2932a354-ae0b-4484-9b52-09ec71a08fa4 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:46:05.741141 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-2932a354-ae0b-4484-9b52-09ec71a08fa4 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:46:05.877238 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2932a354-ae0b-4484-9b52-09ec71a08fa4 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:46:05.877238 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2932a354-ae0b-4484-9b52-09ec71a08fa4 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:46:05.877238 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2932a354-ae0b-4484-9b52-09ec71a08fa4 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:46:05.877238 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2932a354-ae0b-4484-9b52-09ec71a08fa4 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:46:05.877238 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2932a354-ae0b-4484-9b52-09ec71a08fa4 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:46:05.877238 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-2932a354-ae0b-4484-9b52-09ec71a08fa4 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:46:06.165418 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-2932a354-ae0b-4484-9b52-09ec71a08fa4 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8308997c446d4d80ae49b3088c380cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e516f5849f3b4442b4bbfcd62cea8605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:46:06.174768 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-2932a354-ae0b-4484-9b52-09ec71a08fa4 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf" status: 200 len: 1314 microversion: 2.1 time: 0.447774 Oct 12 13:46:06.189552 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1031/2035] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:46:05 2022] GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:46:07.200427 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-82833cfa-39d5-4c8b-86cc-d66719d5528b tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:46:07.201268 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-82833cfa-39d5-4c8b-86cc-d66719d5528b tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:46:07.216162 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-82833cfa-39d5-4c8b-86cc-d66719d5528b tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:46:07.220803 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-82833cfa-39d5-4c8b-86cc-d66719d5528b tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:46:07.220803 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-82833cfa-39d5-4c8b-86cc-d66719d5528b tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:46:07.220803 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-82833cfa-39d5-4c8b-86cc-d66719d5528b tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:46:07.220803 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-82833cfa-39d5-4c8b-86cc-d66719d5528b tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:46:07.220803 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-82833cfa-39d5-4c8b-86cc-d66719d5528b tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:46:07.819919 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-82833cfa-39d5-4c8b-86cc-d66719d5528b tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8308997c446d4d80ae49b3088c380cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e516f5849f3b4442b4bbfcd62cea8605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:46:07.854214 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-82833cfa-39d5-4c8b-86cc-d66719d5528b tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf" status: 200 len: 1464 microversion: 2.1 time: 0.658381 Oct 12 13:46:07.861106 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1005/2036] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:46:07 2022] GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf => generated 1464 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:46:07.882309 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b4bff507-2d7b-4f86-a9f2-1c670afcf265 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a16e3e1-d6e8-41c7-95ce-52a23abfcce1", "device": "/dev/sdb"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:46:07.885299 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-b4bff507-2d7b-4f86-a9f2-1c670afcf265 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:46:07.901157 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4bff507-2d7b-4f86-a9f2-1c670afcf265 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:46:07.902239 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4bff507-2d7b-4f86-a9f2-1c670afcf265 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:46:07.902944 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4bff507-2d7b-4f86-a9f2-1c670afcf265 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:46:07.903957 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4bff507-2d7b-4f86-a9f2-1c670afcf265 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:46:07.904504 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4bff507-2d7b-4f86-a9f2-1c670afcf265 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:46:07.905568 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-b4bff507-2d7b-4f86-a9f2-1c670afcf265 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:46:09.297444 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b4bff507-2d7b-4f86-a9f2-1c670afcf265 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "POST /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.418966 Oct 12 13:46:09.298569 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1032/2037] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Oct 12 13:46:07 2022] POST /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf/os-volume_attachments => generated 194 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:46:33.759019 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-22afcb19-283e-4173-921a-c6999886716b tempest-VolumesActionsTest-2026672675 tempest-VolumesActionsTest-2026672675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1231271836", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "313480eb-9a02-42b6-8203-2b962c0c53b9"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:46:33.774298 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:46:33.775657 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=46 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:46:33.776791 n-d-861076-2 devstack@n-api.service[120932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 13:46:33.777168 n-d-861076-2 devstack@n-api.service[120932]: Wed Oct 12 13:46:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 12 13:46:33.883688 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-22afcb19-283e-4173-921a-c6999886716b tempest-VolumesActionsTest-2026672675 tempest-VolumesActionsTest-2026672675-project] validate_networks() for [('313480eb-9a02-42b6-8203-2b962c0c53b9', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-22afcb19-283e-4173-921a-c6999886716b tempest-VolumesActionsTest-2026672675 tempest-VolumesActionsTest-2026672675-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2329b109-ebf6-4a1f-a6f6-577bcf56e3b8) Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:46:34.287886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:46:34.292964 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:46:34.292964 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:46:34.292964 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:46:34.292964 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:46:34.292964 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:46:34.292964 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:46:34.292964 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:46:34.292964 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:46:34.292964 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:46:34.292964 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:46:34.292964 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:46:34.292964 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:46:34.292964 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:46:34.292964 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:46:34.292964 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2329b109-ebf6-4a1f-a6f6-577bcf56e3b8) Oct 12 13:46:34.292964 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:46:34.292964 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-22afcb19-283e-4173-921a-c6999886716b tempest-VolumesActionsTest-2026672675 tempest-VolumesActionsTest-2026672675-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:46:34.292964 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-22afcb19-283e-4173-921a-c6999886716b tempest-VolumesActionsTest-2026672675 tempest-VolumesActionsTest-2026672675-project] Request method failure captured: Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 206 Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsU1jvWwqjWmxvp5cTVLg90H9dQouQ6Oj8hZ3E5iidIsRrUTAL0zcuWsSWmaB-_jUeFIZMnz0w2DrsmJlL71ExnnhgCkh9MC7AZSnr2zvdxXtH7QTVBURLXo6v-SCkdAc7lPNT9jKRnuTesOutcb7OOEtWRvagAlq6LNeqyTSPLzo7E Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: f056493347664f379cf1c3bf7623f44b Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-VolumesActionsTest-2026672675 Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f056493347664f379cf1c3bf7623f44b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f056493347664f379cf1c3bf7623f44b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f056493347664f379cf1c3bf7623f44b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f056493347664f379cf1c3bf7623f44b"}]}] Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-VolumesActionsTest-2026672675 Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: f056493347664f379cf1c3bf7623f44b Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-VolumesActionsTest-2026672675 Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-VolumesActionsTest-2026672675-project Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 38336e6573174fada63c8cba33177b76 Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-VolumesActionsTest-2026672675-project Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-VolumesActionsTest-instance-1231271836", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "313480eb-9a02-42b6-8203-2b962c0c53b9"}]}} Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-VolumesActionsTest-instance-1231271836', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '313480eb-9a02-42b6-8203-2b962c0c53b9'}]}}} Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:46:34.296352 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2329b109-ebf6-4a1f-a6f6-577bcf56e3b8) Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:46:34.299810 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:46:34.308930 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:46:34.308930 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:46:34.308930 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:46:34.308930 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:46:34.308930 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:46:34.308930 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:46:34.308930 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:46:34.308930 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:46:34.308930 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:46:34.308930 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:46:34.308930 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:46:34.308930 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:46:34.308930 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:46:34.308930 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-22afcb19-283e-4173-921a-c6999886716b tempest-VolumesActionsTest-2026672675 tempest-VolumesActionsTest-2026672675-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:46:34.308930 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:46:34.308930 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-22afcb19-283e-4173-921a-c6999886716b tempest-VolumesActionsTest-2026672675 tempest-VolumesActionsTest-2026672675-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.549690 Oct 12 13:46:34.308930 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1006/2038] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:46:33 2022] POST /compute/v2.1/servers => generated 214 bytes in 551 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:46:34.422880 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-90518b56-be6c-484b-b948-1913e2b0110f tempest-VolumesActionsTest-2026672675 tempest-VolumesActionsTest-2026672675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1393403532", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "313480eb-9a02-42b6-8203-2b962c0c53b9"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:46:34.444154 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=22 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:46:34.445566 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:46:34.548806 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-90518b56-be6c-484b-b948-1913e2b0110f tempest-VolumesActionsTest-2026672675 tempest-VolumesActionsTest-2026672675-project] validate_networks() for [('313480eb-9a02-42b6-8203-2b962c0c53b9', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-90518b56-be6c-484b-b948-1913e2b0110f tempest-VolumesActionsTest-2026672675 tempest-VolumesActionsTest-2026672675-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-33d1ac43-91f3-4eaa-aaa8-93eb2999642f) Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:46:34.898470 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-33d1ac43-91f3-4eaa-aaa8-93eb2999642f) Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-90518b56-be6c-484b-b948-1913e2b0110f tempest-VolumesActionsTest-2026672675 tempest-VolumesActionsTest-2026672675-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-90518b56-be6c-484b-b948-1913e2b0110f tempest-VolumesActionsTest-2026672675 tempest-VolumesActionsTest-2026672675-project] Request method failure captured: Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 206 Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsU1jvWwqjWmxvp5cTVLg90H9dQouQ6Oj8hZ3E5iidIsRrUTAL0zcuWsSWmaB-_jUeFIZMnz0w2DrsmJlL71ExnnhgCkh9MC7AZSnr2zvdxXtH7QTVBURLXo6v-SCkdAc7lPNT9jKRnuTesOutcb7OOEtWRvagAlq6LNeqyTSPLzo7E Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: f056493347664f379cf1c3bf7623f44b Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-VolumesActionsTest-2026672675 Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f056493347664f379cf1c3bf7623f44b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f056493347664f379cf1c3bf7623f44b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f056493347664f379cf1c3bf7623f44b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f056493347664f379cf1c3bf7623f44b"}]}] Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-VolumesActionsTest-2026672675 Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: f056493347664f379cf1c3bf7623f44b Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-VolumesActionsTest-2026672675 Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-VolumesActionsTest-2026672675-project Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 38336e6573174fada63c8cba33177b76 Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-VolumesActionsTest-2026672675-project Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-VolumesActionsTest-instance-1393403532", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "313480eb-9a02-42b6-8203-2b962c0c53b9"}]}} Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-VolumesActionsTest-instance-1393403532', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '313480eb-9a02-42b6-8203-2b962c0c53b9'}]}}} Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:46:34.911012 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:46:34.917237 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-33d1ac43-91f3-4eaa-aaa8-93eb2999642f) Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-90518b56-be6c-484b-b948-1913e2b0110f tempest-VolumesActionsTest-2026672675 tempest-VolumesActionsTest-2026672675-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-90518b56-be6c-484b-b948-1913e2b0110f tempest-VolumesActionsTest-2026672675 tempest-VolumesActionsTest-2026672675-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.485325 Oct 12 13:46:34.923839 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1033/2039] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:46:34 2022] POST /compute/v2.1/servers => generated 214 bytes in 502 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:47:32.383937 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:47:32.750111 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d16c08d2-0fb8-41ed-bdee-8a7c799081fb tempest-TestServerBasicOps-548309971 tempest-TestServerBasicOps-548309971-project] Action: 'create', calling method: .version_select at 0x7f8aa3e3b8b0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1812968005", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6vTimjJC19VM7pZm0NZclW1YXLpm08+6qw8IntCNp9yNJPmvkbpwi8KHcWTSv20k0t3vjp6337LIiHb/xCkeAgq0Ap5dcUQdg5BWvWOzHxNa1jHrdiUaQutzS3aJHnqQ=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:47:32.784072 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-d16c08d2-0fb8-41ed-bdee-8a7c799081fb tempest-TestServerBasicOps-548309971 tempest-TestServerBasicOps-548309971-project] Getting quotas for project fa862b4c24fb4be5a3ec4c2f5e9e135f. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:47:32.806289 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-d16c08d2-0fb8-41ed-bdee-8a7c799081fb tempest-TestServerBasicOps-548309971 tempest-TestServerBasicOps-548309971-project] Getting quotas for user b21dac8f90a048ebb86b95e1fb633428 and project fa862b4c24fb4be5a3ec4c2f5e9e135f. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:47:32.927958 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d16c08d2-0fb8-41ed-bdee-8a7c799081fb tempest-TestServerBasicOps-548309971 tempest-TestServerBasicOps-548309971-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.545415 Oct 12 13:47:32.928574 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1007/2040] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:47:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:47:37.854419 n-d-861076-2 devstack@n-api.service[120933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 13:47:37.855010 n-d-861076-2 devstack@n-api.service[120933]: Wed Oct 12 13:47:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 12 13:47:37.857066 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:47:37.870972 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-70e1e87d-4be1-4ecf-9e30-013c582fdbec tempest-TestServerBasicOps-548309971 tempest-TestServerBasicOps-548309971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-355942786", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1812968005", "security_groups": [{"name": "tempest-secgroup-smoke-1443645739"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "2aa33b80-f89d-47db-848f-eefedba5f9e0"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:47:38.426315 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-70e1e87d-4be1-4ecf-9e30-013c582fdbec tempest-TestServerBasicOps-548309971 tempest-TestServerBasicOps-548309971-project] validate_networks() for [('2aa33b80-f89d-47db-848f-eefedba5f9e0', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-70e1e87d-4be1-4ecf-9e30-013c582fdbec tempest-TestServerBasicOps-548309971 tempest-TestServerBasicOps-548309971-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d58e03bb-45c9-4d9e-afa0-a9dc6de8beba) Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:47:38.706124 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:47:38.709479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:47:38.709479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:47:38.709479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:47:38.709479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:47:38.709479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:47:38.709479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:47:38.709479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:47:38.709479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:47:38.709479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:47:38.709479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:47:38.709479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:47:38.709479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:47:38.709479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:47:38.709479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:47:38.709479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d58e03bb-45c9-4d9e-afa0-a9dc6de8beba) Oct 12 13:47:38.709479 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:47:38.709479 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-70e1e87d-4be1-4ecf-9e30-013c582fdbec tempest-TestServerBasicOps-548309971 tempest-TestServerBasicOps-548309971-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:47:38.709479 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-70e1e87d-4be1-4ecf-9e30-013c582fdbec tempest-TestServerBasicOps-548309971 tempest-TestServerBasicOps-548309971-project] Request method failure captured: Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 414 Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsVmhV8WyW_Fv4YyxrvulA8JWTUVB1hpwvjwhXmKFEoGJBi5kMnIS2UiUOhdoAcBq-m_mjpcIoO5qGcCwEVJcH3xd-o7AXp5TR6H0pM4R-uhSlylDyhN6gPgr8rF8XTrvuZzYwIbfJPfzhGdXlL7vZCMmxkMeqqZHuQXBzClUQ5G35w Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: fa862b4c24fb4be5a3ec4c2f5e9e135f Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-TestServerBasicOps-548309971 Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fa862b4c24fb4be5a3ec4c2f5e9e135f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fa862b4c24fb4be5a3ec4c2f5e9e135f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fa862b4c24fb4be5a3ec4c2f5e9e135f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fa862b4c24fb4be5a3ec4c2f5e9e135f"}]}] Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-TestServerBasicOps-548309971 Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: fa862b4c24fb4be5a3ec4c2f5e9e135f Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-TestServerBasicOps-548309971 Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-TestServerBasicOps-548309971-project Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: b21dac8f90a048ebb86b95e1fb633428 Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-TestServerBasicOps-548309971-project Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-TestServerBasicOps-server-355942786", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1812968005", "security_groups": [{"name": "tempest-secgroup-smoke-1443645739"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "2aa33b80-f89d-47db-848f-eefedba5f9e0"}]}} Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-TestServerBasicOps-server-355942786', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'key_name': 'tempest-TestServerBasicOps-1812968005', 'security_groups': [{'name': 'tempest-secgroup-smoke-1443645739'}], 'config_drive': True, 'metadata': {'meta1': 'data1', 'meta2': 'data2', 'metaN': 'dataN'}, 'networks': [{'uuid': '2aa33b80-f89d-47db-848f-eefedba5f9e0'}]}}} Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:47:38.710559 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d58e03bb-45c9-4d9e-afa0-a9dc6de8beba) Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:47:38.716736 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:47:38.721159 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:47:38.721159 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:47:38.721159 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:47:38.721159 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:47:38.721159 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:47:38.721159 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:47:38.721159 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:47:38.721159 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:47:38.721159 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:47:38.721159 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:47:38.721159 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:47:38.721159 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:47:38.721159 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:47:38.721159 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:47:38.721159 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:47:38.721159 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:47:38.721159 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:47:38.721159 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-70e1e87d-4be1-4ecf-9e30-013c582fdbec tempest-TestServerBasicOps-548309971 tempest-TestServerBasicOps-548309971-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:47:38.721159 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:47:38.721159 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-70e1e87d-4be1-4ecf-9e30-013c582fdbec tempest-TestServerBasicOps-548309971 tempest-TestServerBasicOps-548309971-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.858858 Oct 12 13:47:38.721159 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1034/2041] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:47:37 2022] POST /compute/v2.1/servers => generated 214 bytes in 864 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:47:39.272533 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9ed98419-604a-40c2-9b71-f0f61ae2c4db tempest-TestServerBasicOps-548309971 tempest-TestServerBasicOps-548309971-project] Calling method '.version_select at 0x7f8a9b68e5e0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:47:39.445633 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9ed98419-604a-40c2-9b71-f0f61ae2c4db tempest-TestServerBasicOps-548309971 tempest-TestServerBasicOps-548309971-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1812968005" status: 202 len: 0 microversion: 2.1 time: 0.177918 Oct 12 13:47:39.446224 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1008/2042] 10.222.0.52 () {58 vars in 1254 bytes} [Wed Oct 12 13:47:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1812968005 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:48:10.790511 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:48:10.795190 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c01889ce-f699-48ba-ad09-626cc81f99d3 tempest-TestVolumeBackupRestore-1813459990 tempest-TestVolumeBackupRestore-1813459990-project] Action: 'create', calling method: .version_select at 0x7f8a9b8e9f70>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2071268319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFP132LcauXxzprjp7JuQkCewvTLf1wjAu9AY2Sg0msn0a4D1CiSx3NND5vc9QAngUIpDjKbyyOjxJUI81wfEbVlhIKLDIibVkcQz1aBlYFXIuqnHWYBHLPRYe8GRpbUYw=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:48:10.856280 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-c01889ce-f699-48ba-ad09-626cc81f99d3 tempest-TestVolumeBackupRestore-1813459990 tempest-TestVolumeBackupRestore-1813459990-project] Getting quotas for project 1113d40d88e54b1faaad5adbeea338f7. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:48:10.884733 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-c01889ce-f699-48ba-ad09-626cc81f99d3 tempest-TestVolumeBackupRestore-1813459990 tempest-TestVolumeBackupRestore-1813459990-project] Getting quotas for user 52548073c9ba46ab806cb9f8bb0bc729 and project 1113d40d88e54b1faaad5adbeea338f7. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:48:11.027670 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c01889ce-f699-48ba-ad09-626cc81f99d3 tempest-TestVolumeBackupRestore-1813459990 tempest-TestVolumeBackupRestore-1813459990-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.239173 Oct 12 13:48:11.028533 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1035/2043] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:48:10 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:48:16.892100 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8d3f3aa3-946b-48cc-92c3-473dc4875814 tempest-TestVolumeBackupRestore-1813459990 tempest-TestVolumeBackupRestore-1813459990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1770258530", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d146b644-fe43-4b6d-8c9e-a897637417e8", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2071268319", "security_groups": [{"name": "tempest-secgroup-smoke-705430963"}], "networks": [{"uuid": "e6191600-78c9-46a9-8964-7c3a34f7571b"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:48:16.905289 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:48:16.935110 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:48:17.200475 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-8d3f3aa3-946b-48cc-92c3-473dc4875814 tempest-TestVolumeBackupRestore-1813459990 tempest-TestVolumeBackupRestore-1813459990-project] validate_networks() for [('e6191600-78c9-46a9-8964-7c3a34f7571b', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-8d3f3aa3-946b-48cc-92c3-473dc4875814 tempest-TestVolumeBackupRestore-1813459990 tempest-TestVolumeBackupRestore-1813459990-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5980ea27-bce3-4103-8cb7-ed78f6364903) Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:48:17.833870 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:48:17.837577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:48:17.837577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:48:17.837577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:48:17.837577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:48:17.837577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:48:17.837577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:48:17.837577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:48:17.837577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:48:17.837577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:48:17.837577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:48:17.837577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:48:17.837577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:48:17.837577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:48:17.837577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:48:17.837577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:48:17.837577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5980ea27-bce3-4103-8cb7-ed78f6364903) Oct 12 13:48:17.837577 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:48:17.839749 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-8d3f3aa3-946b-48cc-92c3-473dc4875814 tempest-TestVolumeBackupRestore-1813459990 tempest-TestVolumeBackupRestore-1813459990-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:48:17.839749 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8d3f3aa3-946b-48cc-92c3-473dc4875814 tempest-TestVolumeBackupRestore-1813459990 tempest-TestVolumeBackupRestore-1813459990-project] Request method failure captured: Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 449 Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsRrQASzov7XZXGiFEs1uXGv1GB5cCRL7Di2BPo0fLDkQY7IBKtgsyPeR7zWkmE_YUyCJfbvVw-j_Ze0AfU9YpLx6oXkBSTpe0AT5rrWFxls5F_ElnW5rtwYxRZ2tKtExAibYWpmEXL-o2Q9WSKxQYIyiaAd1YHZPn3EjY_Feszsdas Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 1113d40d88e54b1faaad5adbeea338f7 Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-TestVolumeBackupRestore-1813459990 Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1113d40d88e54b1faaad5adbeea338f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1113d40d88e54b1faaad5adbeea338f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1113d40d88e54b1faaad5adbeea338f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1113d40d88e54b1faaad5adbeea338f7"}]}] Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-TestVolumeBackupRestore-1813459990 Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 1113d40d88e54b1faaad5adbeea338f7 Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1813459990 Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-TestVolumeBackupRestore-1813459990-project Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 52548073c9ba46ab806cb9f8bb0bc729 Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-TestVolumeBackupRestore-1813459990-project Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1770258530", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d146b644-fe43-4b6d-8c9e-a897637417e8", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2071268319", "security_groups": [{"name": "tempest-secgroup-smoke-705430963"}], "networks": [{"uuid": "e6191600-78c9-46a9-8964-7c3a34f7571b"}]}} Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBackupRestore-server-1770258530', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'volume_id': 'd146b644-fe43-4b6d-8c9e-a897637417e8', 'delete_on_termination': False}], 'key_name': 'tempest-TestVolumeBackupRestore-2071268319', 'security_groups': [{'name': 'tempest-secgroup-smoke-705430963'}], 'networks': [{'uuid': 'e6191600-78c9-46a9-8964-7c3a34f7571b'}]}}} Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:48:17.849784 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5980ea27-bce3-4103-8cb7-ed78f6364903) Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:48:17.858265 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:48:17.862720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:48:17.862720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:48:17.862720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:48:17.862720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:48:17.862720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:48:17.862720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:48:17.862720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:48:17.862720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:48:17.862720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:48:17.862720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:48:17.862720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:48:17.862720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:48:17.862720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:48:17.862720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:48:17.862720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:48:17.862720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:48:17.862720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:48:17.862720 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:48:17.862720 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8d3f3aa3-946b-48cc-92c3-473dc4875814 tempest-TestVolumeBackupRestore-1813459990 tempest-TestVolumeBackupRestore-1813459990-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:48:17.862720 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:48:17.862720 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8d3f3aa3-946b-48cc-92c3-473dc4875814 tempest-TestVolumeBackupRestore-1813459990 tempest-TestVolumeBackupRestore-1813459990-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.965738 Oct 12 13:48:17.865710 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1009/2044] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:48:16 2022] POST /compute/v2.1/servers => generated 214 bytes in 979 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:48:18.746769 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0969231f-dd04-44a8-9ef0-e6dbcd96f6d3 tempest-TestVolumeBackupRestore-1813459990 tempest-TestVolumeBackupRestore-1813459990-project] Calling method '.version_select at 0x7f8a9baf2040>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:48:18.902998 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0969231f-dd04-44a8-9ef0-e6dbcd96f6d3 tempest-TestVolumeBackupRestore-1813459990 tempest-TestVolumeBackupRestore-1813459990-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2071268319" status: 202 len: 0 microversion: 2.1 time: 0.170641 Oct 12 13:48:18.903932 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1036/2045] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 12 13:48:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2071268319 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:48:24.615860 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-df6a23dd-e996-4812-9f0a-d8c84daf31fa tempest-TestServerMultinode-32667750 tempest-TestServerMultinode-32667750-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:48:24.628794 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-df6a23dd-e996-4812-9f0a-d8c84daf31fa tempest-TestServerMultinode-32667750 tempest-TestServerMultinode-32667750-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:48:24.629414 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-df6a23dd-e996-4812-9f0a-d8c84daf31fa tempest-TestServerMultinode-32667750 tempest-TestServerMultinode-32667750-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:48:24.632171 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-df6a23dd-e996-4812-9f0a-d8c84daf31fa tempest-TestServerMultinode-32667750 tempest-TestServerMultinode-32667750-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:48:24.634159 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-df6a23dd-e996-4812-9f0a-d8c84daf31fa tempest-TestServerMultinode-32667750 tempest-TestServerMultinode-32667750-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:48:24.634635 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-df6a23dd-e996-4812-9f0a-d8c84daf31fa tempest-TestServerMultinode-32667750 tempest-TestServerMultinode-32667750-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:48:24.637547 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-df6a23dd-e996-4812-9f0a-d8c84daf31fa tempest-TestServerMultinode-32667750 tempest-TestServerMultinode-32667750-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:48:24.696622 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-df6a23dd-e996-4812-9f0a-d8c84daf31fa tempest-TestServerMultinode-32667750 tempest-TestServerMultinode-32667750-project-admin] 10.222.0.52 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.412591 Oct 12 13:48:24.697620 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1010/2046] 10.222.0.52 () {58 vars in 1185 bytes} [Wed Oct 12 13:48:24 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:48:24.952391 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c0febc56-6e0a-4628-bde9-81a8f158830a tempest-TestServerMultinode-32667750 tempest-TestServerMultinode-32667750-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-58305495", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "availability_zone": "nova:n-h1-861076-2", "networks": [{"uuid": "1d274de4-3930-4181-91f6-82b71c153765"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:48:24.990238 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:48:25.735067 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-c0febc56-6e0a-4628-bde9-81a8f158830a tempest-TestServerMultinode-32667750 tempest-TestServerMultinode-32667750-project-admin] validate_networks() for [('1d274de4-3930-4181-91f6-82b71c153765', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-c0febc56-6e0a-4628-bde9-81a8f158830a tempest-TestServerMultinode-32667750 tempest-TestServerMultinode-32667750-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c141ec70-de2f-4650-9433-cabefc31dc7b) Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:48:27.369407 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:48:27.373812 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:48:27.373812 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:48:27.373812 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:48:27.373812 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:48:27.373812 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:48:27.373812 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:48:27.373812 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:48:27.373812 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:48:27.373812 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:48:27.373812 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:48:27.373812 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:48:27.373812 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:48:27.373812 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:48:27.373812 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:48:27.373812 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c141ec70-de2f-4650-9433-cabefc31dc7b) Oct 12 13:48:27.373812 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:48:27.375789 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-c0febc56-6e0a-4628-bde9-81a8f158830a tempest-TestServerMultinode-32667750 tempest-TestServerMultinode-32667750-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:48:27.375789 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c0febc56-6e0a-4628-bde9-81a8f158830a tempest-TestServerMultinode-32667750 tempest-TestServerMultinode-32667750-project-admin] Request method failure captured: Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 246 Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsWoJTaG98lwencdEfuDrTI0n5OBm7ZM4G6ta4XTv6UWW-356ggtprrnP5-xVIl8dq3-WztehDRMgK574TfydTUj_wtF4xqOOzxCEDu8yB2kz0gVZYNB3CB_-65FVbRL4Yt5Owskpl4u6axJK4c-nFaUOruGaaUzVjNywPTF6IDEve8 Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 2cfa2423a0164d33b63502e70e46dd8a Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-TestServerMultinode-32667750 Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2cfa2423a0164d33b63502e70e46dd8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2cfa2423a0164d33b63502e70e46dd8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2cfa2423a0164d33b63502e70e46dd8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2cfa2423a0164d33b63502e70e46dd8a"}]}] Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-TestServerMultinode-32667750 Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 2cfa2423a0164d33b63502e70e46dd8a Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-TestServerMultinode-32667750 Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-TestServerMultinode-32667750-project-admin Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: eadf673043ac4ca49b63f63577886976 Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-TestServerMultinode-32667750-project-admin Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-TestServerMultinode-server-58305495", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "availability_zone": "nova:n-h1-861076-2", "networks": [{"uuid": "1d274de4-3930-4181-91f6-82b71c153765"}]}} Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-TestServerMultinode-server-58305495', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '1d274de4-3930-4181-91f6-82b71c153765'}]}}} Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:48:27.378362 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c141ec70-de2f-4650-9433-cabefc31dc7b) Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:48:27.383545 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:48:27.388802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:48:27.388802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:48:27.388802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:48:27.388802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:48:27.388802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:48:27.388802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:48:27.388802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:48:27.388802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:48:27.388802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:48:27.388802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:48:27.388802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:48:27.388802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:48:27.388802 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:48:27.388802 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c0febc56-6e0a-4628-bde9-81a8f158830a tempest-TestServerMultinode-32667750 tempest-TestServerMultinode-32667750-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:48:27.388802 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:48:27.391039 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c0febc56-6e0a-4628-bde9-81a8f158830a tempest-TestServerMultinode-32667750 tempest-TestServerMultinode-32667750-project-admin] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.443447 Oct 12 13:48:27.391798 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1037/2047] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:48:24 2022] POST /compute/v2.1/servers => generated 214 bytes in 2445 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:48:57.526497 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:48:57.527237 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:48:57.527921 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=8 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:48:57.694551 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-dd989b82-63b9-4127-8b06-9d42cce73339 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Action: 'create', calling method: .version_select at 0x7f8a9be70550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-248354700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIOVhlH4fMYGY/gfnDoWXL6o3AqZSCqLMC5d3Jz+qfYtT/Q2mib7KKCzIfqbKbU7JEyJ1VL6qYoaemk2xySHMVZCo88PdYVblHvKndDQ93laUNIjDjbYmZlRrcR26ENqg=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:48:57.711095 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-dd989b82-63b9-4127-8b06-9d42cce73339 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Getting quotas for project e35b8ba339f2443fb9a0291f93bdff9c. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:48:57.717009 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-dd989b82-63b9-4127-8b06-9d42cce73339 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Getting quotas for user b0f9349e8ff047b69858fdd75989f145 and project e35b8ba339f2443fb9a0291f93bdff9c. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:48:57.848793 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-dd989b82-63b9-4127-8b06-9d42cce73339 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.326978 Oct 12 13:48:57.849574 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1011/2048] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:48:57 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:49:01.867591 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:49:01.874148 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-dd8c59c5-2fa6-40b6-901b-fe29bfce3ea3 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:49:01.874787 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-dd8c59c5-2fa6-40b6-901b-fe29bfce3ea3 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:49:01.881406 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dd8c59c5-2fa6-40b6-901b-fe29bfce3ea3 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:49:01.890195 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dd8c59c5-2fa6-40b6-901b-fe29bfce3ea3 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:49:01.890668 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dd8c59c5-2fa6-40b6-901b-fe29bfce3ea3 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:49:01.891428 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dd8c59c5-2fa6-40b6-901b-fe29bfce3ea3 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:49:01.891896 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dd8c59c5-2fa6-40b6-901b-fe29bfce3ea3 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:49:01.892327 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-dd8c59c5-2fa6-40b6-901b-fe29bfce3ea3 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:49:02.038825 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-dd8c59c5-2fa6-40b6-901b-fe29bfce3ea3 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lazy-loading 'services' on Instance uuid cbfd2474-0d28-43fa-825d-4db0724dafdf {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:49:02.269964 n-d-861076-2 devstack@n-api.service[120933]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dd8c59c5-2fa6-40b6-901b-fe29bfce3ea3 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [67293d3e-a57b-4e6e-9d55-2ca575ffc5f6] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 13:49:03.277615 n-d-861076-2 devstack@n-api.service[120933]: INFO oslo.messaging._drivers.impl_rabbit [None req-dd8c59c5-2fa6-40b6-901b-fe29bfce3ea3 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [67293d3e-a57b-4e6e-9d55-2ca575ffc5f6] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 58042. Oct 12 13:49:03.282340 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-dd8c59c5-2fa6-40b6-901b-fe29bfce3ea3 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf/os-volume_attachments/0a16e3e1-d6e8-41c7-95ce-52a23abfcce1" status: 202 len: 0 microversion: 2.1 time: 1.415720 Oct 12 13:49:03.283250 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1038/2049] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Oct 12 13:49:01 2022] DELETE /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf/os-volume_attachments/0a16e3e1-d6e8-41c7-95ce-52a23abfcce1 => generated 0 bytes in 1418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:49:07.679235 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-91335278-3a9d-4779-b714-8564b16e2e3c tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1939406601", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "44244765-33b6-4734-9e86-6607ccedacdc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-248354700", "security_groups": [{"name": "tempest-secgroup-smoke-817654675"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:49:07.733701 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:49:07.822407 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-91335278-3a9d-4779-b714-8564b16e2e3c tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] validate_networks() for [('44244765-33b6-4734-9e86-6607ccedacdc', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-91335278-3a9d-4779-b714-8564b16e2e3c tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d8ca8448-5eaf-41d8-b9cd-32446be8d9d7) Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:49:08.142684 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d8ca8448-5eaf-41d8-b9cd-32446be8d9d7) Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-91335278-3a9d-4779-b714-8564b16e2e3c tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-91335278-3a9d-4779-b714-8564b16e2e3c tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Request method failure captured: Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 343 Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsXIzhXbPGZNe6bdQ1Ka1lArBq7fzN7FLH0M7fc2c8ZK4ap_zp3H3kQcoatN-ETIwsPhHmJ8hqukk98Bqe7Y4WQ-f79F0xdFVxnr9YVAnCNfhGqoddU13FdMxn4dL-2wzl3x-afZQA9cgcXCzNTkbSkxWMRwcp2JbRyiEM9dl4j35h4 Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: e35b8ba339f2443fb9a0291f93bdff9c Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1503045648 Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e35b8ba339f2443fb9a0291f93bdff9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e35b8ba339f2443fb9a0291f93bdff9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e35b8ba339f2443fb9a0291f93bdff9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e35b8ba339f2443fb9a0291f93bdff9c"}]}] Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1503045648 Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: e35b8ba339f2443fb9a0291f93bdff9c Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1503045648 Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-TestNetworkAdvancedServerOps-1503045648-project Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: b0f9349e8ff047b69858fdd75989f145 Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1503045648-project Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1939406601", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "44244765-33b6-4734-9e86-6607ccedacdc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-248354700", "security_groups": [{"name": "tempest-secgroup-smoke-817654675"}]}} Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:49:08.153188 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1939406601', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '44244765-33b6-4734-9e86-6607ccedacdc'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-248354700', 'security_groups': [{'name': 'tempest-secgroup-smoke-817654675'}]}}} Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:49:08.159159 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d8ca8448-5eaf-41d8-b9cd-32446be8d9d7) Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-91335278-3a9d-4779-b714-8564b16e2e3c tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-91335278-3a9d-4779-b714-8564b16e2e3c tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.473343 Oct 12 13:49:08.173579 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1012/2050] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:49:07 2022] POST /compute/v2.1/servers => generated 214 bytes in 482 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 12 13:49:09.676454 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-42909a44-e5ee-4b6f-9154-20e7142ef5a2 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:49:09.677174 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-42909a44-e5ee-4b6f-9154-20e7142ef5a2 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:49:09.698384 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42909a44-e5ee-4b6f-9154-20e7142ef5a2 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:49:09.699153 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42909a44-e5ee-4b6f-9154-20e7142ef5a2 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:49:09.699794 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42909a44-e5ee-4b6f-9154-20e7142ef5a2 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:49:09.701016 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42909a44-e5ee-4b6f-9154-20e7142ef5a2 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:49:09.701682 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42909a44-e5ee-4b6f-9154-20e7142ef5a2 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:49:09.702180 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-42909a44-e5ee-4b6f-9154-20e7142ef5a2 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:49:09.774820 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-42909a44-e5ee-4b6f-9154-20e7142ef5a2 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Going to try to terminate instance {{(pid=120933) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:49:10.152873 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-42909a44-e5ee-4b6f-9154-20e7142ef5a2 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf" status: 204 len: 0 microversion: 2.1 time: 0.480759 Oct 12 13:49:10.153409 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1039/2051] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:49:09 2022] DELETE /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:49:10.164686 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-12b203b3-0688-4893-b29a-f3ef98291764 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:49:10.166341 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-12b203b3-0688-4893-b29a-f3ef98291764 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:49:10.178907 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-12b203b3-0688-4893-b29a-f3ef98291764 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:49:10.179406 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-12b203b3-0688-4893-b29a-f3ef98291764 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:49:10.179847 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-12b203b3-0688-4893-b29a-f3ef98291764 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:49:10.180562 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-12b203b3-0688-4893-b29a-f3ef98291764 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:49:10.181053 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-12b203b3-0688-4893-b29a-f3ef98291764 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:49:10.181482 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-12b203b3-0688-4893-b29a-f3ef98291764 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:49:10.489931 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-12b203b3-0688-4893-b29a-f3ef98291764 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8308997c446d4d80ae49b3088c380cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e516f5849f3b4442b4bbfcd62cea8605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:49:10.502328 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-12b203b3-0688-4893-b29a-f3ef98291764 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf" status: 200 len: 1470 microversion: 2.1 time: 0.344204 Oct 12 13:49:10.503550 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1013/2052] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:49:10 2022] GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf => generated 1470 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:49:11.527365 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9beb555b-eead-4e1c-9ae3-12bfabfbd95f tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:49:11.528072 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-9beb555b-eead-4e1c-9ae3-12bfabfbd95f tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:49:11.547837 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9beb555b-eead-4e1c-9ae3-12bfabfbd95f tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:49:11.548337 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9beb555b-eead-4e1c-9ae3-12bfabfbd95f tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:49:11.549154 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9beb555b-eead-4e1c-9ae3-12bfabfbd95f tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:49:11.550296 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9beb555b-eead-4e1c-9ae3-12bfabfbd95f tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:49:11.551444 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9beb555b-eead-4e1c-9ae3-12bfabfbd95f tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:49:11.551827 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9beb555b-eead-4e1c-9ae3-12bfabfbd95f tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:49:11.970236 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-9beb555b-eead-4e1c-9ae3-12bfabfbd95f tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8308997c446d4d80ae49b3088c380cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e516f5849f3b4442b4bbfcd62cea8605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:49:11.983444 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9beb555b-eead-4e1c-9ae3-12bfabfbd95f tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf" status: 200 len: 1470 microversion: 2.1 time: 0.460144 Oct 12 13:49:11.986972 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1040/2053] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:49:11 2022] GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf => generated 1470 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:49:12.527259 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-16815e3c-af28-4551-b4d0-8c9b4e54339c req-374c961c-f6bb-4247-9ea2-57d7eeaa8c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbfd2474-0d28-43fa-825d-4db0724dafdf", "name": "network-vif-deleted", "tag": "6294e345-51e8-4e63-aaaa-7d9fff4305bb"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:49:12.542831 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-16815e3c-af28-4551-b4d0-8c9b4e54339c req-374c961c-f6bb-4247-9ea2-57d7eeaa8c8f service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:49:12.543567 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-16815e3c-af28-4551-b4d0-8c9b4e54339c req-374c961c-f6bb-4247-9ea2-57d7eeaa8c8f service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:49:12.544216 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-16815e3c-af28-4551-b4d0-8c9b4e54339c req-374c961c-f6bb-4247-9ea2-57d7eeaa8c8f service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:49:12.558032 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-16815e3c-af28-4551-b4d0-8c9b4e54339c req-374c961c-f6bb-4247-9ea2-57d7eeaa8c8f service nova] Creating event network-vif-deleted:6294e345-51e8-4e63-aaaa-7d9fff4305bb for instance cbfd2474-0d28-43fa-825d-4db0724dafdf on n-h1-861076-2 Oct 12 13:49:12.564687 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-16815e3c-af28-4551-b4d0-8c9b4e54339c req-374c961c-f6bb-4247-9ea2-57d7eeaa8c8f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041160 Oct 12 13:49:12.566085 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1014/2054] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:49:13.007677 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ea9fffc1-dc6e-49c0-ad78-f16ebfd4161a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:49:13.008836 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-ea9fffc1-dc6e-49c0-ad78-f16ebfd4161a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:49:13.016191 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ea9fffc1-dc6e-49c0-ad78-f16ebfd4161a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:49:13.016978 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ea9fffc1-dc6e-49c0-ad78-f16ebfd4161a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:49:13.017627 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ea9fffc1-dc6e-49c0-ad78-f16ebfd4161a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:49:13.018555 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ea9fffc1-dc6e-49c0-ad78-f16ebfd4161a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:49:13.019242 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ea9fffc1-dc6e-49c0-ad78-f16ebfd4161a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:49:13.019948 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ea9fffc1-dc6e-49c0-ad78-f16ebfd4161a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:49:13.063103 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ea9fffc1-dc6e-49c0-ad78-f16ebfd4161a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:49:13.063586 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ea9fffc1-dc6e-49c0-ad78-f16ebfd4161a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:49:13.064025 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-ea9fffc1-dc6e-49c0-ad78-f16ebfd4161a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:49:13.064479 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-ea9fffc1-dc6e-49c0-ad78-f16ebfd4161a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lazy-loading 'fault' on Instance uuid cbfd2474-0d28-43fa-825d-4db0724dafdf {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:49:13.132510 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-ea9fffc1-dc6e-49c0-ad78-f16ebfd4161a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8308997c446d4d80ae49b3088c380cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e516f5849f3b4442b4bbfcd62cea8605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:49:13.140775 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ea9fffc1-dc6e-49c0-ad78-f16ebfd4161a tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf" status: 200 len: 1304 microversion: 2.1 time: 0.137033 Oct 12 13:49:13.142876 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1041/2055] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:49:13 2022] GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf => generated 1304 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:49:13.524387 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e9d345af-2467-47fd-b5c7-2b997d9e96cc tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Calling method '.version_select at 0x7f8a9b9353a0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:49:13.646019 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e9d345af-2467-47fd-b5c7-2b997d9e96cc tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-248354700" status: 202 len: 0 microversion: 2.1 time: 0.126335 Oct 12 13:49:13.646706 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1015/2056] 10.222.0.52 () {58 vars in 1281 bytes} [Wed Oct 12 13:49:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-248354700 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:49:13.659956 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-b8e47e9e-9ca0-4429-86ec-30a3e81d830c tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Action: 'create', calling method: .version_select at 0x7f8a9baf2c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1149697857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYo6Ls9amOIchhDgdKyCDI4ItkUk1VuCXB1DffJBF20GakA9PLCvh9NrhHLZSdq9dOCrEcmggkStgoGB2S47BSi4hZu/e8luFUVUeoJQrevXXEjgR1BWAST/SQhID9Buw=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:49:13.676753 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-b8e47e9e-9ca0-4429-86ec-30a3e81d830c tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Getting quotas for project e35b8ba339f2443fb9a0291f93bdff9c. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:49:13.683243 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-b8e47e9e-9ca0-4429-86ec-30a3e81d830c tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Getting quotas for user b0f9349e8ff047b69858fdd75989f145 and project e35b8ba339f2443fb9a0291f93bdff9c. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:49:13.777405 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-b8e47e9e-9ca0-4429-86ec-30a3e81d830c tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.121233 Oct 12 13:49:13.778065 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1042/2057] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:49:13 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:49:14.165400 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b3b8cb4e-ea87-45ee-9222-8c3fc5626500 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:49:14.166201 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b3b8cb4e-ea87-45ee-9222-8c3fc5626500 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] [instance: cbfd2474-0d28-43fa-825d-4db0724dafdf] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:49:14.172887 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3b8cb4e-ea87-45ee-9222-8c3fc5626500 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:49:14.173401 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3b8cb4e-ea87-45ee-9222-8c3fc5626500 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:49:14.173833 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3b8cb4e-ea87-45ee-9222-8c3fc5626500 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:49:14.174522 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3b8cb4e-ea87-45ee-9222-8c3fc5626500 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:49:14.174971 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3b8cb4e-ea87-45ee-9222-8c3fc5626500 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:49:14.175392 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3b8cb4e-ea87-45ee-9222-8c3fc5626500 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:49:14.189354 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-b3b8cb4e-ea87-45ee-9222-8c3fc5626500 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] HTTP exception thrown: Instance cbfd2474-0d28-43fa-825d-4db0724dafdf could not be found. Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b3b8cb4e-ea87-45ee-9222-8c3fc5626500 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Request method failure captured: Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf HTTP/1.1 Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsUEffIfKUgCDvT7XwavbK1EIleUY7xCsLr1FTe-bQHZnidH0-IwDXAacAEM1exIAtQ5JrMi2h3v4VhukqbOxRx4q2xA_0OikHFmzGwz519tMPFfAC3_iIiTJU9Bx9AQi02T13urhAYR0xw7WPH52CuQf-jKnR-z77iZIzNO1-jnYt8 Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: e516f5849f3b4442b4bbfcd62cea8605 Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-VolumesBackupsTest-2073789940 Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e516f5849f3b4442b4bbfcd62cea8605"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e516f5849f3b4442b4bbfcd62cea8605"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e516f5849f3b4442b4bbfcd62cea8605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e516f5849f3b4442b4bbfcd62cea8605"}]}] Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-VolumesBackupsTest-2073789940 Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: e516f5849f3b4442b4bbfcd62cea8605 Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-VolumesBackupsTest-2073789940 Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-VolumesBackupsTest-2073789940-project Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 8308997c446d4d80ae49b3088c380cc1 Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-VolumesBackupsTest-2073789940-project Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance cbfd2474-0d28-43fa-825d-4db0724dafdf could not be found. Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'cbfd2474-0d28-43fa-825d-4db0724dafdf'} Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbfd2474-0d28-43fa-825d-4db0724dafdf could not be found. Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbfd2474-0d28-43fa-825d-4db0724dafdf could not be found. Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:49:14.191091 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:49:14.195975 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:49:14.195975 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:49:14.195975 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:49:14.195975 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:49:14.195975 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:49:14.195975 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbfd2474-0d28-43fa-825d-4db0724dafdf could not be found. Oct 12 13:49:14.195975 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:49:14.195975 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b3b8cb4e-ea87-45ee-9222-8c3fc5626500 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] Returning 404 to user: Instance cbfd2474-0d28-43fa-825d-4db0724dafdf could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:49:14.195975 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b3b8cb4e-ea87-45ee-9222-8c3fc5626500 tempest-VolumesBackupsTest-2073789940 tempest-VolumesBackupsTest-2073789940-project] 10.222.0.52 "GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf" status: 404 len: 111 microversion: 2.1 time: 0.031470 Oct 12 13:49:14.195975 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1016/2058] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:49:14 2022] GET /compute/v2.1/servers/cbfd2474-0d28-43fa-825d-4db0724dafdf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:49:23.385233 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fc28e992-5ea4-47e2-9b86-a4490c12aa40 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1202739761", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "90e9c11c-f44a-4fd6-be20-0f8df16ed16f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1149697857", "security_groups": [{"name": "tempest-secgroup-smoke-664738423"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:49:23.421694 n-d-861076-2 devstack@n-api.service[120933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 13:49:23.422081 n-d-861076-2 devstack@n-api.service[120933]: Wed Oct 12 13:49:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 12 13:49:23.423958 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:49:23.547285 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-fc28e992-5ea4-47e2-9b86-a4490c12aa40 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] validate_networks() for [('90e9c11c-f44a-4fd6-be20-0f8df16ed16f', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:49:23.690764 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-fc28e992-5ea4-47e2-9b86-a4490c12aa40 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-14bbda3e-d750-45b7-80ff-065925a07869) Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:49:23.815178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-14bbda3e-d750-45b7-80ff-065925a07869) Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-fc28e992-5ea4-47e2-9b86-a4490c12aa40 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fc28e992-5ea4-47e2-9b86-a4490c12aa40 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Request method failure captured: Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 344 Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsXIzhXbPGZNe6bdQ1Ka1lArBq7fzN7FLH0M7fc2c8ZK4ap_zp3H3kQcoatN-ETIwsPhHmJ8hqukk98Bqe7Y4WQ-f79F0xdFVxnr9YVAnCNfhGqoddU13FdMxn4dL-2wzl3x-afZQA9cgcXCzNTkbSkxWMRwcp2JbRyiEM9dl4j35h4 Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: e35b8ba339f2443fb9a0291f93bdff9c Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1503045648 Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e35b8ba339f2443fb9a0291f93bdff9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e35b8ba339f2443fb9a0291f93bdff9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e35b8ba339f2443fb9a0291f93bdff9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e35b8ba339f2443fb9a0291f93bdff9c"}]}] Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1503045648 Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: e35b8ba339f2443fb9a0291f93bdff9c Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1503045648 Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-TestNetworkAdvancedServerOps-1503045648-project Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: b0f9349e8ff047b69858fdd75989f145 Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1503045648-project Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1202739761", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "90e9c11c-f44a-4fd6-be20-0f8df16ed16f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1149697857", "security_groups": [{"name": "tempest-secgroup-smoke-664738423"}]}} Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:49:23.818484 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1202739761', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '90e9c11c-f44a-4fd6-be20-0f8df16ed16f'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1149697857', 'security_groups': [{'name': 'tempest-secgroup-smoke-664738423'}]}}} Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:49:23.821792 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-14bbda3e-d750-45b7-80ff-065925a07869) Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fc28e992-5ea4-47e2-9b86-a4490c12aa40 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fc28e992-5ea4-47e2-9b86-a4490c12aa40 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.442332 Oct 12 13:49:23.826472 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1043/2059] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:49:23 2022] POST /compute/v2.1/servers => generated 214 bytes in 444 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:49:28.490789 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-056f8564-cbcb-4c7b-8364-52787361903b tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Calling method '.version_select at 0x7f8a9b3cb280>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:49:28.504380 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:49:28.505939 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=10 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:49:28.612854 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-056f8564-cbcb-4c7b-8364-52787361903b tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1149697857" status: 202 len: 0 microversion: 2.1 time: 0.126360 Oct 12 13:49:28.613953 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1017/2060] 10.222.0.52 () {58 vars in 1284 bytes} [Wed Oct 12 13:49:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1149697857 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:49:28.629594 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d305534f-ac29-4f88-8669-f5e6b968f591 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Action: 'create', calling method: .version_select at 0x7f8a9bb780d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-591458364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGfspa1OceWEE1bUbgdT9YDVuie2jVX2mJt+hfyBfqjdo9szvPwdOS7b2ba48Nt9UPiX0PsUS7NpYuePpR2o9MVMEMnw7qwQtT0dC3/BXre/uSbQJsg1aW0KWQlBC5TAQ=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:49:28.649329 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-d305534f-ac29-4f88-8669-f5e6b968f591 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Getting quotas for project e35b8ba339f2443fb9a0291f93bdff9c. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:49:28.654377 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-d305534f-ac29-4f88-8669-f5e6b968f591 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Getting quotas for user b0f9349e8ff047b69858fdd75989f145 and project e35b8ba339f2443fb9a0291f93bdff9c. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:49:28.731683 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d305534f-ac29-4f88-8669-f5e6b968f591 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.108712 Oct 12 13:49:28.732742 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1044/2061] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:49:28 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:49:40.374397 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-da4764e8-80c1-41b2-a170-64f23f7c3496 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1364525996", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "98c0c9a3-e39d-421e-a1d4-4d65f8b83cf5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-591458364", "security_groups": [{"name": "tempest-secgroup-smoke-693043459"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:49:40.648226 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-da4764e8-80c1-41b2-a170-64f23f7c3496 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] validate_networks() for [('98c0c9a3-e39d-421e-a1d4-4d65f8b83cf5', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-da4764e8-80c1-41b2-a170-64f23f7c3496 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f0a39962-ad77-4aeb-ac5a-420182a7fb8f) Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:49:41.067313 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:49:41.071385 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:49:41.071385 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:49:41.071385 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:49:41.071385 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:49:41.071385 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:49:41.071385 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:49:41.071385 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:49:41.071385 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:49:41.071385 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:49:41.071385 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:49:41.071385 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:49:41.071385 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:49:41.071385 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:49:41.071385 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:49:41.071385 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:49:41.071385 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f0a39962-ad77-4aeb-ac5a-420182a7fb8f) Oct 12 13:49:41.071385 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:49:41.073862 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-da4764e8-80c1-41b2-a170-64f23f7c3496 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:49:41.073862 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-da4764e8-80c1-41b2-a170-64f23f7c3496 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Request method failure captured: Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 343 Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsXIzhXbPGZNe6bdQ1Ka1lArBq7fzN7FLH0M7fc2c8ZK4ap_zp3H3kQcoatN-ETIwsPhHmJ8hqukk98Bqe7Y4WQ-f79F0xdFVxnr9YVAnCNfhGqoddU13FdMxn4dL-2wzl3x-afZQA9cgcXCzNTkbSkxWMRwcp2JbRyiEM9dl4j35h4 Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: e35b8ba339f2443fb9a0291f93bdff9c Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1503045648 Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e35b8ba339f2443fb9a0291f93bdff9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e35b8ba339f2443fb9a0291f93bdff9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e35b8ba339f2443fb9a0291f93bdff9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e35b8ba339f2443fb9a0291f93bdff9c"}]}] Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1503045648 Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: e35b8ba339f2443fb9a0291f93bdff9c Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1503045648 Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-TestNetworkAdvancedServerOps-1503045648-project Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: b0f9349e8ff047b69858fdd75989f145 Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1503045648-project Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1364525996", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "98c0c9a3-e39d-421e-a1d4-4d65f8b83cf5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-591458364", "security_groups": [{"name": "tempest-secgroup-smoke-693043459"}]}} Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1364525996', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '98c0c9a3-e39d-421e-a1d4-4d65f8b83cf5'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-591458364', 'security_groups': [{'name': 'tempest-secgroup-smoke-693043459'}]}}} Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:49:41.076924 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f0a39962-ad77-4aeb-ac5a-420182a7fb8f) Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:49:41.081311 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:49:41.085471 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:49:41.085471 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:49:41.085471 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:49:41.085471 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:49:41.085471 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:49:41.085471 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:49:41.085471 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:49:41.085471 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:49:41.085471 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:49:41.085471 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:49:41.085471 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:49:41.085471 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:49:41.085471 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:49:41.085471 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:49:41.085471 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:49:41.085471 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:49:41.088483 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-da4764e8-80c1-41b2-a170-64f23f7c3496 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:49:41.088483 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:49:41.088483 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-da4764e8-80c1-41b2-a170-64f23f7c3496 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.722272 Oct 12 13:49:41.089733 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1018/2062] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:49:40 2022] POST /compute/v2.1/servers => generated 214 bytes in 724 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:49:45.985046 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:49:45.986196 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:49:45.991184 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f18d3d8e-1b7a-431c-92cc-2f33856174d4 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Calling method '.version_select at 0x7f8a9b8e9430>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:49:46.093696 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f18d3d8e-1b7a-431c-92cc-2f33856174d4 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-591458364" status: 202 len: 0 microversion: 2.1 time: 0.109992 Oct 12 13:49:46.094707 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1045/2063] 10.222.0.52 () {58 vars in 1281 bytes} [Wed Oct 12 13:49:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-591458364 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:49:46.108107 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b1f23c2a-30af-467b-8d3c-7a3806e8f37c tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Action: 'create', calling method: .version_select at 0x7f8a9ba51040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1379110322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhc3r/iZXRLOzniIG7JpM1M9rqd7vb2zQB3NOIpVG63fF9bB4d1y+b51oe73+eTa6HM7P2xM5OEFbqgm+mQ9nVjXIerqyEDV/ZIVXlnCYe7hRwfjEYGvDDur3e6WLMDOw=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:49:46.125314 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-b1f23c2a-30af-467b-8d3c-7a3806e8f37c tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Getting quotas for project e35b8ba339f2443fb9a0291f93bdff9c. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:49:46.130614 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-b1f23c2a-30af-467b-8d3c-7a3806e8f37c tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Getting quotas for user b0f9349e8ff047b69858fdd75989f145 and project e35b8ba339f2443fb9a0291f93bdff9c. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:49:46.222308 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b1f23c2a-30af-467b-8d3c-7a3806e8f37c tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.118459 Oct 12 13:49:46.222946 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1019/2064] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:49:46 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:49:55.975157 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8a1c5e79-ae32-450a-8a19-f71c9f7fb62a tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-954043066", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "3832abb4-1562-4efc-8a28-38fab631d73f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1379110322", "security_groups": [{"name": "tempest-secgroup-smoke-307901636"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:49:56.579113 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-8a1c5e79-ae32-450a-8a19-f71c9f7fb62a tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] validate_networks() for [('3832abb4-1562-4efc-8a28-38fab631d73f', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-8a1c5e79-ae32-450a-8a19-f71c9f7fb62a tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-59a230d6-f22e-41fa-ace5-ba1a6d84ac34) Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:49:57.213231 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-59a230d6-f22e-41fa-ace5-ba1a6d84ac34) Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-8a1c5e79-ae32-450a-8a19-f71c9f7fb62a tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8a1c5e79-ae32-450a-8a19-f71c9f7fb62a tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Request method failure captured: Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 343 Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsXIzhXbPGZNe6bdQ1Ka1lArBq7fzN7FLH0M7fc2c8ZK4ap_zp3H3kQcoatN-ETIwsPhHmJ8hqukk98Bqe7Y4WQ-f79F0xdFVxnr9YVAnCNfhGqoddU13FdMxn4dL-2wzl3x-afZQA9cgcXCzNTkbSkxWMRwcp2JbRyiEM9dl4j35h4 Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: e35b8ba339f2443fb9a0291f93bdff9c Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1503045648 Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e35b8ba339f2443fb9a0291f93bdff9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e35b8ba339f2443fb9a0291f93bdff9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e35b8ba339f2443fb9a0291f93bdff9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e35b8ba339f2443fb9a0291f93bdff9c"}]}] Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1503045648 Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: e35b8ba339f2443fb9a0291f93bdff9c Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1503045648 Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-TestNetworkAdvancedServerOps-1503045648-project Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: b0f9349e8ff047b69858fdd75989f145 Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1503045648-project Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-954043066", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "3832abb4-1562-4efc-8a28-38fab631d73f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1379110322", "security_groups": [{"name": "tempest-secgroup-smoke-307901636"}]}} Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:49:57.223358 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-954043066', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '3832abb4-1562-4efc-8a28-38fab631d73f'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1379110322', 'security_groups': [{'name': 'tempest-secgroup-smoke-307901636'}]}}} Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:49:57.227343 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-59a230d6-f22e-41fa-ace5-ba1a6d84ac34) Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-8a1c5e79-ae32-450a-8a19-f71c9f7fb62a tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:49:57.234109 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-8a1c5e79-ae32-450a-8a19-f71c9f7fb62a tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.250141 Oct 12 13:49:57.242500 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1046/2065] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:49:55 2022] POST /compute/v2.1/servers => generated 214 bytes in 1274 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:50:03.363172 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:50:03.363919 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:50:03.369448 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1309f61e-b7c8-42fb-9ff7-df647f018ac4 tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] Action: 'create', calling method: .version_select at 0x7f8aa3dea820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2123505363", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9O4Ir9zCA5jonw6TfJqkFlZfsCCUvkHpLSiilxrWV/JznY/gwOF+gI4mY5qr6Jav45PzwBDAtpXEbexKyHc1ellf8fEYtGN7mJ+dFWmfAZ8lZhRLc+sFq6a/xlxs3GmQ=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:50:03.399972 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-1309f61e-b7c8-42fb-9ff7-df647f018ac4 tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] Getting quotas for project c5896b87cc824d368d35c9c15bdf6121. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:50:03.425689 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-1309f61e-b7c8-42fb-9ff7-df647f018ac4 tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] Getting quotas for user 68957012b7f54daabb2926b09fcd3393 and project c5896b87cc824d368d35c9c15bdf6121. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:50:03.561795 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1309f61e-b7c8-42fb-9ff7-df647f018ac4 tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.199849 Oct 12 13:50:03.574773 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1020/2066] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:50:03 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:50:03.577270 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ed93d6f4-4aed-44d0-aa3d-cca727303095 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] Calling method '.version_select at 0x7f8aa3e50550>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:50:03.678752 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ed93d6f4-4aed-44d0-aa3d-cca727303095 tempest-TestNetworkAdvancedServerOps-1503045648 tempest-TestNetworkAdvancedServerOps-1503045648-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1379110322" status: 202 len: 0 microversion: 2.1 time: 0.108635 Oct 12 13:50:03.679586 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1047/2067] 10.222.0.52 () {58 vars in 1284 bytes} [Wed Oct 12 13:50:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1379110322 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:50:06.565248 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d42c5cf5-9174-4a50-a742-0e649174bd4a tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1594436114", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "226ed7f8-98f7-4c99-889a-6726be229653"}], "key_name": "tempest-TestNetworkBasicOps-2123505363", "security_groups": [{"name": "tempest-secgroup-smoke-1156573024"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:50:06.905376 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-d42c5cf5-9174-4a50-a742-0e649174bd4a tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] validate_networks() for [('226ed7f8-98f7-4c99-889a-6726be229653', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-d42c5cf5-9174-4a50-a742-0e649174bd4a tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0047a3b2-3736-44c8-b748-4912462135aa) Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:50:07.121089 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0047a3b2-3736-44c8-b748-4912462135aa) Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-d42c5cf5-9174-4a50-a742-0e649174bd4a tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d42c5cf5-9174-4a50-a742-0e649174bd4a tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] Request method failure captured: Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 327 Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsX_Kn-jRXGQ3oaI3FzDEohEwmJQ38iBsl6wpaTn4LCx2fLekVoZLc50_j5_Xdb8uOU-RcCu2WsCom8Gsfd8lNBhkodGMRTPWjgtXPNjnMQruwB_qSe5NecbSHTihLiRAHzy4qsTUHTP0xUO-KfjdILcsHWlANgtI9IT3H1pE8Q1QB0 Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: c5896b87cc824d368d35c9c15bdf6121 Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-TestNetworkBasicOps-1758642590 Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c5896b87cc824d368d35c9c15bdf6121"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c5896b87cc824d368d35c9c15bdf6121"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c5896b87cc824d368d35c9c15bdf6121"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c5896b87cc824d368d35c9c15bdf6121"}]}] Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-TestNetworkBasicOps-1758642590 Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: c5896b87cc824d368d35c9c15bdf6121 Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-TestNetworkBasicOps-1758642590 Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-TestNetworkBasicOps-1758642590-project Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 68957012b7f54daabb2926b09fcd3393 Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-TestNetworkBasicOps-1758642590-project Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-TestNetworkBasicOps-server-1594436114", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "226ed7f8-98f7-4c99-889a-6726be229653"}], "key_name": "tempest-TestNetworkBasicOps-2123505363", "security_groups": [{"name": "tempest-secgroup-smoke-1156573024"}]}} Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:50:07.125234 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkBasicOps-server-1594436114', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '226ed7f8-98f7-4c99-889a-6726be229653'}], 'key_name': 'tempest-TestNetworkBasicOps-2123505363', 'security_groups': [{'name': 'tempest-secgroup-smoke-1156573024'}]}}} Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:50:07.129497 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0047a3b2-3736-44c8-b748-4912462135aa) Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d42c5cf5-9174-4a50-a742-0e649174bd4a tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d42c5cf5-9174-4a50-a742-0e649174bd4a tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.571776 Oct 12 13:50:07.133898 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1021/2068] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:50:06 2022] POST /compute/v2.1/servers => generated 214 bytes in 574 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:50:07.381387 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5e508595-a5b2-48fa-a5a1-b0cc71ddee0b tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] Calling method '.version_select at 0x7f8aa3e54c10>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:50:07.443369 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5e508595-a5b2-48fa-a5a1-b0cc71ddee0b tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2123505363" status: 202 len: 0 microversion: 2.1 time: 0.066348 Oct 12 13:50:07.444180 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1048/2069] 10.222.0.52 () {58 vars in 1257 bytes} [Wed Oct 12 13:50:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2123505363 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:50:18.112831 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e4aaa7d5-a4bc-4ff2-bea8-67d373b0bfba tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] Action: 'create', calling method: .version_select at 0x7f8aa3dfb940>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-852817421", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoA5N87Wq5mpzUNUCWH2PBwuF+dG0x8HLPuykQiKEGwtOQaREHxoULhQBQS/L8s8RznOwEHJ74Dv/980uqNKoKqieCawvDtU8nOP8HZdLOSarEzrqgoIewWVvh7LTyvag=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:50:18.131165 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:50:18.132024 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:50:18.143238 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-e4aaa7d5-a4bc-4ff2-bea8-67d373b0bfba tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] Getting quotas for project c5896b87cc824d368d35c9c15bdf6121. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:50:18.149335 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-e4aaa7d5-a4bc-4ff2-bea8-67d373b0bfba tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] Getting quotas for user 68957012b7f54daabb2926b09fcd3393 and project c5896b87cc824d368d35c9c15bdf6121. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:50:18.281581 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e4aaa7d5-a4bc-4ff2-bea8-67d373b0bfba tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.172494 Oct 12 13:50:18.282911 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1022/2070] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:50:18 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:50:20.990447 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=3 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:50:20.995386 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-de588545-8e75-4679-9816-cff2245f9930 tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1251178208", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "250417a5-5c7d-4c62-9c57-54a633751759"}], "key_name": "tempest-TestNetworkBasicOps-852817421", "security_groups": [{"name": "tempest-secgroup-smoke-856648382"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:50:21.099113 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-de588545-8e75-4679-9816-cff2245f9930 tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] validate_networks() for [('250417a5-5c7d-4c62-9c57-54a633751759', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-de588545-8e75-4679-9816-cff2245f9930 tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ded1a90c-5ba6-4841-a7a4-8082af8b95b8) Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:50:21.304823 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:50:21.308928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:50:21.308928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:50:21.308928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:50:21.308928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:50:21.308928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:50:21.308928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:50:21.308928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:50:21.308928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:50:21.308928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:50:21.308928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:50:21.308928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:50:21.308928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:50:21.308928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:50:21.308928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:50:21.308928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ded1a90c-5ba6-4841-a7a4-8082af8b95b8) Oct 12 13:50:21.308928 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:50:21.308928 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-de588545-8e75-4679-9816-cff2245f9930 tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:50:21.308928 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-de588545-8e75-4679-9816-cff2245f9930 tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] Request method failure captured: Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 325 Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsX_Kn-jRXGQ3oaI3FzDEohEwmJQ38iBsl6wpaTn4LCx2fLekVoZLc50_j5_Xdb8uOU-RcCu2WsCom8Gsfd8lNBhkodGMRTPWjgtXPNjnMQruwB_qSe5NecbSHTihLiRAHzy4qsTUHTP0xUO-KfjdILcsHWlANgtI9IT3H1pE8Q1QB0 Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: c5896b87cc824d368d35c9c15bdf6121 Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-TestNetworkBasicOps-1758642590 Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c5896b87cc824d368d35c9c15bdf6121"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c5896b87cc824d368d35c9c15bdf6121"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c5896b87cc824d368d35c9c15bdf6121"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c5896b87cc824d368d35c9c15bdf6121"}]}] Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-TestNetworkBasicOps-1758642590 Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: c5896b87cc824d368d35c9c15bdf6121 Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-TestNetworkBasicOps-1758642590 Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-TestNetworkBasicOps-1758642590-project Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 68957012b7f54daabb2926b09fcd3393 Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-TestNetworkBasicOps-1758642590-project Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-TestNetworkBasicOps-server-1251178208", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "250417a5-5c7d-4c62-9c57-54a633751759"}], "key_name": "tempest-TestNetworkBasicOps-852817421", "security_groups": [{"name": "tempest-secgroup-smoke-856648382"}]}} Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkBasicOps-server-1251178208', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '250417a5-5c7d-4c62-9c57-54a633751759'}], 'key_name': 'tempest-TestNetworkBasicOps-852817421', 'security_groups': [{'name': 'tempest-secgroup-smoke-856648382'}]}}} Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:50:21.310959 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ded1a90c-5ba6-4841-a7a4-8082af8b95b8) Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:50:21.320540 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:50:21.326117 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:50:21.326117 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:50:21.326117 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:50:21.326117 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:50:21.326117 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:50:21.326117 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:50:21.326117 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:50:21.326117 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:50:21.326117 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:50:21.326117 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:50:21.326117 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:50:21.326117 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:50:21.326117 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:50:21.326117 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:50:21.326117 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:50:21.326117 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-de588545-8e75-4679-9816-cff2245f9930 tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:50:21.326117 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:50:21.326117 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-de588545-8e75-4679-9816-cff2245f9930 tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.324044 Oct 12 13:50:21.326117 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1049/2071] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:50:20 2022] POST /compute/v2.1/servers => generated 214 bytes in 325 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:50:21.542538 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-79a92925-2875-4c5f-b377-44e3fdf6ca1c tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] Calling method '.version_select at 0x7f8aa3dea670>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:50:21.616616 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-79a92925-2875-4c5f-b377-44e3fdf6ca1c tempest-TestNetworkBasicOps-1758642590 tempest-TestNetworkBasicOps-1758642590-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-852817421" status: 202 len: 0 microversion: 2.1 time: 0.077955 Oct 12 13:50:21.617234 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1023/2072] 10.222.0.52 () {58 vars in 1254 bytes} [Wed Oct 12 13:50:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-852817421 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:54:29.835160 n-d-861076-2 devstack@n-api.service[120933]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0b35a388-ce4a-4a13-a8cf-7a371d068249] AMQP server on 10.222.0.52:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Oct 12 13:54:29.835680 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:54:29.836524 n-d-861076-2 devstack@n-api.service[120933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 13:54:29.836664 n-d-861076-2 devstack@n-api.service[120933]: Wed Oct 12 13:54:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 12 13:54:29.838761 n-d-861076-2 devstack@n-api.service[120933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 13:54:29.838882 n-d-861076-2 devstack@n-api.service[120933]: Wed Oct 12 13:54:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 12 13:54:29.841528 n-d-861076-2 devstack@n-api.service[120933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 13:54:29.841650 n-d-861076-2 devstack@n-api.service[120933]: Wed Oct 12 13:54:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 12 13:54:29.857575 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4ae41a27-ac6a-4898-b3fd-6063b55918e2 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-169180956", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "624aa587-8172-4e5b-a85b-b0a4eb131da7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ebd8a942-f09c-4234-8b77-e298fda428e1"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:54:30.065015 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-4ae41a27-ac6a-4898-b3fd-6063b55918e2 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] validate_networks() for [('ebd8a942-f09c-4234-8b77-e298fda428e1', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-4ae41a27-ac6a-4898-b3fd-6063b55918e2 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4a2be52d-e62a-421e-ae78-17f68cbe154a) Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:54:30.274902 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4a2be52d-e62a-421e-ae78-17f68cbe154a) Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-4ae41a27-ac6a-4898-b3fd-6063b55918e2 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4ae41a27-ac6a-4898-b3fd-6063b55918e2 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Request method failure captured: Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 353 Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRscMubjDQHR-SpHjHKGGFUvwrKUZ0FDI70mJGKi-HCGcIbna2FgtEbQ8F8PAMw7DST5hJXl6NnIk5XLn3c_LvHdMn3ZRsP4gWhkAjAR2eSaO6BiF72qAawOOlfcyxBkzlUTMUmVDAygHBRbK_1uMQjqdZTvNy871rApCZYxlIHRWMw4 Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: e75bf65c805b4a9587fd8000858590fe Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-TestVolumeBootPattern-1327495126 Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e75bf65c805b4a9587fd8000858590fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e75bf65c805b4a9587fd8000858590fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e75bf65c805b4a9587fd8000858590fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e75bf65c805b4a9587fd8000858590fe"}]}] Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-TestVolumeBootPattern-1327495126 Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: e75bf65c805b4a9587fd8000858590fe Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-TestVolumeBootPattern-1327495126 Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-TestVolumeBootPattern-1327495126-project Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 8d5587d9ee5945639d664057f2375507 Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-TestVolumeBootPattern-1327495126-project Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-TestVolumeBootPattern-server-169180956", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "624aa587-8172-4e5b-a85b-b0a4eb131da7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ebd8a942-f09c-4234-8b77-e298fda428e1"}]}} Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:54:30.279867 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-169180956', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': '624aa587-8172-4e5b-a85b-b0a4eb131da7'}], 'networks': [{'uuid': 'ebd8a942-f09c-4234-8b77-e298fda428e1'}]}}} Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:54:30.284155 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4a2be52d-e62a-421e-ae78-17f68cbe154a) Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-4ae41a27-ac6a-4898-b3fd-6063b55918e2 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-4ae41a27-ac6a-4898-b3fd-6063b55918e2 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.446687 Oct 12 13:54:30.289423 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1050/2073] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:54:29 2022] POST /compute/v2.1/servers => generated 214 bytes in 448 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:54:37.009992 n-d-861076-2 devstack@n-api.service[120932]: ERROR oslo.messaging._drivers.impl_rabbit [-] [218a9a61-6610-4e2e-83a8-c73fc80d21fe] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 13:54:37.010467 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:54:37.011310 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:54:37.011966 n-d-861076-2 devstack@n-api.service[120932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 13:54:37.012111 n-d-861076-2 devstack@n-api.service[120932]: Wed Oct 12 13:54:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 12 13:54:37.013111 n-d-861076-2 devstack@n-api.service[120932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 13:54:37.013225 n-d-861076-2 devstack@n-api.service[120932]: Wed Oct 12 13:54:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 12 13:54:37.014262 n-d-861076-2 devstack@n-api.service[120932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 13:54:37.014386 n-d-861076-2 devstack@n-api.service[120932]: Wed Oct 12 13:54:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 12 13:54:37.020463 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c54603d4-46a9-4146-9b94-ba0b6d4eb05d tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1739076559", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d33eed25-6aa5-4bc9-ae74-1c0954ccb54a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ebd8a942-f09c-4234-8b77-e298fda428e1"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:54:37.083822 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-c54603d4-46a9-4146-9b94-ba0b6d4eb05d tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] validate_networks() for [('ebd8a942-f09c-4234-8b77-e298fda428e1', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-c54603d4-46a9-4146-9b94-ba0b6d4eb05d tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1381c833-e1d4-42c3-a117-976cfd7e71af) Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:54:37.277217 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1381c833-e1d4-42c3-a117-976cfd7e71af) Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-c54603d4-46a9-4146-9b94-ba0b6d4eb05d tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c54603d4-46a9-4146-9b94-ba0b6d4eb05d tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Request method failure captured: Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 354 Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRscMubjDQHR-SpHjHKGGFUvwrKUZ0FDI70mJGKi-HCGcIbna2FgtEbQ8F8PAMw7DST5hJXl6NnIk5XLn3c_LvHdMn3ZRsP4gWhkAjAR2eSaO6BiF72qAawOOlfcyxBkzlUTMUmVDAygHBRbK_1uMQjqdZTvNy871rApCZYxlIHRWMw4 Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: e75bf65c805b4a9587fd8000858590fe Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-TestVolumeBootPattern-1327495126 Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e75bf65c805b4a9587fd8000858590fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e75bf65c805b4a9587fd8000858590fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e75bf65c805b4a9587fd8000858590fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e75bf65c805b4a9587fd8000858590fe"}]}] Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-TestVolumeBootPattern-1327495126 Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: e75bf65c805b4a9587fd8000858590fe Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-TestVolumeBootPattern-1327495126 Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-TestVolumeBootPattern-1327495126-project Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 8d5587d9ee5945639d664057f2375507 Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-TestVolumeBootPattern-1327495126-project Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-TestVolumeBootPattern-server-1739076559", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d33eed25-6aa5-4bc9-ae74-1c0954ccb54a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ebd8a942-f09c-4234-8b77-e298fda428e1"}]}} Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:54:37.281886 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-1739076559', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': 'd33eed25-6aa5-4bc9-ae74-1c0954ccb54a'}], 'networks': [{'uuid': 'ebd8a942-f09c-4234-8b77-e298fda428e1'}]}}} Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:54:37.287002 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1381c833-e1d4-42c3-a117-976cfd7e71af) Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c54603d4-46a9-4146-9b94-ba0b6d4eb05d tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c54603d4-46a9-4146-9b94-ba0b6d4eb05d tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.273108 Oct 12 13:54:37.292392 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1024/2074] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:54:37 2022] POST /compute/v2.1/servers => generated 214 bytes in 274 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:55:07.572279 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a9e8a0fc-e945-444d-9898-c6521d655e47 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1675021314", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2b047a3c-eee3-4ae9-acea-33967e3a8133", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "ebd8a942-f09c-4234-8b77-e298fda428e1"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:55:07.584037 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:55:07.597276 n-d-861076-2 devstack@n-api.service[120933]: INFO oslo.messaging._drivers.impl_rabbit [-] [0b35a388-ce4a-4a13-a8cf-7a371d068249] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 33926. Oct 12 13:55:07.663693 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-a9e8a0fc-e945-444d-9898-c6521d655e47 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] validate_networks() for [('ebd8a942-f09c-4234-8b77-e298fda428e1', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-a9e8a0fc-e945-444d-9898-c6521d655e47 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7747377e-7f92-4ef6-9ea9-d9c1bca57a3e) Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:55:07.858045 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7747377e-7f92-4ef6-9ea9-d9c1bca57a3e) Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-a9e8a0fc-e945-444d-9898-c6521d655e47 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a9e8a0fc-e945-444d-9898-c6521d655e47 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Request method failure captured: Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 355 Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRscMubjDQHR-SpHjHKGGFUvwrKUZ0FDI70mJGKi-HCGcIbna2FgtEbQ8F8PAMw7DST5hJXl6NnIk5XLn3c_LvHdMn3ZRsP4gWhkAjAR2eSaO6BiF72qAawOOlfcyxBkzlUTMUmVDAygHBRbK_1uMQjqdZTvNy871rApCZYxlIHRWMw4 Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: e75bf65c805b4a9587fd8000858590fe Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-TestVolumeBootPattern-1327495126 Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e75bf65c805b4a9587fd8000858590fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e75bf65c805b4a9587fd8000858590fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e75bf65c805b4a9587fd8000858590fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e75bf65c805b4a9587fd8000858590fe"}]}] Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-TestVolumeBootPattern-1327495126 Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: e75bf65c805b4a9587fd8000858590fe Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-TestVolumeBootPattern-1327495126 Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-TestVolumeBootPattern-1327495126-project Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 8d5587d9ee5945639d664057f2375507 Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-TestVolumeBootPattern-1327495126-project Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-TestVolumeBootPattern-server-1675021314", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2b047a3c-eee3-4ae9-acea-33967e3a8133", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "ebd8a942-f09c-4234-8b77-e298fda428e1"}]}} Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:55:07.862605 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-1675021314', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'snapshot', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'snapshot_id': '2b047a3c-eee3-4ae9-acea-33967e3a8133'}], 'networks': [{'uuid': 'ebd8a942-f09c-4234-8b77-e298fda428e1'}]}}} Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:55:07.867071 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7747377e-7f92-4ef6-9ea9-d9c1bca57a3e) Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a9e8a0fc-e945-444d-9898-c6521d655e47 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a9e8a0fc-e945-444d-9898-c6521d655e47 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.293718 Oct 12 13:55:07.872344 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1051/2075] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:55:07 2022] POST /compute/v2.1/servers => generated 214 bytes in 295 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:55:37.355455 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:55:37.362262 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c69c9ae5-8050-49b3-813b-759f9115cc65 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1182549411", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "499e31c6-e29c-47c1-b17a-dfef2aa4b92b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "ebd8a942-f09c-4234-8b77-e298fda428e1"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:55:37.385080 n-d-861076-2 devstack@n-api.service[120932]: INFO oslo.messaging._drivers.impl_rabbit [-] [218a9a61-6610-4e2e-83a8-c73fc80d21fe] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 34104. Oct 12 13:55:37.481847 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-c69c9ae5-8050-49b3-813b-759f9115cc65 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] validate_networks() for [('ebd8a942-f09c-4234-8b77-e298fda428e1', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-c69c9ae5-8050-49b3-813b-759f9115cc65 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b6090b2e-70de-45ff-93e7-1127da234290) Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:55:37.670863 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b6090b2e-70de-45ff-93e7-1127da234290) Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-c69c9ae5-8050-49b3-813b-759f9115cc65 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c69c9ae5-8050-49b3-813b-759f9115cc65 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Request method failure captured: Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 367 Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRscMubjDQHR-SpHjHKGGFUvwrKUZ0FDI70mJGKi-HCGcIbna2FgtEbQ8F8PAMw7DST5hJXl6NnIk5XLn3c_LvHdMn3ZRsP4gWhkAjAR2eSaO6BiF72qAawOOlfcyxBkzlUTMUmVDAygHBRbK_1uMQjqdZTvNy871rApCZYxlIHRWMw4 Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: e75bf65c805b4a9587fd8000858590fe Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-TestVolumeBootPattern-1327495126 Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e75bf65c805b4a9587fd8000858590fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e75bf65c805b4a9587fd8000858590fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e75bf65c805b4a9587fd8000858590fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e75bf65c805b4a9587fd8000858590fe"}]}] Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-TestVolumeBootPattern-1327495126 Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: e75bf65c805b4a9587fd8000858590fe Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-TestVolumeBootPattern-1327495126 Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-TestVolumeBootPattern-1327495126-project Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 8d5587d9ee5945639d664057f2375507 Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-TestVolumeBootPattern-1327495126-project Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1182549411", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "499e31c6-e29c-47c1-b17a-dfef2aa4b92b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "ebd8a942-f09c-4234-8b77-e298fda428e1"}]}} Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:55:37.675401 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-volume-backed-server-1182549411', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': '499e31c6-e29c-47c1-b17a-dfef2aa4b92b'}], 'networks': [{'uuid': 'ebd8a942-f09c-4234-8b77-e298fda428e1'}]}}} Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:55:37.679955 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b6090b2e-70de-45ff-93e7-1127da234290) Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c69c9ae5-8050-49b3-813b-759f9115cc65 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c69c9ae5-8050-49b3-813b-759f9115cc65 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.321596 Oct 12 13:55:37.684275 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1025/2076] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:55:37 2022] POST /compute/v2.1/servers => generated 214 bytes in 326 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:55:41.066014 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:55:41.070170 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e06ac0a3-cb0d-4278-9b24-ff19606f56ea tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Action: 'create', calling method: .version_select at 0x7f8a9baf2af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2081167184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyK/ZsasFwNHHYn9PNI/jh8WSKn3EDvEkiwbtbfJYSkawixnNkJTiXzmVhoIw1hauQRhE+LmqgtDhbyOF3+eIn5ecSUzMSdE8qPbFSkahMuXlOvEVxATLlXl5bZzV4Cqw=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:55:41.086830 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-e06ac0a3-cb0d-4278-9b24-ff19606f56ea tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Getting quotas for project e75bf65c805b4a9587fd8000858590fe. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:55:41.091887 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-e06ac0a3-cb0d-4278-9b24-ff19606f56ea tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Getting quotas for user 8d5587d9ee5945639d664057f2375507 and project e75bf65c805b4a9587fd8000858590fe. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:55:41.181522 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e06ac0a3-cb0d-4278-9b24-ff19606f56ea tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.116837 Oct 12 13:55:41.182129 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1052/2077] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:55:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:56:09.412449 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:56:09.416476 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ca083840-55db-4980-9b95-59fc3d1ae318 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1378434410", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2081167184", "security_groups": [{"name": "tempest-secgroup-smoke-369174000"}], "block_device_mapping_v2": [{"uuid": "907655a5-cd94-48e6-ae4c-00985744a9dc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ebd8a942-f09c-4234-8b77-e298fda428e1"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:56:09.533824 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-ca083840-55db-4980-9b95-59fc3d1ae318 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] validate_networks() for [('ebd8a942-f09c-4234-8b77-e298fda428e1', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-ca083840-55db-4980-9b95-59fc3d1ae318 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-59ac585d-6975-463d-9cb0-21b7834bb4b8) Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:56:09.730631 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-59ac585d-6975-463d-9cb0-21b7834bb4b8) Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-ca083840-55db-4980-9b95-59fc3d1ae318 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ca083840-55db-4980-9b95-59fc3d1ae318 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Request method failure captured: Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 477 Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRscMubjDQHR-SpHjHKGGFUvwrKUZ0FDI70mJGKi-HCGcIbna2FgtEbQ8F8PAMw7DST5hJXl6NnIk5XLn3c_LvHdMn3ZRsP4gWhkAjAR2eSaO6BiF72qAawOOlfcyxBkzlUTMUmVDAygHBRbK_1uMQjqdZTvNy871rApCZYxlIHRWMw4 Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: e75bf65c805b4a9587fd8000858590fe Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-TestVolumeBootPattern-1327495126 Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e75bf65c805b4a9587fd8000858590fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e75bf65c805b4a9587fd8000858590fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e75bf65c805b4a9587fd8000858590fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e75bf65c805b4a9587fd8000858590fe"}]}] Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-TestVolumeBootPattern-1327495126 Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: e75bf65c805b4a9587fd8000858590fe Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-TestVolumeBootPattern-1327495126 Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-TestVolumeBootPattern-1327495126-project Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 8d5587d9ee5945639d664057f2375507 Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-TestVolumeBootPattern-1327495126-project Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-TestVolumeBootPattern-server-1378434410", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2081167184", "security_groups": [{"name": "tempest-secgroup-smoke-369174000"}], "block_device_mapping_v2": [{"uuid": "907655a5-cd94-48e6-ae4c-00985744a9dc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ebd8a942-f09c-4234-8b77-e298fda428e1"}]}} Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:56:09.735332 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-1378434410', 'imageRef': '', 'flavorRef': '452', 'key_name': 'tempest-TestVolumeBootPattern-2081167184', 'security_groups': [{'name': 'tempest-secgroup-smoke-369174000'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': '907655a5-cd94-48e6-ae4c-00985744a9dc'}], 'networks': [{'uuid': 'ebd8a942-f09c-4234-8b77-e298fda428e1'}]}}} Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:56:09.739852 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-59ac585d-6975-463d-9cb0-21b7834bb4b8) Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ca083840-55db-4980-9b95-59fc3d1ae318 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ca083840-55db-4980-9b95-59fc3d1ae318 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.324477 Oct 12 13:56:09.744154 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1026/2078] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:56:09 2022] POST /compute/v2.1/servers => generated 214 bytes in 326 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:56:12.276721 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-95184c3a-568a-4312-96ed-23de744ec422 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] Calling method '.version_select at 0x7f8a9b846ee0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:12.293233 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:56:12.296468 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:56:12.373883 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-95184c3a-568a-4312-96ed-23de744ec422 tempest-TestVolumeBootPattern-1327495126 tempest-TestVolumeBootPattern-1327495126-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2081167184" status: 202 len: 0 microversion: 2.1 time: 0.101077 Oct 12 13:56:12.374527 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1053/2079] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Oct 12 13:56:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2081167184 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:56:31.479949 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:56:31.611130 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-980a35a2-c873-4c77-9549-72e7e65f5a1d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1750105393", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:56:31.661597 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-980a35a2-c873-4c77-9549-72e7e65f5a1d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] validate_networks() for None {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:56:31.864049 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-980a35a2-c873-4c77-9549-72e7e65f5a1d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 13:56:31.864503 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-980a35a2-c873-4c77-9549-72e7e65f5a1d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 13:56:31.865150 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-980a35a2-c873-4c77-9549-72e7e65f5a1d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 13:56:31.865564 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-980a35a2-c873-4c77-9549-72e7e65f5a1d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 13:56:31.865979 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-980a35a2-c873-4c77-9549-72e7e65f5a1d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 13:56:31.875449 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-980a35a2-c873-4c77-9549-72e7e65f5a1d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:31.875928 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-980a35a2-c873-4c77-9549-72e7e65f5a1d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:31.876367 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-980a35a2-c873-4c77-9549-72e7e65f5a1d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:31.877140 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-980a35a2-c873-4c77-9549-72e7e65f5a1d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:31.877594 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-980a35a2-c873-4c77-9549-72e7e65f5a1d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:31.878018 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-980a35a2-c873-4c77-9549-72e7e65f5a1d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:31.897182 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-980a35a2-c873-4c77-9549-72e7e65f5a1d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Getting quotas for project dd59616722954b7684da82dd5462b76d. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:56:31.902453 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-980a35a2-c873-4c77-9549-72e7e65f5a1d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Getting quotas for user cb8fb8aa25f4491581623856a90c6475 and project dd59616722954b7684da82dd5462b76d. Resources: {'ram', 'cores', 'instances'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:56:31.914679 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-980a35a2-c873-4c77-9549-72e7e65f5a1d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 13:56:31.917452 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-980a35a2-c873-4c77-9549-72e7e65f5a1d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] [instance: a6ef5641-3a33-431e-8e6f-cd00fc71d577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92c34f67-0f72-4439-9fdb-d8567b96935c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 13:56:32.048476 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-980a35a2-c873-4c77-9549-72e7e65f5a1d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571097 Oct 12 13:56:32.049155 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1027/2080] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:56:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 13:56:32.068341 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-06d341c7-48ec-46a6-af01-cffbc77d2dbf tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:32.069032 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-06d341c7-48ec-46a6-af01-cffbc77d2dbf tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] [instance: a6ef5641-3a33-431e-8e6f-cd00fc71d577] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:56:32.123813 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-06d341c7-48ec-46a6-af01-cffbc77d2dbf tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8fb8aa25f4491581623856a90c6475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59616722954b7684da82dd5462b76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:56:32.131077 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-06d341c7-48ec-46a6-af01-cffbc77d2dbf tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] 10.222.0.52 "GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577" status: 200 len: 1222 microversion: 2.1 time: 0.068624 Oct 12 13:56:32.131647 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1054/2081] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:56:32 2022] GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577 => generated 1222 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:56:33.154391 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-95199c4b-4d87-44dc-8ddc-f94ffb126b5a tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:33.155002 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-95199c4b-4d87-44dc-8ddc-f94ffb126b5a tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] [instance: a6ef5641-3a33-431e-8e6f-cd00fc71d577] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:56:33.205960 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-95199c4b-4d87-44dc-8ddc-f94ffb126b5a tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8fb8aa25f4491581623856a90c6475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59616722954b7684da82dd5462b76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:56:33.213771 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-95199c4b-4d87-44dc-8ddc-f94ffb126b5a tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] 10.222.0.52 "GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577" status: 200 len: 1222 microversion: 2.1 time: 0.063573 Oct 12 13:56:33.214621 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1028/2082] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:56:33 2022] GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577 => generated 1222 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:56:34.236588 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-289817f6-e37f-4c44-b5c6-a7813df4d48e tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:34.237231 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-289817f6-e37f-4c44-b5c6-a7813df4d48e tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] [instance: a6ef5641-3a33-431e-8e6f-cd00fc71d577] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:56:34.291341 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-289817f6-e37f-4c44-b5c6-a7813df4d48e tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8fb8aa25f4491581623856a90c6475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59616722954b7684da82dd5462b76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:56:34.298097 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-289817f6-e37f-4c44-b5c6-a7813df4d48e tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] 10.222.0.52 "GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577" status: 200 len: 1222 microversion: 2.1 time: 0.065415 Oct 12 13:56:34.298658 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1055/2083] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:56:34 2022] GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577 => generated 1222 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:56:35.319585 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d61c5a26-42e0-4eb2-9012-e2d58786cbf6 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:35.320331 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d61c5a26-42e0-4eb2-9012-e2d58786cbf6 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] [instance: a6ef5641-3a33-431e-8e6f-cd00fc71d577] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:56:35.327680 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d61c5a26-42e0-4eb2-9012-e2d58786cbf6 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:35.328187 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d61c5a26-42e0-4eb2-9012-e2d58786cbf6 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:35.328620 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d61c5a26-42e0-4eb2-9012-e2d58786cbf6 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:35.329471 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d61c5a26-42e0-4eb2-9012-e2d58786cbf6 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:35.329928 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d61c5a26-42e0-4eb2-9012-e2d58786cbf6 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:35.330356 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d61c5a26-42e0-4eb2-9012-e2d58786cbf6 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:35.390743 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d61c5a26-42e0-4eb2-9012-e2d58786cbf6 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8fb8aa25f4491581623856a90c6475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59616722954b7684da82dd5462b76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:56:35.398564 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d61c5a26-42e0-4eb2-9012-e2d58786cbf6 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] 10.222.0.52 "GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577" status: 200 len: 1226 microversion: 2.1 time: 0.082848 Oct 12 13:56:35.399131 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1029/2084] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:56:35 2022] GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:56:36.422735 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a62be243-f2ad-4e65-ba09-7bdfaa512336 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:36.423299 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a62be243-f2ad-4e65-ba09-7bdfaa512336 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] [instance: a6ef5641-3a33-431e-8e6f-cd00fc71d577] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:56:36.430505 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a62be243-f2ad-4e65-ba09-7bdfaa512336 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:36.431531 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a62be243-f2ad-4e65-ba09-7bdfaa512336 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:36.431978 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a62be243-f2ad-4e65-ba09-7bdfaa512336 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:36.432667 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a62be243-f2ad-4e65-ba09-7bdfaa512336 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:36.433142 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a62be243-f2ad-4e65-ba09-7bdfaa512336 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:36.433607 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a62be243-f2ad-4e65-ba09-7bdfaa512336 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:36.514642 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a62be243-f2ad-4e65-ba09-7bdfaa512336 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8fb8aa25f4491581623856a90c6475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59616722954b7684da82dd5462b76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:56:36.522385 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a62be243-f2ad-4e65-ba09-7bdfaa512336 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] 10.222.0.52 "GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577" status: 200 len: 1280 microversion: 2.1 time: 0.103692 Oct 12 13:56:36.522945 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1056/2085] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:56:36 2022] GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577 => generated 1280 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:56:37.545804 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d2c832fd-b865-4880-917b-64f0be29f75a tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:37.546425 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d2c832fd-b865-4880-917b-64f0be29f75a tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] [instance: a6ef5641-3a33-431e-8e6f-cd00fc71d577] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:56:37.552547 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d2c832fd-b865-4880-917b-64f0be29f75a tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:37.553163 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d2c832fd-b865-4880-917b-64f0be29f75a tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:37.553668 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d2c832fd-b865-4880-917b-64f0be29f75a tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:37.554425 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d2c832fd-b865-4880-917b-64f0be29f75a tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:37.554955 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d2c832fd-b865-4880-917b-64f0be29f75a tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:37.555370 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d2c832fd-b865-4880-917b-64f0be29f75a tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:37.762694 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-d2c832fd-b865-4880-917b-64f0be29f75a tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8fb8aa25f4491581623856a90c6475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59616722954b7684da82dd5462b76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:56:37.770479 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d2c832fd-b865-4880-917b-64f0be29f75a tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] 10.222.0.52 "GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577" status: 200 len: 1322 microversion: 2.1 time: 0.228636 Oct 12 13:56:37.771214 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1030/2086] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:56:37 2022] GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:56:38.296682 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [req-a0d8bc23-68c0-4855-9d9b-448a906c1b48 req-d378eba8-7c41-4611-811c-3abb0840569e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6ef5641-3a33-431e-8e6f-cd00fc71d577", "tag": "909aeeb0-c218-4b97-be11-0a22eee292f7"}]} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:56:38.306230 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-a0d8bc23-68c0-4855-9d9b-448a906c1b48 req-d378eba8-7c41-4611-811c-3abb0840569e service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:38.306745 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-a0d8bc23-68c0-4855-9d9b-448a906c1b48 req-d378eba8-7c41-4611-811c-3abb0840569e service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:38.307236 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [req-a0d8bc23-68c0-4855-9d9b-448a906c1b48 req-d378eba8-7c41-4611-811c-3abb0840569e service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:38.318245 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.compute.server_external_events [req-a0d8bc23-68c0-4855-9d9b-448a906c1b48 req-d378eba8-7c41-4611-811c-3abb0840569e service nova] Creating event network-changed:909aeeb0-c218-4b97-be11-0a22eee292f7 for instance a6ef5641-3a33-431e-8e6f-cd00fc71d577 on n-h1-861076-2 Oct 12 13:56:38.324434 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [req-a0d8bc23-68c0-4855-9d9b-448a906c1b48 req-d378eba8-7c41-4611-811c-3abb0840569e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099942 Oct 12 13:56:38.325227 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1057/2087] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:56:38.793104 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4623310a-770b-4b76-9e68-d81d5b651d2f tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:38.797544 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-4623310a-770b-4b76-9e68-d81d5b651d2f tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] [instance: a6ef5641-3a33-431e-8e6f-cd00fc71d577] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:56:38.800208 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4623310a-770b-4b76-9e68-d81d5b651d2f tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:38.800688 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4623310a-770b-4b76-9e68-d81d5b651d2f tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:38.801145 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4623310a-770b-4b76-9e68-d81d5b651d2f tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:38.801832 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4623310a-770b-4b76-9e68-d81d5b651d2f tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:38.802284 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4623310a-770b-4b76-9e68-d81d5b651d2f tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:38.802703 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4623310a-770b-4b76-9e68-d81d5b651d2f tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:38.934334 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-4623310a-770b-4b76-9e68-d81d5b651d2f tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8fb8aa25f4491581623856a90c6475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59616722954b7684da82dd5462b76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:56:38.941998 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4623310a-770b-4b76-9e68-d81d5b651d2f tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] 10.222.0.52 "GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577" status: 200 len: 1322 microversion: 2.1 time: 0.152878 Oct 12 13:56:38.942566 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1031/2088] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:56:38 2022] GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:56:39.966611 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a599d06e-bbfa-40f3-a42b-fa2989b94fed tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:39.967316 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-a599d06e-bbfa-40f3-a42b-fa2989b94fed tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] [instance: a6ef5641-3a33-431e-8e6f-cd00fc71d577] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:56:39.973467 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a599d06e-bbfa-40f3-a42b-fa2989b94fed tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:39.973953 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a599d06e-bbfa-40f3-a42b-fa2989b94fed tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:39.974391 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a599d06e-bbfa-40f3-a42b-fa2989b94fed tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:39.975091 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a599d06e-bbfa-40f3-a42b-fa2989b94fed tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:39.975552 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a599d06e-bbfa-40f3-a42b-fa2989b94fed tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:39.977682 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-a599d06e-bbfa-40f3-a42b-fa2989b94fed tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:40.130933 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-a599d06e-bbfa-40f3-a42b-fa2989b94fed tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8fb8aa25f4491581623856a90c6475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59616722954b7684da82dd5462b76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:56:40.139341 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a599d06e-bbfa-40f3-a42b-fa2989b94fed tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] 10.222.0.52 "GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577" status: 200 len: 1322 microversion: 2.1 time: 0.177894 Oct 12 13:56:40.139910 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1058/2089] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:56:39 2022] GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:56:41.162543 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-148042d4-948c-4462-bb74-7e76bd57d44e tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:41.163162 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-148042d4-948c-4462-bb74-7e76bd57d44e tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] [instance: a6ef5641-3a33-431e-8e6f-cd00fc71d577] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:56:41.169415 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-148042d4-948c-4462-bb74-7e76bd57d44e tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:41.169904 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-148042d4-948c-4462-bb74-7e76bd57d44e tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:41.170346 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-148042d4-948c-4462-bb74-7e76bd57d44e tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:41.171042 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-148042d4-948c-4462-bb74-7e76bd57d44e tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:41.171494 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-148042d4-948c-4462-bb74-7e76bd57d44e tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:41.171957 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-148042d4-948c-4462-bb74-7e76bd57d44e tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:41.303907 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-148042d4-948c-4462-bb74-7e76bd57d44e tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8fb8aa25f4491581623856a90c6475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59616722954b7684da82dd5462b76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:56:41.312283 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-148042d4-948c-4462-bb74-7e76bd57d44e tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] 10.222.0.52 "GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577" status: 200 len: 1322 microversion: 2.1 time: 0.153633 Oct 12 13:56:41.312853 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1032/2090] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:56:41 2022] GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:56:42.337275 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-127a6563-e41a-4562-953e-540319e13c7d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:42.338381 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-127a6563-e41a-4562-953e-540319e13c7d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] [instance: a6ef5641-3a33-431e-8e6f-cd00fc71d577] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:56:42.344770 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-127a6563-e41a-4562-953e-540319e13c7d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:42.345276 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-127a6563-e41a-4562-953e-540319e13c7d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:42.345711 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-127a6563-e41a-4562-953e-540319e13c7d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:42.346398 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-127a6563-e41a-4562-953e-540319e13c7d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:42.346849 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-127a6563-e41a-4562-953e-540319e13c7d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:42.347273 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-127a6563-e41a-4562-953e-540319e13c7d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:42.472090 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-127a6563-e41a-4562-953e-540319e13c7d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8fb8aa25f4491581623856a90c6475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59616722954b7684da82dd5462b76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:56:42.479605 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-127a6563-e41a-4562-953e-540319e13c7d tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] 10.222.0.52 "GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577" status: 200 len: 1322 microversion: 2.1 time: 0.146528 Oct 12 13:56:42.480173 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1059/2091] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:56:42 2022] GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:56:43.263667 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:56:43.265015 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=8 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:56:43.332996 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-ca6d2682-5262-4599-94dc-384698d4495a req-78f660cf-6957-4b60-9f26-b8f6a3e9c0b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6ef5641-3a33-431e-8e6f-cd00fc71d577", "name": "network-vif-plugged", "status": "completed", "tag": "909aeeb0-c218-4b97-be11-0a22eee292f7"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:56:43.342864 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ca6d2682-5262-4599-94dc-384698d4495a req-78f660cf-6957-4b60-9f26-b8f6a3e9c0b5 service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:43.361552 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ca6d2682-5262-4599-94dc-384698d4495a req-78f660cf-6957-4b60-9f26-b8f6a3e9c0b5 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:43.361552 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ca6d2682-5262-4599-94dc-384698d4495a req-78f660cf-6957-4b60-9f26-b8f6a3e9c0b5 service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:43.361552 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-ca6d2682-5262-4599-94dc-384698d4495a req-78f660cf-6957-4b60-9f26-b8f6a3e9c0b5 service nova] Creating event network-vif-plugged:909aeeb0-c218-4b97-be11-0a22eee292f7 for instance a6ef5641-3a33-431e-8e6f-cd00fc71d577 on n-h1-861076-2 Oct 12 13:56:43.362112 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-ca6d2682-5262-4599-94dc-384698d4495a req-78f660cf-6957-4b60-9f26-b8f6a3e9c0b5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098598 Oct 12 13:56:43.362333 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1033/2092] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:56:43.502035 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f8bf27cd-0dc3-4fea-b556-aa9607e14998 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:43.502648 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-f8bf27cd-0dc3-4fea-b556-aa9607e14998 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] [instance: a6ef5641-3a33-431e-8e6f-cd00fc71d577] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:56:43.509759 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f8bf27cd-0dc3-4fea-b556-aa9607e14998 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:43.510275 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f8bf27cd-0dc3-4fea-b556-aa9607e14998 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:43.510711 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f8bf27cd-0dc3-4fea-b556-aa9607e14998 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:43.511407 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f8bf27cd-0dc3-4fea-b556-aa9607e14998 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:43.511856 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f8bf27cd-0dc3-4fea-b556-aa9607e14998 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:43.512277 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-f8bf27cd-0dc3-4fea-b556-aa9607e14998 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:43.640142 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-f8bf27cd-0dc3-4fea-b556-aa9607e14998 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8fb8aa25f4491581623856a90c6475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59616722954b7684da82dd5462b76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:56:43.647719 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f8bf27cd-0dc3-4fea-b556-aa9607e14998 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] 10.222.0.52 "GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577" status: 200 len: 1322 microversion: 2.1 time: 0.149539 Oct 12 13:56:43.648287 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1060/2093] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:56:43 2022] GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:56:44.673946 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9a4f7591-73c9-4be0-a07f-50fc1ea0ad95 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:44.674707 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9a4f7591-73c9-4be0-a07f-50fc1ea0ad95 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] [instance: a6ef5641-3a33-431e-8e6f-cd00fc71d577] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:56:44.680996 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9a4f7591-73c9-4be0-a07f-50fc1ea0ad95 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:44.681481 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9a4f7591-73c9-4be0-a07f-50fc1ea0ad95 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:44.681914 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9a4f7591-73c9-4be0-a07f-50fc1ea0ad95 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:44.682596 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9a4f7591-73c9-4be0-a07f-50fc1ea0ad95 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:44.683044 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9a4f7591-73c9-4be0-a07f-50fc1ea0ad95 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:44.683463 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9a4f7591-73c9-4be0-a07f-50fc1ea0ad95 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:44.811646 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-9a4f7591-73c9-4be0-a07f-50fc1ea0ad95 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8fb8aa25f4491581623856a90c6475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59616722954b7684da82dd5462b76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:56:44.819560 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9a4f7591-73c9-4be0-a07f-50fc1ea0ad95 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] 10.222.0.52 "GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577" status: 200 len: 1472 microversion: 2.1 time: 0.151689 Oct 12 13:56:44.820138 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1034/2094] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:56:44 2022] GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577 => generated 1472 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:56:44.846227 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:56:44.893344 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-47c5456a-d319-46d9-b21d-323be48af450 tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Calling method '.version_select at 0x7f8aa3e50a60>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:44.957558 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-47c5456a-d319-46d9-b21d-323be48af450 tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/b91e5964b2a243ed901cb1c4d2d6d0ef" status: 200 len: 371 microversion: 2.1 time: 0.115775 Oct 12 13:56:44.958137 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1061/2095] 10.222.0.52 () {58 vars in 1242 bytes} [Wed Oct 12 13:56:44 2022] GET /compute/v2.1/os-quota-sets/b91e5964b2a243ed901cb1c4d2d6d0ef => generated 371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:56:44.971135 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e28615ee-37b5-4d25-b22f-452e8b998426 tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1193610080", "id": 1635235832, "os-flavor-access:is_public": "True"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:56:45.060074 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e28615ee-37b5-4d25-b22f-452e8b998426 tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.092517 Oct 12 13:56:45.060672 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1035/2096] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:56:44 2022] POST /compute/v2.1/flavors => generated 438 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:56:45.073546 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-643b0dc5-70a4-4a16-aedd-5088534e8a03 tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1635235832"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:56:45.075821 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-643b0dc5-70a4-4a16-aedd-5088534e8a03 tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] [instance: a6ef5641-3a33-431e-8e6f-cd00fc71d577] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:56:45.082469 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-643b0dc5-70a4-4a16-aedd-5088534e8a03 tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:45.082949 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-643b0dc5-70a4-4a16-aedd-5088534e8a03 tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:45.085976 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-643b0dc5-70a4-4a16-aedd-5088534e8a03 tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:45.085976 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-643b0dc5-70a4-4a16-aedd-5088534e8a03 tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:45.085976 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-643b0dc5-70a4-4a16-aedd-5088534e8a03 tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:45.085976 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-643b0dc5-70a4-4a16-aedd-5088534e8a03 tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-643b0dc5-70a4-4a16-aedd-5088534e8a03 tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-874e9afb-243e-4c15-bb5a-842cfb42f8d5) Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:56:45.178037 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-874e9afb-243e-4c15-bb5a-842cfb42f8d5) Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-643b0dc5-70a4-4a16-aedd-5088534e8a03 tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-643b0dc5-70a4-4a16-aedd-5088534e8a03 tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Request method failure captured: Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577/action HTTP/1.1 Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 39 Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRseP81tk3v058rI3GZdGdWM4D02uvwgE1xhklC0XRfjv1r5LcSSpHdMMINTXfrXwLNsiF2ndCRTYPxTVs-9F9F5MBVFkKEXI_krNsiI3kCk_wlUQifxVQcBuW2XadCFUskVWkgI3242FnLYbJJillpUUeOUfLdYFmoOwEY-144LNDvg Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: b91e5964b2a243ed901cb1c4d2d6d0ef Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1916583520 Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,admin,reader Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,admin,reader Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b91e5964b2a243ed901cb1c4d2d6d0ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b91e5964b2a243ed901cb1c4d2d6d0ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b91e5964b2a243ed901cb1c4d2d6d0ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b91e5964b2a243ed901cb1c4d2d6d0ef"}]}] Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1916583520 Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: b91e5964b2a243ed901cb1c4d2d6d0ef Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1916583520 Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServersAdminNegativeTestJSON-1916583520-project-admin Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 23405fb428264a8aa06a1c2d7b6da03b Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1916583520-project-admin Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: {"resize": {"flavorRef": "1635235832"}} Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'id': 'a6ef5641-3a33-431e-8e6f-cd00fc71d577', 'body': {'resize': {'flavorRef': '1635235832'}}} Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 12 13:56:45.183485 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:56:45.188783 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-874e9afb-243e-4c15-bb5a-842cfb42f8d5) Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-643b0dc5-70a4-4a16-aedd-5088534e8a03 tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-643b0dc5-70a4-4a16-aedd-5088534e8a03 tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577/action" status: 500 len: 214 microversion: 2.1 time: 0.113446 Oct 12 13:56:45.193178 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1062/2097] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:56:45 2022] POST /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577/action => generated 214 bytes in 115 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 12 13:56:45.195573 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b74aa593-a8d5-45c8-8cc0-e04f05f9c885 tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:45.257927 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b74aa593-a8d5-45c8-8cc0-e04f05f9c885 tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1635235832" status: 202 len: 0 microversion: 2.1 time: 0.067813 Oct 12 13:56:45.258500 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1036/2098] 10.222.0.52 () {58 vars in 1161 bytes} [Wed Oct 12 13:56:45 2022] DELETE /compute/v2.1/flavors/1635235832 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:56:45.267053 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a27fe6f7-fb1b-4059-8cd6-8a575efec0e4 tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:45.286763 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a27fe6f7-fb1b-4059-8cd6-8a575efec0e4 tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023247 Oct 12 13:56:45.287330 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1063/2099] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:56:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 13:56:45.312748 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c432630d-c45e-4042-857f-bce7ce1a0bcc tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Calling method '.version_select at 0x7f8aa3db8550>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:45.387186 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c432630d-c45e-4042-857f-bce7ce1a0bcc tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/b91e5964b2a243ed901cb1c4d2d6d0ef" status: 200 len: 371 microversion: 2.1 time: 0.078003 Oct 12 13:56:45.387751 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1037/2100] 10.222.0.52 () {58 vars in 1242 bytes} [Wed Oct 12 13:56:45 2022] GET /compute/v2.1/os-quota-sets/b91e5964b2a243ed901cb1c4d2d6d0ef => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:56:45.404956 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-78e70d83-5660-41ab-a35f-ad259389ebef tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1147312451", "id": 998624007, "os-flavor-access:is_public": "True"}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:56:45.500040 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-78e70d83-5660-41ab-a35f-ad259389ebef tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.099795 Oct 12 13:56:45.500639 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1064/2101] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:56:45 2022] POST /compute/v2.1/flavors => generated 434 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:56:45.513320 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-86b1c178-db8f-41f3-a8d3-a971213dc14f tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "998624007"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:56:45.515734 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-86b1c178-db8f-41f3-a8d3-a971213dc14f tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] [instance: a6ef5641-3a33-431e-8e6f-cd00fc71d577] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:56:45.521735 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-86b1c178-db8f-41f3-a8d3-a971213dc14f tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:45.528063 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-86b1c178-db8f-41f3-a8d3-a971213dc14f tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:45.528063 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-86b1c178-db8f-41f3-a8d3-a971213dc14f tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:45.528063 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-86b1c178-db8f-41f3-a8d3-a971213dc14f tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:45.528063 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-86b1c178-db8f-41f3-a8d3-a971213dc14f tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:45.528063 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-86b1c178-db8f-41f3-a8d3-a971213dc14f tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-86b1c178-db8f-41f3-a8d3-a971213dc14f tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f804bd46-76a2-4746-8c00-ff7d0fecdf54) Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:56:45.612374 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f804bd46-76a2-4746-8c00-ff7d0fecdf54) Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-86b1c178-db8f-41f3-a8d3-a971213dc14f tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-86b1c178-db8f-41f3-a8d3-a971213dc14f tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Request method failure captured: Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577/action HTTP/1.1 Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 38 Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRseP81tk3v058rI3GZdGdWM4D02uvwgE1xhklC0XRfjv1r5LcSSpHdMMINTXfrXwLNsiF2ndCRTYPxTVs-9F9F5MBVFkKEXI_krNsiI3kCk_wlUQifxVQcBuW2XadCFUskVWkgI3242FnLYbJJillpUUeOUfLdYFmoOwEY-144LNDvg Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: b91e5964b2a243ed901cb1c4d2d6d0ef Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1916583520 Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,admin,reader Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,admin,reader Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b91e5964b2a243ed901cb1c4d2d6d0ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b91e5964b2a243ed901cb1c4d2d6d0ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b91e5964b2a243ed901cb1c4d2d6d0ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b91e5964b2a243ed901cb1c4d2d6d0ef"}]}] Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1916583520 Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: b91e5964b2a243ed901cb1c4d2d6d0ef Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1916583520 Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServersAdminNegativeTestJSON-1916583520-project-admin Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 23405fb428264a8aa06a1c2d7b6da03b Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1916583520-project-admin Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: {"resize": {"flavorRef": "998624007"}} Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'a6ef5641-3a33-431e-8e6f-cd00fc71d577', 'body': {'resize': {'flavorRef': '998624007'}}} Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 12 13:56:45.616493 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:56:45.621965 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f804bd46-76a2-4746-8c00-ff7d0fecdf54) Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-86b1c178-db8f-41f3-a8d3-a971213dc14f tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-86b1c178-db8f-41f3-a8d3-a971213dc14f tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577/action" status: 500 len: 214 microversion: 2.1 time: 0.106943 Oct 12 13:56:45.626322 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1038/2102] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Oct 12 13:56:45 2022] POST /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577/action => generated 214 bytes in 108 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:56:45.628599 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-1cb2bce9-96fa-4a2a-81c5-c59e9a00acaa tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:45.699839 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-1cb2bce9-96fa-4a2a-81c5-c59e9a00acaa tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/998624007" status: 202 len: 0 microversion: 2.1 time: 0.077615 Oct 12 13:56:45.700406 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1065/2103] 10.222.0.52 () {58 vars in 1158 bytes} [Wed Oct 12 13:56:45 2022] DELETE /compute/v2.1/flavors/998624007 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:56:45.708862 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d4e37289-725a-4ba6-b10c-eb92cf3b3fc3 tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:45.729690 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d4e37289-725a-4ba6-b10c-eb92cf3b3fc3 tempest-ServersAdminNegativeTestJSON-1916583520 tempest-ServersAdminNegativeTestJSON-1916583520-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024976 Oct 12 13:56:45.730241 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1039/2104] 10.222.0.52 () {58 vars in 1146 bytes} [Wed Oct 12 13:56:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:56:45.752018 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-9bd4c07d-085e-4e76-a622-d38eaf0b101b tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:45.752455 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-9bd4c07d-085e-4e76-a622-d38eaf0b101b tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] [instance: a6ef5641-3a33-431e-8e6f-cd00fc71d577] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:56:45.758459 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9bd4c07d-085e-4e76-a622-d38eaf0b101b tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:45.758943 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9bd4c07d-085e-4e76-a622-d38eaf0b101b tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:45.759378 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9bd4c07d-085e-4e76-a622-d38eaf0b101b tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:45.760091 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9bd4c07d-085e-4e76-a622-d38eaf0b101b tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:45.760544 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9bd4c07d-085e-4e76-a622-d38eaf0b101b tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:45.760991 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-9bd4c07d-085e-4e76-a622-d38eaf0b101b tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:45.786229 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-9bd4c07d-085e-4e76-a622-d38eaf0b101b tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] [instance: a6ef5641-3a33-431e-8e6f-cd00fc71d577] Going to try to terminate instance {{(pid=120933) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 13:56:45.997072 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-9bd4c07d-085e-4e76-a622-d38eaf0b101b tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577" status: 204 len: 0 microversion: 2.1 time: 0.248262 Oct 12 13:56:45.997769 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1066/2105] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Oct 12 13:56:45 2022] DELETE /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 13:56:46.005295 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ead56ad1-6bb5-4979-b081-6bde197f15b3 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:46.005912 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ead56ad1-6bb5-4979-b081-6bde197f15b3 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] [instance: a6ef5641-3a33-431e-8e6f-cd00fc71d577] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:56:46.011811 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ead56ad1-6bb5-4979-b081-6bde197f15b3 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:46.012294 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ead56ad1-6bb5-4979-b081-6bde197f15b3 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:46.014138 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ead56ad1-6bb5-4979-b081-6bde197f15b3 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:46.014138 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ead56ad1-6bb5-4979-b081-6bde197f15b3 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:46.014138 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ead56ad1-6bb5-4979-b081-6bde197f15b3 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:46.014458 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ead56ad1-6bb5-4979-b081-6bde197f15b3 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:46.145425 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.policy [None req-ead56ad1-6bb5-4979-b081-6bde197f15b3 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8fb8aa25f4491581623856a90c6475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59616722954b7684da82dd5462b76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:56:46.153629 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ead56ad1-6bb5-4979-b081-6bde197f15b3 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] 10.222.0.52 "GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577" status: 200 len: 1478 microversion: 2.1 time: 0.152148 Oct 12 13:56:46.154186 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1040/2106] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:56:46 2022] GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577 => generated 1478 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:56:47.178461 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-21073eaa-6d7e-43c5-89e6-4d369686a7e3 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:47.179380 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-21073eaa-6d7e-43c5-89e6-4d369686a7e3 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] [instance: a6ef5641-3a33-431e-8e6f-cd00fc71d577] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:56:47.185573 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-21073eaa-6d7e-43c5-89e6-4d369686a7e3 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:47.186059 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-21073eaa-6d7e-43c5-89e6-4d369686a7e3 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:47.186496 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-21073eaa-6d7e-43c5-89e6-4d369686a7e3 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:47.187184 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-21073eaa-6d7e-43c5-89e6-4d369686a7e3 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:47.187637 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-21073eaa-6d7e-43c5-89e6-4d369686a7e3 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:47.188057 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-21073eaa-6d7e-43c5-89e6-4d369686a7e3 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:47.380070 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-21073eaa-6d7e-43c5-89e6-4d369686a7e3 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8fb8aa25f4491581623856a90c6475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59616722954b7684da82dd5462b76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:56:47.388836 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-21073eaa-6d7e-43c5-89e6-4d369686a7e3 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] 10.222.0.52 "GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577" status: 200 len: 1478 microversion: 2.1 time: 0.215506 Oct 12 13:56:47.389441 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1067/2107] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:56:47 2022] GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577 => generated 1478 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:56:47.817134 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-52f144ff-8bc0-4b30-bea6-9954cf91f95e req-a45b55c0-6d33-4f49-8e5d-89fbda19d68c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6ef5641-3a33-431e-8e6f-cd00fc71d577", "name": "network-vif-deleted", "tag": "909aeeb0-c218-4b97-be11-0a22eee292f7"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:56:47.827423 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-52f144ff-8bc0-4b30-bea6-9954cf91f95e req-a45b55c0-6d33-4f49-8e5d-89fbda19d68c service nova] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:47.827901 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-52f144ff-8bc0-4b30-bea6-9954cf91f95e req-a45b55c0-6d33-4f49-8e5d-89fbda19d68c service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:47.829118 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-52f144ff-8bc0-4b30-bea6-9954cf91f95e req-a45b55c0-6d33-4f49-8e5d-89fbda19d68c service nova] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:47.841262 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-52f144ff-8bc0-4b30-bea6-9954cf91f95e req-a45b55c0-6d33-4f49-8e5d-89fbda19d68c service nova] Creating event network-vif-deleted:909aeeb0-c218-4b97-be11-0a22eee292f7 for instance a6ef5641-3a33-431e-8e6f-cd00fc71d577 on n-h1-861076-2 Oct 12 13:56:47.846678 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-52f144ff-8bc0-4b30-bea6-9954cf91f95e req-a45b55c0-6d33-4f49-8e5d-89fbda19d68c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033387 Oct 12 13:56:47.847293 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1041/2108] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Oct 12 13:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:56:48.411493 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-919cd0da-604a-426a-b0ea-14de28a5c3b4 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Calling method '>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:48.412108 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.compute.api [None req-919cd0da-604a-426a-b0ea-14de28a5c3b4 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] [instance: a6ef5641-3a33-431e-8e6f-cd00fc71d577] Fetching instance by UUID {{(pid=120933) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:56:48.420195 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-919cd0da-604a-426a-b0ea-14de28a5c3b4 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:48.420675 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-919cd0da-604a-426a-b0ea-14de28a5c3b4 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:48.421139 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-919cd0da-604a-426a-b0ea-14de28a5c3b4 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:48.421840 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-919cd0da-604a-426a-b0ea-14de28a5c3b4 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:48.422290 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-919cd0da-604a-426a-b0ea-14de28a5c3b4 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:48.422713 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-919cd0da-604a-426a-b0ea-14de28a5c3b4 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:48.461893 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-919cd0da-604a-426a-b0ea-14de28a5c3b4 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:48.461893 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-919cd0da-604a-426a-b0ea-14de28a5c3b4 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:48.461893 n-d-861076-2 devstack@n-api.service[120933]: DEBUG oslo_concurrency.lockutils [None req-919cd0da-604a-426a-b0ea-14de28a5c3b4 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:48.461893 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.objects.instance [None req-919cd0da-604a-426a-b0ea-14de28a5c3b4 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lazy-loading 'fault' on Instance uuid a6ef5641-3a33-431e-8e6f-cd00fc71d577 {{(pid=120933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 13:56:48.502654 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.policy [None req-919cd0da-604a-426a-b0ea-14de28a5c3b4 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb8fb8aa25f4491581623856a90c6475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd59616722954b7684da82dd5462b76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120933) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 13:56:48.510653 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-919cd0da-604a-426a-b0ea-14de28a5c3b4 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] 10.222.0.52 "GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577" status: 200 len: 1312 microversion: 2.1 time: 0.102954 Oct 12 13:56:48.511225 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1068/2109] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:56:48 2022] GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577 => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 13:56:49.534548 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7259d244-da23-4c92-8238-6fd771059cb9 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:56:49.535256 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7259d244-da23-4c92-8238-6fd771059cb9 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] [instance: a6ef5641-3a33-431e-8e6f-cd00fc71d577] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 13:56:49.541544 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7259d244-da23-4c92-8238-6fd771059cb9 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:49.542024 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7259d244-da23-4c92-8238-6fd771059cb9 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:49.542462 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7259d244-da23-4c92-8238-6fd771059cb9 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:49.543156 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7259d244-da23-4c92-8238-6fd771059cb9 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Acquiring lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 13:56:49.543608 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7259d244-da23-4c92-8238-6fd771059cb9 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 13:56:49.544034 n-d-861076-2 devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7259d244-da23-4c92-8238-6fd771059cb9 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Lock "c7d37a9d-54da-4741-8e88-e51a0f3ae3d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 13:56:49.557581 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-7259d244-da23-4c92-8238-6fd771059cb9 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] HTTP exception thrown: Instance a6ef5641-3a33-431e-8e6f-cd00fc71d577 could not be found. Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7259d244-da23-4c92-8238-6fd771059cb9 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Request method failure captured: Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577 HTTP/1.1 Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 0 Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRseOdcGkUCPOIcZLx5q1PugwL7UP6_Z2kQdnuLuzI5aVuDzxSnduM_cTou00UYo6UaCrXY5cibE_VUYfzZafLKT2c5w7wLyJyrSQc_yVJGCGyfYiLLaVWEbgMa0Dyrw964WAH39GQp8ucIBWjgEM-zGKCSF05GBy1YkuHUVJeb4CCBc Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: dd59616722954b7684da82dd5462b76d Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1942254201 Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dd59616722954b7684da82dd5462b76d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dd59616722954b7684da82dd5462b76d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dd59616722954b7684da82dd5462b76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dd59616722954b7684da82dd5462b76d"}]}] Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1942254201 Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: dd59616722954b7684da82dd5462b76d Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1942254201 Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServersAdminNegativeTestJSON-1942254201-project Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: cb8fb8aa25f4491581623856a90c6475 Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1942254201-project Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: exception: Instance a6ef5641-3a33-431e-8e6f-cd00fc71d577 could not be found. Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'id': 'a6ef5641-3a33-431e-8e6f-cd00fc71d577'} Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6ef5641-3a33-431e-8e6f-cd00fc71d577 could not be found. Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6ef5641-3a33-431e-8e6f-cd00fc71d577 could not be found. Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:56:49.559170 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:56:49.564504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:56:49.564504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:56:49.564504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:56:49.564504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:56:49.564504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:56:49.564504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:56:49.564504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6ef5641-3a33-431e-8e6f-cd00fc71d577 could not be found. Oct 12 13:56:49.564504 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:56:49.564504 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7259d244-da23-4c92-8238-6fd771059cb9 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] Returning 404 to user: Instance a6ef5641-3a33-431e-8e6f-cd00fc71d577 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:56:49.564504 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7259d244-da23-4c92-8238-6fd771059cb9 tempest-ServersAdminNegativeTestJSON-1942254201 tempest-ServersAdminNegativeTestJSON-1942254201-project] 10.222.0.52 "GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577" status: 404 len: 111 microversion: 2.1 time: 0.030755 Oct 12 13:56:49.564504 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1042/2110] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Oct 12 13:56:49 2022] GET /compute/v2.1/servers/a6ef5641-3a33-431e-8e6f-cd00fc71d577 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 13:56:57.974728 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:56:58.091451 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-682c163b-840b-4236-9600-efe4a4706880 tempest-DeleteServersTestJSON-1355932342 tempest-DeleteServersTestJSON-1355932342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1034141408", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "f56fea43-11bb-4057-9f8a-7bd60836152a"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:56:58.147753 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-682c163b-840b-4236-9600-efe4a4706880 tempest-DeleteServersTestJSON-1355932342 tempest-DeleteServersTestJSON-1355932342-project] validate_networks() for [('f56fea43-11bb-4057-9f8a-7bd60836152a', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-682c163b-840b-4236-9600-efe4a4706880 tempest-DeleteServersTestJSON-1355932342 tempest-DeleteServersTestJSON-1355932342-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7cef7dd3-48a9-40f3-8871-c5db550f5766) Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:56:58.346768 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7cef7dd3-48a9-40f3-8871-c5db550f5766) Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-682c163b-840b-4236-9600-efe4a4706880 tempest-DeleteServersTestJSON-1355932342 tempest-DeleteServersTestJSON-1355932342-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-682c163b-840b-4236-9600-efe4a4706880 tempest-DeleteServersTestJSON-1355932342 tempest-DeleteServersTestJSON-1355932342-project] Request method failure captured: Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 207 Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsepZVpX9wgE-s-HLXCDUFjfzz40neN4hue9nJQN70-wpY-KnmyDecuwrvqJ8g0DadqZA5RhoUUSUQgMXgULKI2-njes-LlERlaAnHYSYO2i2JEvfw0SGnv5jL4i75b98Edy0W4pLZR6mjv5GtHUVAu4tlH6aTHdxMCWY14qK0BUR44 Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 6350d93f67b6481d8304ab9da1b3ebd9 Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-DeleteServersTestJSON-1355932342 Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6350d93f67b6481d8304ab9da1b3ebd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6350d93f67b6481d8304ab9da1b3ebd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6350d93f67b6481d8304ab9da1b3ebd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6350d93f67b6481d8304ab9da1b3ebd9"}]}] Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-DeleteServersTestJSON-1355932342 Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 6350d93f67b6481d8304ab9da1b3ebd9 Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-DeleteServersTestJSON-1355932342 Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-DeleteServersTestJSON-1355932342-project Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: c54c9c65d52f483aac0e098ac58577d2 Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-DeleteServersTestJSON-1355932342-project Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-DeleteServersTestJSON-server-1034141408", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "f56fea43-11bb-4057-9f8a-7bd60836152a"}]}} Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-1034141408', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': 'f56fea43-11bb-4057-9f8a-7bd60836152a'}]}}} Oct 12 13:56:58.351288 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:56:58.355870 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7cef7dd3-48a9-40f3-8871-c5db550f5766) Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-682c163b-840b-4236-9600-efe4a4706880 tempest-DeleteServersTestJSON-1355932342 tempest-DeleteServersTestJSON-1355932342-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-682c163b-840b-4236-9600-efe4a4706880 tempest-DeleteServersTestJSON-1355932342 tempest-DeleteServersTestJSON-1355932342-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.381409 Oct 12 13:56:58.360201 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1069/2111] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:56:57 2022] POST /compute/v2.1/servers => generated 214 bytes in 383 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:57:08.905543 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:57:08.906334 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:57:08.906957 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=48 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:57:09.038779 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4835625e-5e6e-4657-90b1-f8458781bb0e tempest-ServerDiskConfigTestJSON-302345585 tempest-ServerDiskConfigTestJSON-302345585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-935739291", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "6ddab9f3-bd6f-476f-8fc0-263193d10b9b"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:57:09.093391 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-4835625e-5e6e-4657-90b1-f8458781bb0e tempest-ServerDiskConfigTestJSON-302345585 tempest-ServerDiskConfigTestJSON-302345585-project] validate_networks() for [('6ddab9f3-bd6f-476f-8fc0-263193d10b9b', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-4835625e-5e6e-4657-90b1-f8458781bb0e tempest-ServerDiskConfigTestJSON-302345585 tempest-ServerDiskConfigTestJSON-302345585-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-591bffe5-c0b0-40f7-8a3f-cd3c234d3621) Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:57:09.309073 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-591bffe5-c0b0-40f7-8a3f-cd3c234d3621) Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-4835625e-5e6e-4657-90b1-f8458781bb0e tempest-ServerDiskConfigTestJSON-302345585 tempest-ServerDiskConfigTestJSON-302345585-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4835625e-5e6e-4657-90b1-f8458781bb0e tempest-ServerDiskConfigTestJSON-302345585 tempest-ServerDiskConfigTestJSON-302345585-project] Request method failure captured: Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 209 Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRse0-pL7k5tdDpKaVkUtkrKcFvJa2JAXLNAgG1ghrOgcO1HDSqAxzF9L3992j8-St069PLVb9GZCbfVTnZZs6MjotIRyqIUX6z7qu17W5N0sKBVnTJjGAaCIWwLlYVN11yYwY6h9kSvc15drcpVlczznMnoVUNaXE27NvaE-zeEr3cI Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 86b2c4aef8c744f388ef21dcc23b5ddc Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-ServerDiskConfigTestJSON-302345585 Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/86b2c4aef8c744f388ef21dcc23b5ddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_86b2c4aef8c744f388ef21dcc23b5ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86b2c4aef8c744f388ef21dcc23b5ddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86b2c4aef8c744f388ef21dcc23b5ddc"}]}] Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-ServerDiskConfigTestJSON-302345585 Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 86b2c4aef8c744f388ef21dcc23b5ddc Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-302345585 Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-ServerDiskConfigTestJSON-302345585-project Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: e7b0bea5e0fc4df88f9b36f68bfe9f64 Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-ServerDiskConfigTestJSON-302345585-project Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-935739291", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "6ddab9f3-bd6f-476f-8fc0-263193d10b9b"}]}} Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:57:09.313053 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-935739291', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '6ddab9f3-bd6f-476f-8fc0-263193d10b9b'}]}}} Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:57:09.317663 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-591bffe5-c0b0-40f7-8a3f-cd3c234d3621) Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4835625e-5e6e-4657-90b1-f8458781bb0e tempest-ServerDiskConfigTestJSON-302345585 tempest-ServerDiskConfigTestJSON-302345585-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4835625e-5e6e-4657-90b1-f8458781bb0e tempest-ServerDiskConfigTestJSON-302345585 tempest-ServerDiskConfigTestJSON-302345585-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.413617 Oct 12 13:57:09.323820 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1043/2112] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:57:08 2022] POST /compute/v2.1/servers => generated 214 bytes in 415 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:57:09.361987 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:57:09.363412 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=4,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:57:09.367362 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c8c382be-2a0a-4f30-b142-4c822c195d7e tempest-ServerDiskConfigTestJSON-302345585 tempest-ServerDiskConfigTestJSON-302345585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-948436963", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "6ddab9f3-bd6f-476f-8fc0-263193d10b9b"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:57:09.421447 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-c8c382be-2a0a-4f30-b142-4c822c195d7e tempest-ServerDiskConfigTestJSON-302345585 tempest-ServerDiskConfigTestJSON-302345585-project] validate_networks() for [('6ddab9f3-bd6f-476f-8fc0-263193d10b9b', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-c8c382be-2a0a-4f30-b142-4c822c195d7e tempest-ServerDiskConfigTestJSON-302345585 tempest-ServerDiskConfigTestJSON-302345585-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e206ff8f-d52f-45df-89a3-38e3656fb574) Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:57:09.647522 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e206ff8f-d52f-45df-89a3-38e3656fb574) Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-c8c382be-2a0a-4f30-b142-4c822c195d7e tempest-ServerDiskConfigTestJSON-302345585 tempest-ServerDiskConfigTestJSON-302345585-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c8c382be-2a0a-4f30-b142-4c822c195d7e tempest-ServerDiskConfigTestJSON-302345585 tempest-ServerDiskConfigTestJSON-302345585-project] Request method failure captured: Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 209 Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRse0-pL7k5tdDpKaVkUtkrKcFvJa2JAXLNAgG1ghrOgcO1HDSqAxzF9L3992j8-St069PLVb9GZCbfVTnZZs6MjotIRyqIUX6z7qu17W5N0sKBVnTJjGAaCIWwLlYVN11yYwY6h9kSvc15drcpVlczznMnoVUNaXE27NvaE-zeEr3cI Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 86b2c4aef8c744f388ef21dcc23b5ddc Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServerDiskConfigTestJSON-302345585 Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/86b2c4aef8c744f388ef21dcc23b5ddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_86b2c4aef8c744f388ef21dcc23b5ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86b2c4aef8c744f388ef21dcc23b5ddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86b2c4aef8c744f388ef21dcc23b5ddc"}]}] Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServerDiskConfigTestJSON-302345585 Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 86b2c4aef8c744f388ef21dcc23b5ddc Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-302345585 Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServerDiskConfigTestJSON-302345585-project Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: e7b0bea5e0fc4df88f9b36f68bfe9f64 Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServerDiskConfigTestJSON-302345585-project Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-948436963", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "6ddab9f3-bd6f-476f-8fc0-263193d10b9b"}]}} Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:57:09.651918 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-948436963', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '6ddab9f3-bd6f-476f-8fc0-263193d10b9b'}]}}} Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:57:09.659063 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e206ff8f-d52f-45df-89a3-38e3656fb574) Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c8c382be-2a0a-4f30-b142-4c822c195d7e tempest-ServerDiskConfigTestJSON-302345585 tempest-ServerDiskConfigTestJSON-302345585-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c8c382be-2a0a-4f30-b142-4c822c195d7e tempest-ServerDiskConfigTestJSON-302345585 tempest-ServerDiskConfigTestJSON-302345585-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.290474 Oct 12 13:57:09.663702 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1070/2113] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:57:09 2022] POST /compute/v2.1/servers => generated 214 bytes in 292 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:57:20.690263 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:57:20.843217 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5da12eb4-82cd-45b7-9bff-79a164852b42 tempest-ServerActionsTestJSON-2005680867 tempest-ServerActionsTestJSON-2005680867-project] Action: 'create', calling method: .version_select at 0x7f8aa3d75700>, body: {"keypair": {"name": "tempest-keypair-1493902082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCe/P6aZD0wSluAYMFEqLYT9WwCxBfug2QeZSyWyOlPP3zxSL82h7PycPnkBwcf47HtlipRiufDbW16VSXUp+zqXMXLS7Q7nBBIgydopBY32xj7HfOt6LS4x2EJLnNoKw=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:57:20.859943 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-5da12eb4-82cd-45b7-9bff-79a164852b42 tempest-ServerActionsTestJSON-2005680867 tempest-ServerActionsTestJSON-2005680867-project] Getting quotas for project 9613bc14d72a4e979727ae8ce6fefbf3. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:57:20.865235 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-5da12eb4-82cd-45b7-9bff-79a164852b42 tempest-ServerActionsTestJSON-2005680867 tempest-ServerActionsTestJSON-2005680867-project] Getting quotas for user 16370622c11f4af7b195cc7b23ab7f38 and project 9613bc14d72a4e979727ae8ce6fefbf3. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:57:20.965118 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5da12eb4-82cd-45b7-9bff-79a164852b42 tempest-ServerActionsTestJSON-2005680867 tempest-ServerActionsTestJSON-2005680867-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.276054 Oct 12 13:57:20.968473 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1044/2114] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:57:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:57:23.121950 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:57:23.126356 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e4bf1254-3f9f-4b3b-a06a-eecfdb2a1c22 tempest-ServerActionsTestJSON-2005680867 tempest-ServerActionsTestJSON-2005680867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2058535528", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d82d0456-436b-4a1e-a805-8180f2ff3fd5"}], "security_groups": [{"name": "tempest-securitygroup--1026470226"}], "key_name": "tempest-keypair-1493902082", "user_data": "}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:57:23.237366 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-e4bf1254-3f9f-4b3b-a06a-eecfdb2a1c22 tempest-ServerActionsTestJSON-2005680867 tempest-ServerActionsTestJSON-2005680867-project] validate_networks() for [('d82d0456-436b-4a1e-a805-8180f2ff3fd5', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-e4bf1254-3f9f-4b3b-a06a-eecfdb2a1c22 tempest-ServerActionsTestJSON-2005680867 tempest-ServerActionsTestJSON-2005680867-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d3ca461a-a97d-4f2e-9d41-fa0cfa8ef39d) Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:57:23.446690 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d3ca461a-a97d-4f2e-9d41-fa0cfa8ef39d) Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-e4bf1254-3f9f-4b3b-a06a-eecfdb2a1c22 tempest-ServerActionsTestJSON-2005680867 tempest-ServerActionsTestJSON-2005680867-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e4bf1254-3f9f-4b3b-a06a-eecfdb2a1c22 tempest-ServerActionsTestJSON-2005680867 tempest-ServerActionsTestJSON-2005680867-project] Request method failure captured: Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 494 Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsfAT5AWoPw-mxLdWWfNlh6u1rdd2K3Vo1rNXTk-v5db-iXQjVdi3eab5mVvuGdURJmpfck7wRw7DN39lkKjH3ClsfYGHX9QR4rLnDSNGyaFCT8XTdGma2W6tSAisl28hiU8SANFZOrkkqlAkQc4asShP7odbGJur_cW1JU_e5UN-MU Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 9613bc14d72a4e979727ae8ce6fefbf3 Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServerActionsTestJSON-2005680867 Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9613bc14d72a4e979727ae8ce6fefbf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9613bc14d72a4e979727ae8ce6fefbf3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9613bc14d72a4e979727ae8ce6fefbf3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9613bc14d72a4e979727ae8ce6fefbf3"}]}] Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServerActionsTestJSON-2005680867 Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 9613bc14d72a4e979727ae8ce6fefbf3 Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServerActionsTestJSON-2005680867 Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServerActionsTestJSON-2005680867-project Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 16370622c11f4af7b195cc7b23ab7f38 Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServerActionsTestJSON-2005680867-project Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-ServerActionsTestJSON-server-2058535528", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "adminPass": "K8%az+ZN0E*wCyq", "networks": [{"uuid": "d82d0456-436b-4a1e-a805-8180f2ff3fd5"}], "security_groups": [{"name": "tempest-securitygroup--1026470226"}], "key_name": "tempest-keypair-1493902082", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:57:23.451825 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-ServerActionsTestJSON-server-2058535528', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'adminPass': 'K8%az+ZN0E*wCyq', 'networks': [{'uuid': 'd82d0456-436b-4a1e-a805-8180f2ff3fd5'}], 'security_groups': [{'name': 'tempest-securitygroup--1026470226'}], 'key_name': 'tempest-keypair-1493902082', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:57:23.456660 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d3ca461a-a97d-4f2e-9d41-fa0cfa8ef39d) Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-e4bf1254-3f9f-4b3b-a06a-eecfdb2a1c22 tempest-ServerActionsTestJSON-2005680867 tempest-ServerActionsTestJSON-2005680867-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-e4bf1254-3f9f-4b3b-a06a-eecfdb2a1c22 tempest-ServerActionsTestJSON-2005680867 tempest-ServerActionsTestJSON-2005680867-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.330259 Oct 12 13:57:23.461614 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1071/2115] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:57:23 2022] POST /compute/v2.1/servers => generated 214 bytes in 332 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:57:23.472230 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-dd4b80d1-6feb-4e2d-b1f1-8bc7dd782d68 tempest-ServerActionsTestJSON-2005680867 tempest-ServerActionsTestJSON-2005680867-project] Calling method '.version_select at 0x7f8aa3e003a0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:57:23.619545 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-dd4b80d1-6feb-4e2d-b1f1-8bc7dd782d68 tempest-ServerActionsTestJSON-2005680867 tempest-ServerActionsTestJSON-2005680867-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1493902082" status: 202 len: 0 microversion: 2.1 time: 0.162950 Oct 12 13:57:23.620194 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1045/2116] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Oct 12 13:57:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1493902082 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:57:35.587283 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:57:35.742381 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ee1e9445-51ba-40a5-85f3-f1704b308ff5 tempest-ServersNegativeTestJSON-284623786 tempest-ServersNegativeTestJSON-284623786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1047832049", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "d23a0a31-001b-433f-8c90-2459f03f3139"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:57:35.797969 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-ee1e9445-51ba-40a5-85f3-f1704b308ff5 tempest-ServersNegativeTestJSON-284623786 tempest-ServersNegativeTestJSON-284623786-project] validate_networks() for [('d23a0a31-001b-433f-8c90-2459f03f3139', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-ee1e9445-51ba-40a5-85f3-f1704b308ff5 tempest-ServersNegativeTestJSON-284623786 tempest-ServersNegativeTestJSON-284623786-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c1f58ec3-f086-4ac6-a80c-d0af9db1806c) Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:57:36.000710 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c1f58ec3-f086-4ac6-a80c-d0af9db1806c) Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-ee1e9445-51ba-40a5-85f3-f1704b308ff5 tempest-ServersNegativeTestJSON-284623786 tempest-ServersNegativeTestJSON-284623786-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ee1e9445-51ba-40a5-85f3-f1704b308ff5 tempest-ServersNegativeTestJSON-284623786 tempest-ServersNegativeTestJSON-284623786-project] Request method failure captured: Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 209 Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsfPKPJrCKHq2y7YqJh2n-M3u5JU29eJXbZLLjy5PIAq2D1ZomTdI40G8fy-oyLbPSQHv3YBObIzozIvwlh1EeRNiPkA_xUOeGQ-EtNtsQKwq1NTWpgKivtxG5cWsopIiKOMyKY2-lJEA50BRyhaKqn5QKOa_seICeMOCxBJjZTaZVY Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: dee3bd0a75774470a67a22b32bfd0193 Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-ServersNegativeTestJSON-284623786 Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dee3bd0a75774470a67a22b32bfd0193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dee3bd0a75774470a67a22b32bfd0193"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dee3bd0a75774470a67a22b32bfd0193"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dee3bd0a75774470a67a22b32bfd0193"}]}] Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-ServersNegativeTestJSON-284623786 Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: dee3bd0a75774470a67a22b32bfd0193 Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-ServersNegativeTestJSON-284623786 Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-ServersNegativeTestJSON-284623786-project Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 85884640d8024e1285a104b5b204883e Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-ServersNegativeTestJSON-284623786-project Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1047832049", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "d23a0a31-001b-433f-8c90-2459f03f3139"}]}} Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1047832049', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': 'd23a0a31-001b-433f-8c90-2459f03f3139'}]}}} Oct 12 13:57:36.005595 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:57:36.011970 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c1f58ec3-f086-4ac6-a80c-d0af9db1806c) Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ee1e9445-51ba-40a5-85f3-f1704b308ff5 tempest-ServersNegativeTestJSON-284623786 tempest-ServersNegativeTestJSON-284623786-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ee1e9445-51ba-40a5-85f3-f1704b308ff5 tempest-ServersNegativeTestJSON-284623786 tempest-ServersNegativeTestJSON-284623786-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.420809 Oct 12 13:57:36.016603 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1072/2117] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:57:35 2022] POST /compute/v2.1/servers => generated 214 bytes in 422 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:58:20.061273 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:58:20.062234 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:58:20.230500 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5cc6a98c-e1bd-4369-a55c-ffd4bd7babf6 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Action: 'create', calling method: .version_select at 0x7f8aa3d57940>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-241020221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj7fn895bssqHErSJpRVjYkJPdjrmditONKDYDhOaLL28h9JMnuS6qhgi6MPb7laJo0LtKkICiAHiHHvkGOJtxkKUJFusC6P67zCMTd0iuk0HvieNuKLdSpM8eC1JBnXg=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:58:20.245863 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-5cc6a98c-e1bd-4369-a55c-ffd4bd7babf6 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Getting quotas for project d78f258c71f94ab29a2104f43e619d75. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:58:20.251627 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-5cc6a98c-e1bd-4369-a55c-ffd4bd7babf6 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Getting quotas for user 74fe621ded0147ffabfb42d52dddf76e and project d78f258c71f94ab29a2104f43e619d75. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:58:20.344463 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5cc6a98c-e1bd-4369-a55c-ffd4bd7babf6 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.284668 Oct 12 13:58:20.345188 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1046/2118] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:58:20 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:58:20.394558 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=2 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:58:20.395777 n-d-861076-2 devstack@n-api.service[120933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 13:58:20.395935 n-d-861076-2 devstack@n-api.service[120933]: Wed Oct 12 13:58:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 12 13:58:20.402229 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-562f8a4c-e4fd-4d0d-b668-53f533210127 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1828298930", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-241020221", "networks": [{"uuid": "873155a6-94eb-4f3a-b637-2863ed4c859a"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:58:20.457494 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-562f8a4c-e4fd-4d0d-b668-53f533210127 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] validate_networks() for [('873155a6-94eb-4f3a-b637-2863ed4c859a', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-562f8a4c-e4fd-4d0d-b668-53f533210127 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3e8378da-a9c1-44a7-b293-692784d5e621) Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:58:20.659516 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3e8378da-a9c1-44a7-b293-692784d5e621) Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-562f8a4c-e4fd-4d0d-b668-53f533210127 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-562f8a4c-e4fd-4d0d-b668-53f533210127 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Request method failure captured: Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 272 Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsf1TqNDy9xCwUt3YyIX2gW0suHJTBtJhvsmJXJnxWnijr6glmDgRAp3K4jQjxB4ghVzvznHjXNN_O2_hNFZFkdpRKS9vvtpTQfYPB_7RPet1QymJ7xkH1o4R2GaYEEftWKwEXd2imq7B1GikDS3xoueC5Ka7_1bMBqpCXDn4Ux1XzY Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: d78f258c71f94ab29a2104f43e619d75 Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-TestEncryptedCinderVolumes-623821179 Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d78f258c71f94ab29a2104f43e619d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d78f258c71f94ab29a2104f43e619d75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d78f258c71f94ab29a2104f43e619d75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d78f258c71f94ab29a2104f43e619d75"}]}] Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-TestEncryptedCinderVolumes-623821179 Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: d78f258c71f94ab29a2104f43e619d75 Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-623821179 Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-TestEncryptedCinderVolumes-623821179-project Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 74fe621ded0147ffabfb42d52dddf76e Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-TestEncryptedCinderVolumes-623821179-project Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1828298930", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-241020221", "networks": [{"uuid": "873155a6-94eb-4f3a-b637-2863ed4c859a"}]}} Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:58:20.662525 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-TestEncryptedCinderVolumes-server-1828298930', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'key_name': 'tempest-TestEncryptedCinderVolumes-241020221', 'networks': [{'uuid': '873155a6-94eb-4f3a-b637-2863ed4c859a'}]}}} Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:58:20.665729 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3e8378da-a9c1-44a7-b293-692784d5e621) Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-562f8a4c-e4fd-4d0d-b668-53f533210127 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-562f8a4c-e4fd-4d0d-b668-53f533210127 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.271082 Oct 12 13:58:20.669769 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1073/2119] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:58:20 2022] POST /compute/v2.1/servers => generated 214 bytes in 272 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:58:20.683307 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-028ab733-a783-472b-8289-f924d7547907 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Calling method '.version_select at 0x7f8aa3d575e0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:58:20.767243 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-028ab733-a783-472b-8289-f924d7547907 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-241020221" status: 202 len: 0 microversion: 2.1 time: 0.088019 Oct 12 13:58:20.778881 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1047/2120] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 12 13:58:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-241020221 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:58:20.780745 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-439d0128-0c63-4276-993a-5e718ea59d4e tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Action: 'create', calling method: .version_select at 0x7f8aa3e505e0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1557699134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfoXJX7BYRBrQfKH5LV5ctqzZemK/SfyAkwt2u6XRl3bmGi1v1ZoeyBPim5oFKCkXptitpc30v+Gc2ENsxjW2vAHhDfMnaVaAVGRiFrDYDO3svYlpIIWvJCO+wmLyvY7w=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:58:20.797679 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-439d0128-0c63-4276-993a-5e718ea59d4e tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Getting quotas for project d78f258c71f94ab29a2104f43e619d75. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:58:20.804263 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-439d0128-0c63-4276-993a-5e718ea59d4e tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Getting quotas for user 74fe621ded0147ffabfb42d52dddf76e and project d78f258c71f94ab29a2104f43e619d75. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:58:20.895789 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-439d0128-0c63-4276-993a-5e718ea59d4e tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.118790 Oct 12 13:58:20.896508 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1074/2121] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:58:20 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:58:20.955228 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6990e5fb-c41d-4a95-9930-d5c995dcfb51 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-474035183", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1557699134", "networks": [{"uuid": "873155a6-94eb-4f3a-b637-2863ed4c859a"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:58:21.012805 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-6990e5fb-c41d-4a95-9930-d5c995dcfb51 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] validate_networks() for [('873155a6-94eb-4f3a-b637-2863ed4c859a', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-6990e5fb-c41d-4a95-9930-d5c995dcfb51 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-46a72dc9-3cd9-4ebc-a1c4-201705635d87) Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:58:21.567096 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-46a72dc9-3cd9-4ebc-a1c4-201705635d87) Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-6990e5fb-c41d-4a95-9930-d5c995dcfb51 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6990e5fb-c41d-4a95-9930-d5c995dcfb51 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Request method failure captured: Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 272 Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsf1TqNDy9xCwUt3YyIX2gW0suHJTBtJhvsmJXJnxWnijr6glmDgRAp3K4jQjxB4ghVzvznHjXNN_O2_hNFZFkdpRKS9vvtpTQfYPB_7RPet1QymJ7xkH1o4R2GaYEEftWKwEXd2imq7B1GikDS3xoueC5Ka7_1bMBqpCXDn4Ux1XzY Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: d78f258c71f94ab29a2104f43e619d75 Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-TestEncryptedCinderVolumes-623821179 Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d78f258c71f94ab29a2104f43e619d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d78f258c71f94ab29a2104f43e619d75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d78f258c71f94ab29a2104f43e619d75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d78f258c71f94ab29a2104f43e619d75"}]}] Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-TestEncryptedCinderVolumes-623821179 Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: d78f258c71f94ab29a2104f43e619d75 Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-623821179 Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-TestEncryptedCinderVolumes-623821179-project Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 74fe621ded0147ffabfb42d52dddf76e Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-TestEncryptedCinderVolumes-623821179-project Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-474035183", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1557699134", "networks": [{"uuid": "873155a6-94eb-4f3a-b637-2863ed4c859a"}]}} Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:58:21.570716 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-TestEncryptedCinderVolumes-server-474035183', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'key_name': 'tempest-TestEncryptedCinderVolumes-1557699134', 'networks': [{'uuid': '873155a6-94eb-4f3a-b637-2863ed4c859a'}]}}} Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:58:21.573822 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-46a72dc9-3cd9-4ebc-a1c4-201705635d87) Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6990e5fb-c41d-4a95-9930-d5c995dcfb51 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6990e5fb-c41d-4a95-9930-d5c995dcfb51 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.620245 Oct 12 13:58:21.577841 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1048/2122] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:58:20 2022] POST /compute/v2.1/servers => generated 214 bytes in 622 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:58:21.583335 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-a5e95747-dddd-4e53-9073-8acac2b4cc67 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Calling method '.version_select at 0x7f8aa3e54820>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:58:21.655600 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-a5e95747-dddd-4e53-9073-8acac2b4cc67 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1557699134" status: 202 len: 0 microversion: 2.1 time: 0.077091 Oct 12 13:58:21.656259 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1075/2123] 10.222.0.52 () {58 vars in 1278 bytes} [Wed Oct 12 13:58:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1557699134 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:58:21.668834 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0676c58d-d387-4d31-9fe0-f2271b5c98b5 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Action: 'create', calling method: .version_select at 0x7f8aa3d804c0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-839260919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/zF9zNKnvSJ8HdyuOV5h5GbgoTe2tlJ0gMu9ie7KW0b2uUduOsjgDB97hpF8Ogs4K+uCO8savrOGOB3C4zn9XAHZPkKDBgkae/qvRnOmbkYrhcF6L6wrEcGF3ZRSMCNg=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:58:21.685621 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-0676c58d-d387-4d31-9fe0-f2271b5c98b5 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Getting quotas for project d78f258c71f94ab29a2104f43e619d75. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:58:21.690870 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-0676c58d-d387-4d31-9fe0-f2271b5c98b5 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Getting quotas for user 74fe621ded0147ffabfb42d52dddf76e and project d78f258c71f94ab29a2104f43e619d75. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:58:21.778362 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0676c58d-d387-4d31-9fe0-f2271b5c98b5 tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.113376 Oct 12 13:58:21.779083 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1049/2124] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:58:21 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:58:21.831363 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fb79c41a-0ddd-48cd-8eac-32971ad2de5e tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-182019105", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-839260919", "networks": [{"uuid": "873155a6-94eb-4f3a-b637-2863ed4c859a"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:58:21.884377 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-fb79c41a-0ddd-48cd-8eac-32971ad2de5e tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] validate_networks() for [('873155a6-94eb-4f3a-b637-2863ed4c859a', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-fb79c41a-0ddd-48cd-8eac-32971ad2de5e tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-509ca4af-cda0-4ac9-be0b-b2ebbfb406a2) Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:58:22.101625 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-509ca4af-cda0-4ac9-be0b-b2ebbfb406a2) Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-fb79c41a-0ddd-48cd-8eac-32971ad2de5e tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fb79c41a-0ddd-48cd-8eac-32971ad2de5e tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Request method failure captured: Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 271 Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsf1TqNDy9xCwUt3YyIX2gW0suHJTBtJhvsmJXJnxWnijr6glmDgRAp3K4jQjxB4ghVzvznHjXNN_O2_hNFZFkdpRKS9vvtpTQfYPB_7RPet1QymJ7xkH1o4R2GaYEEftWKwEXd2imq7B1GikDS3xoueC5Ka7_1bMBqpCXDn4Ux1XzY Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: d78f258c71f94ab29a2104f43e619d75 Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-TestEncryptedCinderVolumes-623821179 Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d78f258c71f94ab29a2104f43e619d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d78f258c71f94ab29a2104f43e619d75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d78f258c71f94ab29a2104f43e619d75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d78f258c71f94ab29a2104f43e619d75"}]}] Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-TestEncryptedCinderVolumes-623821179 Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: d78f258c71f94ab29a2104f43e619d75 Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-623821179 Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-TestEncryptedCinderVolumes-623821179-project Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 74fe621ded0147ffabfb42d52dddf76e Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-TestEncryptedCinderVolumes-623821179-project Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-182019105", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-839260919", "networks": [{"uuid": "873155a6-94eb-4f3a-b637-2863ed4c859a"}]}} Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:58:22.105085 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-TestEncryptedCinderVolumes-server-182019105', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'key_name': 'tempest-TestEncryptedCinderVolumes-839260919', 'networks': [{'uuid': '873155a6-94eb-4f3a-b637-2863ed4c859a'}]}}} Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:58:22.109450 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-509ca4af-cda0-4ac9-be0b-b2ebbfb406a2) Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-fb79c41a-0ddd-48cd-8eac-32971ad2de5e tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-fb79c41a-0ddd-48cd-8eac-32971ad2de5e tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.275457 Oct 12 13:58:22.115539 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1076/2125] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:58:21 2022] POST /compute/v2.1/servers => generated 214 bytes in 277 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:58:22.121699 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3976ba83-0cda-4ca6-a7cc-fe9585f625dd tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] Calling method '.version_select at 0x7f8aa3d57550>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:58:22.212420 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3976ba83-0cda-4ca6-a7cc-fe9585f625dd tempest-TestEncryptedCinderVolumes-623821179 tempest-TestEncryptedCinderVolumes-623821179-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-839260919" status: 202 len: 0 microversion: 2.1 time: 0.100741 Oct 12 13:58:22.213040 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1050/2126] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Oct 12 13:58:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-839260919 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:58:54.922971 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:58:54.923736 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:58:54.927772 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-37bd7a2b-47ec-4e13-adf7-3534c833879d tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] Action: 'create', calling method: .version_select at 0x7f8aa3e6d280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1931581824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSp0bTum9N0XEJoK3wK3aFlkAyfFVMUDx+ju9uCFGIHnjykzrLVIOkOozVZw/ilJySPxex/j4v7j5JdU1b64v1rryvVMipBA3zgnTidmP/iGOQRfY1NPzySQWArLiovqQ=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:58:54.944058 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-37bd7a2b-47ec-4e13-adf7-3534c833879d tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] Getting quotas for project f9c8e52b44154075a28616bc54353d26. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:58:54.949460 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-37bd7a2b-47ec-4e13-adf7-3534c833879d tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] Getting quotas for user f84889b627274d9e81b3d32dfa537a4c and project f9c8e52b44154075a28616bc54353d26. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:58:55.025286 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-37bd7a2b-47ec-4e13-adf7-3534c833879d tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.103835 Oct 12 13:58:55.025858 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1077/2127] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:58:54 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:58:55.072168 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=8 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:58:55.072959 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:58:55.076769 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0b10115a-efcc-4b99-92a4-17f5bf810f9c tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-431643668", "imageRef": "a4bfdf71-ee00-41ed-a7c3-3022141424f3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1931581824", "networks": [{"uuid": "1227ae0f-309c-4a12-b7c0-d6d0938831a3"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:58:55.126980 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-0b10115a-efcc-4b99-92a4-17f5bf810f9c tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] validate_networks() for [('1227ae0f-309c-4a12-b7c0-d6d0938831a3', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-0b10115a-efcc-4b99-92a4-17f5bf810f9c tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-38f55084-272b-421b-8b6b-f8a575b67602) Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:58:55.325598 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-38f55084-272b-421b-8b6b-f8a575b67602) Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-0b10115a-efcc-4b99-92a4-17f5bf810f9c tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0b10115a-efcc-4b99-92a4-17f5bf810f9c tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] Request method failure captured: Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 268 Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsgNfwxmnouu1aNjzaGOaJya5buYEN85Gp5zeWvUHG3bcKYrvXKk2BF6afHLgCs9hC1lV5hqhYr_1af_ZWZsQTTs0PgsA0PkGQfBGF7aVcxjj1RcruUl_Ro36RO37qZFm2e9YN43qSrOdpOgsZoxERtEcfKPQBcO4ulMDxgzv4GknLk Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: f9c8e52b44154075a28616bc54353d26 Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-TestMinimumBasicScenario-1659850134 Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9c8e52b44154075a28616bc54353d26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9c8e52b44154075a28616bc54353d26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9c8e52b44154075a28616bc54353d26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9c8e52b44154075a28616bc54353d26"}]}] Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-TestMinimumBasicScenario-1659850134 Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: f9c8e52b44154075a28616bc54353d26 Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1659850134 Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-TestMinimumBasicScenario-1659850134-project Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: f84889b627274d9e81b3d32dfa537a4c Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-TestMinimumBasicScenario-1659850134-project Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-TestMinimumBasicScenario-server-431643668", "imageRef": "a4bfdf71-ee00-41ed-a7c3-3022141424f3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1931581824", "networks": [{"uuid": "1227ae0f-309c-4a12-b7c0-d6d0938831a3"}]}} Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:58:55.329483 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-TestMinimumBasicScenario-server-431643668', 'imageRef': 'a4bfdf71-ee00-41ed-a7c3-3022141424f3', 'flavorRef': '452', 'key_name': 'tempest-TestMinimumBasicScenario-1931581824', 'networks': [{'uuid': '1227ae0f-309c-4a12-b7c0-d6d0938831a3'}]}}} Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:58:55.332836 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-38f55084-272b-421b-8b6b-f8a575b67602) Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0b10115a-efcc-4b99-92a4-17f5bf810f9c tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0b10115a-efcc-4b99-92a4-17f5bf810f9c tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.259810 Oct 12 13:58:55.336225 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1051/2128] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:58:55 2022] POST /compute/v2.1/servers => generated 214 bytes in 261 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:58:55.341185 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f818179e-048c-4c84-8a23-b4de27f354c0 tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] Calling method '.version_select at 0x7f8aa3e54430>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:58:55.462767 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f818179e-048c-4c84-8a23-b4de27f354c0 tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1931581824" status: 202 len: 0 microversion: 2.1 time: 0.125837 Oct 12 13:58:55.463343 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1078/2129] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Oct 12 13:58:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1931581824 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:59:06.387585 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:59:06.392428 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9b65800f-e4a7-438a-b5b5-38af24aed335 tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] Action: 'create', calling method: .version_select at 0x7f8aa3d57700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-700600364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdMCtxLAZKNlRh7GMsNzQyL2Yq6rcG9y5x5PPIV0VoWwnlYC5N+0mM+VM+Jsn8RSCOGKahzFDTQBDTv0wJnnC40jWngKDgzcG+vCqjuc7cpNhgGqJb6uYqTTSZxX0Ue8g=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:59:06.408366 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-9b65800f-e4a7-438a-b5b5-38af24aed335 tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] Getting quotas for project f9c8e52b44154075a28616bc54353d26. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:59:06.413622 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-9b65800f-e4a7-438a-b5b5-38af24aed335 tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] Getting quotas for user f84889b627274d9e81b3d32dfa537a4c and project f9c8e52b44154075a28616bc54353d26. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:59:06.511354 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9b65800f-e4a7-438a-b5b5-38af24aed335 tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.125010 Oct 12 13:59:06.511956 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1052/2130] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:59:06 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:59:06.559637 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:59:06.564645 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-527048df-65fc-40d1-a547-68957e187818 tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-862608784", "imageRef": "dabbb8e0-feeb-48b2-bec7-0f064e0683df", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-700600364", "networks": [{"uuid": "1227ae0f-309c-4a12-b7c0-d6d0938831a3"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:59:06.615405 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-527048df-65fc-40d1-a547-68957e187818 tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] validate_networks() for [('1227ae0f-309c-4a12-b7c0-d6d0938831a3', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-527048df-65fc-40d1-a547-68957e187818 tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-be2dc6af-7052-41c3-a93f-32048c5e47e1) Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:59:06.816034 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-be2dc6af-7052-41c3-a93f-32048c5e47e1) Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-527048df-65fc-40d1-a547-68957e187818 tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-527048df-65fc-40d1-a547-68957e187818 tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] Request method failure captured: Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 267 Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsgNfwxmnouu1aNjzaGOaJya5buYEN85Gp5zeWvUHG3bcKYrvXKk2BF6afHLgCs9hC1lV5hqhYr_1af_ZWZsQTTs0PgsA0PkGQfBGF7aVcxjj1RcruUl_Ro36RO37qZFm2e9YN43qSrOdpOgsZoxERtEcfKPQBcO4ulMDxgzv4GknLk Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: f9c8e52b44154075a28616bc54353d26 Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-TestMinimumBasicScenario-1659850134 Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9c8e52b44154075a28616bc54353d26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9c8e52b44154075a28616bc54353d26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9c8e52b44154075a28616bc54353d26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9c8e52b44154075a28616bc54353d26"}]}] Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-TestMinimumBasicScenario-1659850134 Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: f9c8e52b44154075a28616bc54353d26 Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1659850134 Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-TestMinimumBasicScenario-1659850134-project Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: f84889b627274d9e81b3d32dfa537a4c Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-TestMinimumBasicScenario-1659850134-project Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-TestMinimumBasicScenario-server-862608784", "imageRef": "dabbb8e0-feeb-48b2-bec7-0f064e0683df", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-700600364", "networks": [{"uuid": "1227ae0f-309c-4a12-b7c0-d6d0938831a3"}]}} Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:59:06.819203 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-TestMinimumBasicScenario-server-862608784', 'imageRef': 'dabbb8e0-feeb-48b2-bec7-0f064e0683df', 'flavorRef': '452', 'key_name': 'tempest-TestMinimumBasicScenario-700600364', 'networks': [{'uuid': '1227ae0f-309c-4a12-b7c0-d6d0938831a3'}]}}} Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:59:06.822475 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-be2dc6af-7052-41c3-a93f-32048c5e47e1) Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-527048df-65fc-40d1-a547-68957e187818 tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-527048df-65fc-40d1-a547-68957e187818 tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.261795 Oct 12 13:59:06.825889 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1079/2131] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:59:06 2022] POST /compute/v2.1/servers => generated 214 bytes in 263 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:59:06.829597 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-852dd513-e804-4c1f-a3d8-687a7529c96c tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] Calling method '.version_select at 0x7f8aa3d633a0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:59:06.912931 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-852dd513-e804-4c1f-a3d8-687a7529c96c tempest-TestMinimumBasicScenario-1659850134 tempest-TestMinimumBasicScenario-1659850134-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-700600364" status: 202 len: 0 microversion: 2.1 time: 0.087512 Oct 12 13:59:06.913646 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1053/2132] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Oct 12 13:59:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-700600364 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:59:18.220258 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:59:18.386046 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-c219cbbb-4216-4465-8759-8fb7d2d61af4 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Action: 'create', calling method: .version_select at 0x7f8aa3dc7430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-234071539", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzkv1dnyzjTGFlGm6fJkesBlk5fc34yWz225hskufCZ1VOTek9YJyWIhpTBNEnaX7WjdEOPO25El3DTPxcCY/wimgeH5W2o3rW9wF20E6Q522Edtd7WoPMGkMmnmUxD4A=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:59:18.405515 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-c219cbbb-4216-4465-8759-8fb7d2d61af4 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Getting quotas for project bb24515db83646be9ff5e2382540a15a. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:59:18.410491 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-c219cbbb-4216-4465-8759-8fb7d2d61af4 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Getting quotas for user 742fc533938e46ab957eeedc07b6ced4 and project bb24515db83646be9ff5e2382540a15a. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:59:18.490314 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-c219cbbb-4216-4465-8759-8fb7d2d61af4 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.271367 Oct 12 13:59:18.490925 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1080/2133] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:59:18 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:59:26.763837 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:59:26.767611 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:59:26.774002 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-760eb27f-6cab-4bd0-8c59-600beece7366 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1258296499", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "e94544d1-5ae0-4b87-837d-8c20cff3b547"}], "key_name": "tempest-TestNetworkAdvancedServerOps-234071539", "security_groups": [{"name": "tempest-secgroup-smoke-1774330396"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:59:26.918840 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-760eb27f-6cab-4bd0-8c59-600beece7366 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] validate_networks() for [('e94544d1-5ae0-4b87-837d-8c20cff3b547', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-760eb27f-6cab-4bd0-8c59-600beece7366 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5a5f23f1-748f-49a1-964b-18e27c035707) Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:59:27.141524 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5a5f23f1-748f-49a1-964b-18e27c035707) Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-760eb27f-6cab-4bd0-8c59-600beece7366 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-760eb27f-6cab-4bd0-8c59-600beece7366 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Request method failure captured: Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 344 Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsg1XYEsyW8LUQNP_lZ9wbOJUxQI7NyrE4ppO5Rqsyp0-GAwAjP5WbJZoXXvzk2yC7T4cgHqQhDxG1s3qUJlY7U8vZnDVR0wJYGiZpep66V77QktRt4gseqYbSKJyshT-i4YKI9lVXxdj72pCnJ9Z3GsDBnP3nLxUuJeJVaJpgvwpSA Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: bb24515db83646be9ff5e2382540a15a Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1734618362 Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bb24515db83646be9ff5e2382540a15a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bb24515db83646be9ff5e2382540a15a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bb24515db83646be9ff5e2382540a15a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bb24515db83646be9ff5e2382540a15a"}]}] Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1734618362 Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: bb24515db83646be9ff5e2382540a15a Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1734618362 Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-TestNetworkAdvancedServerOps-1734618362-project Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 742fc533938e46ab957eeedc07b6ced4 Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1734618362-project Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1258296499", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "e94544d1-5ae0-4b87-837d-8c20cff3b547"}], "key_name": "tempest-TestNetworkAdvancedServerOps-234071539", "security_groups": [{"name": "tempest-secgroup-smoke-1774330396"}]}} Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:59:27.145969 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1258296499', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': 'e94544d1-5ae0-4b87-837d-8c20cff3b547'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-234071539', 'security_groups': [{'name': 'tempest-secgroup-smoke-1774330396'}]}}} Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:59:27.150057 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5a5f23f1-748f-49a1-964b-18e27c035707) Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-760eb27f-6cab-4bd0-8c59-600beece7366 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-760eb27f-6cab-4bd0-8c59-600beece7366 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.383831 Oct 12 13:59:27.153391 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1054/2134] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:59:26 2022] POST /compute/v2.1/servers => generated 214 bytes in 385 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:59:31.336594 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:59:31.342471 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:59:31.343289 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-932d12a3-afb6-42ef-be7d-79bd60836a35 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Calling method '.version_select at 0x7f8aa3dcfe50>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:59:31.439398 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-932d12a3-afb6-42ef-be7d-79bd60836a35 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-234071539" status: 202 len: 0 microversion: 2.1 time: 0.104034 Oct 12 13:59:31.439940 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1081/2135] 10.222.0.52 () {58 vars in 1281 bytes} [Wed Oct 12 13:59:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-234071539 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:59:31.453682 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c9fe5586-c3a5-4361-878c-b456c1af0687 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Action: 'create', calling method: .version_select at 0x7f8aa3d323a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-644299320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCEMHFJe6bPeBaG5KXFL9L5R0CXk2qAvQxmcmW9xpeqT3Jzc6zjwOWYRDOjUHBxyo7tQ25muREW4+gB1XcPoWH7jVPVqsmtrw1MHFVt1Ht1W1417keRF7OudS5gsTHegw=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:59:31.470491 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-c9fe5586-c3a5-4361-878c-b456c1af0687 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Getting quotas for project bb24515db83646be9ff5e2382540a15a. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:59:31.476153 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-c9fe5586-c3a5-4361-878c-b456c1af0687 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Getting quotas for user 742fc533938e46ab957eeedc07b6ced4 and project bb24515db83646be9ff5e2382540a15a. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:59:31.552734 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c9fe5586-c3a5-4361-878c-b456c1af0687 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.103472 Oct 12 13:59:31.553396 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1055/2136] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:59:31 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 13:59:39.386795 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d5149318-4580-43fd-96ed-3c060e7dda97 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-59790690", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "1559d8cf-afea-415d-b1c6-7a2917ce0c67"}], "key_name": "tempest-TestNetworkAdvancedServerOps-644299320", "security_groups": [{"name": "tempest-secgroup-smoke-45634412"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:59:39.646617 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-d5149318-4580-43fd-96ed-3c060e7dda97 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] validate_networks() for [('1559d8cf-afea-415d-b1c6-7a2917ce0c67', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-d5149318-4580-43fd-96ed-3c060e7dda97 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-31bb8315-1623-4bbb-b9ff-0df5b9fac0d5) Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:59:39.870171 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-31bb8315-1623-4bbb-b9ff-0df5b9fac0d5) Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-d5149318-4580-43fd-96ed-3c060e7dda97 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d5149318-4580-43fd-96ed-3c060e7dda97 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Request method failure captured: Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 340 Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsg1XYEsyW8LUQNP_lZ9wbOJUxQI7NyrE4ppO5Rqsyp0-GAwAjP5WbJZoXXvzk2yC7T4cgHqQhDxG1s3qUJlY7U8vZnDVR0wJYGiZpep66V77QktRt4gseqYbSKJyshT-i4YKI9lVXxdj72pCnJ9Z3GsDBnP3nLxUuJeJVaJpgvwpSA Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: bb24515db83646be9ff5e2382540a15a Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1734618362 Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bb24515db83646be9ff5e2382540a15a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bb24515db83646be9ff5e2382540a15a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bb24515db83646be9ff5e2382540a15a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bb24515db83646be9ff5e2382540a15a"}]}] Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1734618362 Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: bb24515db83646be9ff5e2382540a15a Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1734618362 Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-TestNetworkAdvancedServerOps-1734618362-project Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 742fc533938e46ab957eeedc07b6ced4 Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1734618362-project Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-59790690", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "1559d8cf-afea-415d-b1c6-7a2917ce0c67"}], "key_name": "tempest-TestNetworkAdvancedServerOps-644299320", "security_groups": [{"name": "tempest-secgroup-smoke-45634412"}]}} Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:59:39.872963 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-59790690', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '1559d8cf-afea-415d-b1c6-7a2917ce0c67'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-644299320', 'security_groups': [{'name': 'tempest-secgroup-smoke-45634412'}]}}} Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:59:39.878299 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-31bb8315-1623-4bbb-b9ff-0df5b9fac0d5) Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-d5149318-4580-43fd-96ed-3c060e7dda97 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-d5149318-4580-43fd-96ed-3c060e7dda97 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.492581 Oct 12 13:59:39.885911 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1082/2137] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:59:39 2022] POST /compute/v2.1/servers => generated 214 bytes in 494 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 12 13:59:43.561452 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:59:43.565279 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:59:43.566805 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3fcca947-fd94-40dd-8daf-6e72441ba905 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Calling method '.version_select at 0x7f8a9ba13790>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:59:43.643746 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3fcca947-fd94-40dd-8daf-6e72441ba905 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-644299320" status: 202 len: 0 microversion: 2.1 time: 0.079246 Oct 12 13:59:43.643746 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1056/2138] 10.222.0.52 () {58 vars in 1281 bytes} [Wed Oct 12 13:59:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-644299320 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:59:43.655363 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-6a9025e7-844e-4a92-abf6-260400f1371f tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Action: 'create', calling method: .version_select at 0x7f8aa3e53160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-242209266", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuToWS55sPgulxPsmezT0Kfw5m86eFOZ0KTsedrerePwQoqVzpSSXgmEKDU3H/CwQPTT2dUfz9RKP2Z1+utcalWZK0i0FzDN4idhIM7X82MYIKnUX4lOBWtSVII6nv2/w=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:59:43.672026 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-6a9025e7-844e-4a92-abf6-260400f1371f tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Getting quotas for project bb24515db83646be9ff5e2382540a15a. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:59:43.677581 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-6a9025e7-844e-4a92-abf6-260400f1371f tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Getting quotas for user 742fc533938e46ab957eeedc07b6ced4 and project bb24515db83646be9ff5e2382540a15a. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:59:43.758795 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-6a9025e7-844e-4a92-abf6-260400f1371f tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.108036 Oct 12 13:59:43.759397 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1083/2139] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:59:43 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 13:59:51.806970 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4250abe4-6cd2-40d3-879f-d9cfbf617518 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2064331182", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "8a319b53-c94b-497f-a037-fe68983eba49"}], "key_name": "tempest-TestNetworkAdvancedServerOps-242209266", "security_groups": [{"name": "tempest-secgroup-smoke-1922309769"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:59:51.930821 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-4250abe4-6cd2-40d3-879f-d9cfbf617518 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] validate_networks() for [('8a319b53-c94b-497f-a037-fe68983eba49', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-4250abe4-6cd2-40d3-879f-d9cfbf617518 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1baa16ac-057b-49e2-97a9-5e295dba6b27) Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:59:52.142851 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:59:52.146243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:59:52.146243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:59:52.146243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:59:52.146243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:59:52.146243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:59:52.146243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:59:52.146243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:59:52.146243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:59:52.146243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:59:52.146243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:59:52.146243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:59:52.146243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:59:52.146243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:59:52.146243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:59:52.146243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:59:52.146243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1baa16ac-057b-49e2-97a9-5e295dba6b27) Oct 12 13:59:52.146243 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:59:52.146243 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-4250abe4-6cd2-40d3-879f-d9cfbf617518 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:59:52.146243 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4250abe4-6cd2-40d3-879f-d9cfbf617518 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Request method failure captured: Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 344 Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsg1XYEsyW8LUQNP_lZ9wbOJUxQI7NyrE4ppO5Rqsyp0-GAwAjP5WbJZoXXvzk2yC7T4cgHqQhDxG1s3qUJlY7U8vZnDVR0wJYGiZpep66V77QktRt4gseqYbSKJyshT-i4YKI9lVXxdj72pCnJ9Z3GsDBnP3nLxUuJeJVaJpgvwpSA Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: bb24515db83646be9ff5e2382540a15a Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1734618362 Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bb24515db83646be9ff5e2382540a15a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bb24515db83646be9ff5e2382540a15a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bb24515db83646be9ff5e2382540a15a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bb24515db83646be9ff5e2382540a15a"}]}] Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1734618362 Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: bb24515db83646be9ff5e2382540a15a Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1734618362 Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-TestNetworkAdvancedServerOps-1734618362-project Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 742fc533938e46ab957eeedc07b6ced4 Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1734618362-project Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2064331182", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "8a319b53-c94b-497f-a037-fe68983eba49"}], "key_name": "tempest-TestNetworkAdvancedServerOps-242209266", "security_groups": [{"name": "tempest-secgroup-smoke-1922309769"}]}} Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-2064331182', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '8a319b53-c94b-497f-a037-fe68983eba49'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-242209266', 'security_groups': [{'name': 'tempest-secgroup-smoke-1922309769'}]}}} Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 13:59:52.147245 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1baa16ac-057b-49e2-97a9-5e295dba6b27) Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:59:52.151613 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 13:59:52.155351 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 13:59:52.155351 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 13:59:52.155351 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 13:59:52.155351 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:59:52.155351 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:59:52.155351 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:59:52.155351 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 13:59:52.155351 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:59:52.155351 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 13:59:52.155351 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 13:59:52.155351 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 13:59:52.155351 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 13:59:52.155351 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 13:59:52.155351 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:59:52.155351 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:59:52.155351 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 13:59:52.155351 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4250abe4-6cd2-40d3-879f-d9cfbf617518 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 13:59:52.155351 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 13:59:52.155351 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4250abe4-6cd2-40d3-879f-d9cfbf617518 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.345715 Oct 12 13:59:52.155351 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1057/2140] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 13:59:51 2022] POST /compute/v2.1/servers => generated 214 bytes in 347 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 13:59:56.003379 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:59:56.004152 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 13:59:56.008186 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-af215c4f-f5d3-426a-8b67-0ad5b8e09552 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Calling method '.version_select at 0x7f8a9b846670>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 13:59:56.090698 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-af215c4f-f5d3-426a-8b67-0ad5b8e09552 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-242209266" status: 202 len: 0 microversion: 2.1 time: 0.088490 Oct 12 13:59:56.091314 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1084/2141] 10.222.0.52 () {58 vars in 1281 bytes} [Wed Oct 12 13:59:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-242209266 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 13:59:56.106255 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-029ab4f2-bba9-4709-afa6-cae45f26b7b7 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Action: 'create', calling method: .version_select at 0x7f8aa3d57940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1486006184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2//VKdEgE0MXbg0kEBEQRb5SdjPtnNVYqOlsJ7JSUOblOAuDbMwIwasMAhDHmAXwgcsI1inODcr+iEonLbZeVdJnaVU8hG3NXcjGX4eYThB/7Ga+z/uLX4q3bkGDsQ3Q=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 13:59:56.126825 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-029ab4f2-bba9-4709-afa6-cae45f26b7b7 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Getting quotas for project bb24515db83646be9ff5e2382540a15a. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 13:59:56.132156 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-029ab4f2-bba9-4709-afa6-cae45f26b7b7 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Getting quotas for user 742fc533938e46ab957eeedc07b6ced4 and project bb24515db83646be9ff5e2382540a15a. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 13:59:56.216452 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-029ab4f2-bba9-4709-afa6-cae45f26b7b7 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.114965 Oct 12 13:59:56.217103 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1058/2142] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 13:59:56 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 14:00:04.087437 n-d-861076-2 devstack@n-api.service[120933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 14:00:04.087880 n-d-861076-2 devstack@n-api.service[120933]: Wed Oct 12 14:00:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Oct 12 14:00:04.093761 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-80628065-a5d0-46bf-aac3-4821402bf4f8 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-581424353", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "a74ccb3f-6619-44fb-b97d-7c6be2406b05"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1486006184", "security_groups": [{"name": "tempest-secgroup-smoke-772161886"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 14:00:04.222814 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-80628065-a5d0-46bf-aac3-4821402bf4f8 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] validate_networks() for [('a74ccb3f-6619-44fb-b97d-7c6be2406b05', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-80628065-a5d0-46bf-aac3-4821402bf4f8 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dc11801a-ff88-4f40-b009-8fffe61863ca) Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 14:00:04.457733 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 14:00:04.462019 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 14:00:04.462019 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 14:00:04.462019 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 14:00:04.462019 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 14:00:04.462019 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 14:00:04.462019 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 14:00:04.462019 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 14:00:04.462019 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 14:00:04.462019 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 14:00:04.462019 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 14:00:04.462019 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 14:00:04.462019 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 14:00:04.462019 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 14:00:04.462019 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 14:00:04.462019 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 14:00:04.462019 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dc11801a-ff88-4f40-b009-8fffe61863ca) Oct 12 14:00:04.462019 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:00:04.462019 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-80628065-a5d0-46bf-aac3-4821402bf4f8 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:00:04.462019 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-80628065-a5d0-46bf-aac3-4821402bf4f8 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Request method failure captured: Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 343 Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsg1XYEsyW8LUQNP_lZ9wbOJUxQI7NyrE4ppO5Rqsyp0-GAwAjP5WbJZoXXvzk2yC7T4cgHqQhDxG1s3qUJlY7U8vZnDVR0wJYGiZpep66V77QktRt4gseqYbSKJyshT-i4YKI9lVXxdj72pCnJ9Z3GsDBnP3nLxUuJeJVaJpgvwpSA Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: bb24515db83646be9ff5e2382540a15a Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1734618362 Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bb24515db83646be9ff5e2382540a15a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bb24515db83646be9ff5e2382540a15a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bb24515db83646be9ff5e2382540a15a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bb24515db83646be9ff5e2382540a15a"}]}] Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1734618362 Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: bb24515db83646be9ff5e2382540a15a Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1734618362 Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-TestNetworkAdvancedServerOps-1734618362-project Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 742fc533938e46ab957eeedc07b6ced4 Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1734618362-project Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-581424353", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "a74ccb3f-6619-44fb-b97d-7c6be2406b05"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1486006184", "security_groups": [{"name": "tempest-secgroup-smoke-772161886"}]}} Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-581424353', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': 'a74ccb3f-6619-44fb-b97d-7c6be2406b05'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1486006184', 'security_groups': [{'name': 'tempest-secgroup-smoke-772161886'}]}}} Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 14:00:04.464744 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dc11801a-ff88-4f40-b009-8fffe61863ca) Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 14:00:04.468496 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 14:00:04.472564 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 14:00:04.472564 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 14:00:04.472564 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 14:00:04.472564 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:00:04.472564 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:00:04.472564 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:00:04.472564 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 14:00:04.472564 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:00:04.472564 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 14:00:04.472564 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 14:00:04.472564 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 14:00:04.472564 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 14:00:04.472564 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 14:00:04.472564 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:00:04.472564 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:00:04.472564 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:00:04.472564 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-80628065-a5d0-46bf-aac3-4821402bf4f8 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:00:04.472564 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 14:00:04.472564 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-80628065-a5d0-46bf-aac3-4821402bf4f8 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.382482 Oct 12 14:00:04.472564 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1085/2143] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 14:00:04 2022] POST /compute/v2.1/servers => generated 214 bytes in 385 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 14:00:08.588617 n-d-861076-2 devstack@n-api.service[120932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 14:00:08.589398 n-d-861076-2 devstack@n-api.service[120932]: Wed Oct 12 14:00:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1486006184 (ip 10.222.0.52) !!! Oct 12 14:00:08.590800 n-d-861076-2 devstack@n-api.service[120932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 14:00:08.591071 n-d-861076-2 devstack@n-api.service[120932]: Wed Oct 12 14:00:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1486006184 (ip 10.222.0.52) !!! Oct 12 14:00:08.592074 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:00:08.593109 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:00:08.598284 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7a62b174-f67a-44f0-ba1a-c5141be40cd9 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Calling method '.version_select at 0x7f8a9b3cb820>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 14:00:08.678505 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7a62b174-f67a-44f0-ba1a-c5141be40cd9 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1486006184" status: 202 len: 0 microversion: 2.1 time: 0.092285 Oct 12 14:00:08.679097 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1059/2144] 10.222.0.52 () {58 vars in 1284 bytes} [Wed Oct 12 14:00:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1486006184 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 14:00:08.693602 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-656d3ad5-601e-41ad-abdb-7b523a477432 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Action: 'create', calling method: .version_select at 0x7f8aa3dcf5e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-145533952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvY7HvslrcV+aJ7l29L+hgGcKBIN4LY39Y7lz3oUAKRMUPI3jMO/ThfCe/3thjbG/qKeOcSamoEcLPi5H4rV38Wsb0jbiq4NwUPPrfV3LXREMA9zMS19Fm/27njtqaPPw=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 14:00:08.710464 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-656d3ad5-601e-41ad-abdb-7b523a477432 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Getting quotas for project bb24515db83646be9ff5e2382540a15a. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 14:00:08.715986 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-656d3ad5-601e-41ad-abdb-7b523a477432 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Getting quotas for user 742fc533938e46ab957eeedc07b6ced4 and project bb24515db83646be9ff5e2382540a15a. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 14:00:08.808818 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-656d3ad5-601e-41ad-abdb-7b523a477432 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.120285 Oct 12 14:00:08.809491 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1086/2145] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 14:00:08 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 14:00:16.809234 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-946b9a73-1e38-4a06-a116-1545a2f582e5 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2075932215", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "33f1ec4a-6270-4689-b82f-7c3dfebaa8db"}], "key_name": "tempest-TestNetworkAdvancedServerOps-145533952", "security_groups": [{"name": "tempest-secgroup-smoke-1735483851"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 14:00:16.965211 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-946b9a73-1e38-4a06-a116-1545a2f582e5 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] validate_networks() for [('33f1ec4a-6270-4689-b82f-7c3dfebaa8db', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-946b9a73-1e38-4a06-a116-1545a2f582e5 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1423b403-3dc9-4c14-a977-2d99960a610e) Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 14:00:17.194694 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1423b403-3dc9-4c14-a977-2d99960a610e) Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-946b9a73-1e38-4a06-a116-1545a2f582e5 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-946b9a73-1e38-4a06-a116-1545a2f582e5 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Request method failure captured: Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 344 Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsg1XYEsyW8LUQNP_lZ9wbOJUxQI7NyrE4ppO5Rqsyp0-GAwAjP5WbJZoXXvzk2yC7T4cgHqQhDxG1s3qUJlY7U8vZnDVR0wJYGiZpep66V77QktRt4gseqYbSKJyshT-i4YKI9lVXxdj72pCnJ9Z3GsDBnP3nLxUuJeJVaJpgvwpSA Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: bb24515db83646be9ff5e2382540a15a Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1734618362 Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bb24515db83646be9ff5e2382540a15a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bb24515db83646be9ff5e2382540a15a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bb24515db83646be9ff5e2382540a15a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bb24515db83646be9ff5e2382540a15a"}]}] Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1734618362 Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: bb24515db83646be9ff5e2382540a15a Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1734618362 Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-TestNetworkAdvancedServerOps-1734618362-project Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 742fc533938e46ab957eeedc07b6ced4 Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1734618362-project Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2075932215", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "networks": [{"uuid": "33f1ec4a-6270-4689-b82f-7c3dfebaa8db"}], "key_name": "tempest-TestNetworkAdvancedServerOps-145533952", "security_groups": [{"name": "tempest-secgroup-smoke-1735483851"}]}} Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:00:17.198816 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-2075932215', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'networks': [{'uuid': '33f1ec4a-6270-4689-b82f-7c3dfebaa8db'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-145533952', 'security_groups': [{'name': 'tempest-secgroup-smoke-1735483851'}]}}} Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 14:00:17.202004 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1423b403-3dc9-4c14-a977-2d99960a610e) Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-946b9a73-1e38-4a06-a116-1545a2f582e5 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-946b9a73-1e38-4a06-a116-1545a2f582e5 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.395506 Oct 12 14:00:17.204760 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1060/2146] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 14:00:16 2022] POST /compute/v2.1/servers => generated 214 bytes in 397 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Oct 12 14:00:20.970610 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:00:20.971605 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:00:20.976838 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-23b65e9a-84e5-4042-a82e-ef706824ca76 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] Calling method '.version_select at 0x7f8a9b84f0d0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 14:00:21.043714 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-23b65e9a-84e5-4042-a82e-ef706824ca76 tempest-TestNetworkAdvancedServerOps-1734618362 tempest-TestNetworkAdvancedServerOps-1734618362-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-145533952" status: 202 len: 0 microversion: 2.1 time: 0.074336 Oct 12 14:00:21.053131 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1087/2147] 10.222.0.52 () {58 vars in 1281 bytes} [Wed Oct 12 14:00:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-145533952 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 14:00:34.905869 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:00:35.092155 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-abd16965-0e4b-4484-ace7-a30f28eaf988 tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] Action: 'create', calling method: .version_select at 0x7f8a9bd59700>, body: {"keypair": {"name": "tempest-TestShelveInstance-308070423", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhEdB2jrfNR1mEwGqwKITTw32DClrxzbfTjuJbiiH9UUDB5peDmovIvGwVA8iE1SF9dnr7YmwytyOQv0XDMQflqScY2i8sI6aSXSOAmGBfbbHZYeVutDTqWmqBKGVYtOQ=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 14:00:35.111145 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-abd16965-0e4b-4484-ace7-a30f28eaf988 tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] Getting quotas for project 431902414cdd4ebd9fb05f168d0d92b8. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 14:00:35.118054 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-abd16965-0e4b-4484-ace7-a30f28eaf988 tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] Getting quotas for user 45825db19faa45099e9837fad628cfd8 and project 431902414cdd4ebd9fb05f168d0d92b8. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 14:00:35.237879 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-abd16965-0e4b-4484-ace7-a30f28eaf988 tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.337024 Oct 12 14:00:35.238892 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1061/2148] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 14:00:34 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 14:00:37.603311 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0d469656-36ad-4425-8039-f150a507f5dd tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1332976878", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-308070423", "security_groups": [{"name": "tempest-secgroup-smoke-1747151360"}], "networks": [{"uuid": "cf568804-f81a-4de1-9a86-f5761e81877f"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 14:00:37.712773 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-0d469656-36ad-4425-8039-f150a507f5dd tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] validate_networks() for [('cf568804-f81a-4de1-9a86-f5761e81877f', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-0d469656-36ad-4425-8039-f150a507f5dd tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-698cd277-d4f6-4f27-9056-c39a00c46b10) Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 14:00:37.911958 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 14:00:37.915782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 14:00:37.915782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 14:00:37.915782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 14:00:37.915782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 14:00:37.915782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 14:00:37.915782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 14:00:37.915782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 14:00:37.915782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 14:00:37.915782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 14:00:37.915782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 14:00:37.915782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 14:00:37.915782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 14:00:37.915782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 14:00:37.915782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 14:00:37.915782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-698cd277-d4f6-4f27-9056-c39a00c46b10) Oct 12 14:00:37.915782 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:00:37.915782 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-0d469656-36ad-4425-8039-f150a507f5dd tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:00:37.915782 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0d469656-36ad-4425-8039-f150a507f5dd tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] Request method failure captured: Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 324 Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsh8AiZPx-gYsCHrjbIw4TmdIGDowYDDYpiowqpdd6QzWq1aBtNqbfeKPybtUaJjdaRy3P1qvjbSokvEBNNBPruagOmx-avLvF_1GjneatzBEgZVfGD3Z3mvDADdYRqjFFv6fA5LaWgnfEmYjrafCJ5y0HrVyLvUP8co_sAGdo4wbbo Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 431902414cdd4ebd9fb05f168d0d92b8 Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-TestShelveInstance-246893704 Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/431902414cdd4ebd9fb05f168d0d92b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_431902414cdd4ebd9fb05f168d0d92b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/431902414cdd4ebd9fb05f168d0d92b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/431902414cdd4ebd9fb05f168d0d92b8"}]}] Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-TestShelveInstance-246893704 Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 431902414cdd4ebd9fb05f168d0d92b8 Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-TestShelveInstance-246893704 Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-TestShelveInstance-246893704-project Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: 45825db19faa45099e9837fad628cfd8 Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-TestShelveInstance-246893704-project Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-TestShelveInstance-server-1332976878", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-308070423", "security_groups": [{"name": "tempest-secgroup-smoke-1747151360"}], "networks": [{"uuid": "cf568804-f81a-4de1-9a86-f5761e81877f"}]}} Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-TestShelveInstance-server-1332976878', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'key_name': 'tempest-TestShelveInstance-308070423', 'security_groups': [{'name': 'tempest-secgroup-smoke-1747151360'}], 'networks': [{'uuid': 'cf568804-f81a-4de1-9a86-f5761e81877f'}]}}} Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 14:00:37.916953 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-698cd277-d4f6-4f27-9056-c39a00c46b10) Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 14:00:37.920469 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 14:00:37.923871 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 14:00:37.923871 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 14:00:37.923871 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:00:37.923871 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:00:37.923871 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:00:37.923871 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 14:00:37.923871 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:00:37.923871 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 14:00:37.923871 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 14:00:37.923871 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 14:00:37.923871 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 14:00:37.923871 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 14:00:37.923871 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:00:37.923871 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:00:37.923871 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:00:37.923871 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-0d469656-36ad-4425-8039-f150a507f5dd tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:00:37.923871 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 14:00:37.923871 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-0d469656-36ad-4425-8039-f150a507f5dd tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.319641 Oct 12 14:00:37.923871 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1088/2149] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 14:00:37 2022] POST /compute/v2.1/servers => generated 214 bytes in 321 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 14:00:38.195614 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-db081ee3-105e-433e-9b45-1a946a968009 tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] Calling method '.version_select at 0x7f8aa3db8e50>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 14:00:38.299672 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-db081ee3-105e-433e-9b45-1a946a968009 tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-308070423" status: 202 len: 0 microversion: 2.1 time: 0.108383 Oct 12 14:00:38.300259 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1062/2150] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Oct 12 14:00:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-308070423 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 14:00:38.314275 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-f23234bf-52a7-4dd8-92a6-08743aa14030 tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] Action: 'create', calling method: .version_select at 0x7f8aa3e6db80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1720570519", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkJiTNUu+V8Aa7ATezewmb0U3KwapRvaNVF1z55wfDJ4/6DSUvcXtPZxqy8FJlMMZmYDCp4M3TREgr7miIyhEXeE68HMQQHsB3IHDijhKEq7CuEqS5AbI24sdMYoTxAog=="}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 14:00:38.330023 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-f23234bf-52a7-4dd8-92a6-08743aa14030 tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] Getting quotas for project 431902414cdd4ebd9fb05f168d0d92b8. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 14:00:38.335893 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.quota [None req-f23234bf-52a7-4dd8-92a6-08743aa14030 tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] Getting quotas for user 45825db19faa45099e9837fad628cfd8 and project 431902414cdd4ebd9fb05f168d0d92b8. Resources: {'key_pairs'} {{(pid=120933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 14:00:38.421005 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-f23234bf-52a7-4dd8-92a6-08743aa14030 tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.110384 Oct 12 14:00:38.421609 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1089/2151] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 14:00:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 14:01:02.504149 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:01:02.504926 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:01:02.508771 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-db94a222-0b3c-4985-a4a8-ed3d824186f2 tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1847373805", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1720570519", "security_groups": [{"name": "tempest-secgroup-smoke-953492383"}], "networks": [{"uuid": "cf568804-f81a-4de1-9a86-f5761e81877f"}], "block_device_mapping_v2": [{"uuid": "06224a73-ea14-4de2-9763-6fec9d814687", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 14:01:02.743423 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-db94a222-0b3c-4985-a4a8-ed3d824186f2 tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] validate_networks() for [('cf568804-f81a-4de1-9a86-f5761e81877f', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [None req-db94a222-0b3c-4985-a4a8-ed3d824186f2 tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-eebf2106-9021-4019-84ac-1e468085e2e8) Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 14:01:02.937321 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-eebf2106-9021-4019-84ac-1e468085e2e8) Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-db94a222-0b3c-4985-a4a8-ed3d824186f2 tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-db94a222-0b3c-4985-a4a8-ed3d824186f2 tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] Request method failure captured: Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: Accept: application/json Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: Accept-Encoding: identity Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: Connection: close Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: Content-Length: 470 Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: Content-Type: application/json Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: Host: 10.222.0.52 Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: Openstack-System-Scope: None Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjRsh8AiZPx-gYsCHrjbIw4TmdIGDowYDDYpiowqpdd6QzWq1aBtNqbfeKPybtUaJjdaRy3P1qvjbSokvEBNNBPruagOmx-avLvF_1GjneatzBEgZVfGD3Z3mvDADdYRqjFFv6fA5LaWgnfEmYjrafCJ5y0HrVyLvUP8co_sAGdo4wbbo Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Id: None Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: X-Domain-Name: None Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: X-Identity-Status: Confirmed Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: X-Is-Admin-Project: True Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Id: default Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Domain-Name: Default Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Id: 431902414cdd4ebd9fb05f168d0d92b8 Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: X-Project-Name: tempest-TestShelveInstance-246893704 Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: X-Role: member,reader Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: X-Roles: member,reader Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/431902414cdd4ebd9fb05f168d0d92b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_431902414cdd4ebd9fb05f168d0d92b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/431902414cdd4ebd9fb05f168d0d92b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/431902414cdd4ebd9fb05f168d0d92b8"}]}] Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant: tempest-TestShelveInstance-246893704 Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Id: 431902414cdd4ebd9fb05f168d0d92b8 Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: X-Tenant-Name: tempest-TestShelveInstance-246893704 Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: X-User: tempest-TestShelveInstance-246893704-project Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Id: default Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: X-User-Domain-Name: Default Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: X-User-Id: 45825db19faa45099e9837fad628cfd8 Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: X-User-Name: tempest-TestShelveInstance-246893704-project Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: {"server": {"name": "tempest-TestShelveInstance-server-1847373805", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1720570519", "security_groups": [{"name": "tempest-secgroup-smoke-953492383"}], "networks": [{"uuid": "cf568804-f81a-4de1-9a86-f5761e81877f"}], "block_device_mapping_v2": [{"uuid": "06224a73-ea14-4de2-9763-6fec9d814687", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: method: > Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:01:02.941099 n-d-861076-2 devstack@n-api.service[120932]: Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: action_args: {'body': {'server': {'name': 'tempest-TestShelveInstance-server-1847373805', 'imageRef': '', 'flavorRef': '452', 'key_name': 'tempest-TestShelveInstance-1720570519', 'security_groups': [{'name': 'tempest-secgroup-smoke-953492383'}], 'networks': [{'uuid': 'cf568804-f81a-4de1-9a86-f5761e81877f'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': '06224a73-ea14-4de2-9763-6fec9d814687'}]}}} Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 14:01:02.944645 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-eebf2106-9021-4019-84ac-1e468085e2e8) Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-db94a222-0b3c-4985-a4a8-ed3d824186f2 tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-db94a222-0b3c-4985-a4a8-ed3d824186f2 tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.438499 Oct 12 14:01:02.948029 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1063/2152] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 14:01:02 2022] POST /compute/v2.1/servers => generated 214 bytes in 440 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 14:01:03.206885 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-5c4fa3e2-79b4-4ba3-a82d-ae1edcf05131 tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] Calling method '.version_select at 0x7f8aa3e6d4c0>' {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 14:01:03.211985 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_cell0:SELECT=4 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:01:03.212745 n-d-861076-2 devstack@n-api.service[120933]: DEBUG dbcounter [-] [120933] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:01:03.288086 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-5c4fa3e2-79b4-4ba3-a82d-ae1edcf05131 tempest-TestShelveInstance-246893704 tempest-TestShelveInstance-246893704-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1720570519" status: 202 len: 0 microversion: 2.1 time: 0.085248 Oct 12 14:01:03.288681 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1090/2153] 10.222.0.52 () {58 vars in 1254 bytes} [Wed Oct 12 14:01:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1720570519 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 14:01:24.658882 n-d-861076-2 devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:01:24.840666 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-48a0ee92-efb6-4d61-8fc0-ffab27758cbf tempest-TestSnapshotPattern-28903087 tempest-TestSnapshotPattern-28903087-project] Action: 'create', calling method: .version_select at 0x7f8a9ba51040>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-672108111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWPC7vZ7O7YZ1eBqpdqm/GSUuMuOVY0HZ5x3f5XDLaKEVcXyGOCbjYp9a2nuiYZqRunEMTPKyAIVtvuG7XgIzuwNi8YIjoSnn+NIePk5rCiaP/PUEVLRZu2Q9a6Zvgu2A=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 14:01:24.858482 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-48a0ee92-efb6-4d61-8fc0-ffab27758cbf tempest-TestSnapshotPattern-28903087 tempest-TestSnapshotPattern-28903087-project] Getting quotas for project 373c9c9ebe5e434db6034bc4c4971729. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 14:01:24.863876 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.quota [None req-48a0ee92-efb6-4d61-8fc0-ffab27758cbf tempest-TestSnapshotPattern-28903087 tempest-TestSnapshotPattern-28903087-project] Getting quotas for user b1bac77bdef14929afbcead58aa6e78b and project 373c9c9ebe5e434db6034bc4c4971729. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 14:01:24.962508 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-48a0ee92-efb6-4d61-8fc0-ffab27758cbf tempest-TestSnapshotPattern-28903087 tempest-TestSnapshotPattern-28903087-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.304886 Oct 12 14:01:24.963425 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1064/2154] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Oct 12 14:01:24 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 14:01:27.262587 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ed81046d-d356-42d0-948e-af6c13b874fc tempest-TestSnapshotPattern-28903087 tempest-TestSnapshotPattern-28903087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-658757508", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-672108111", "security_groups": [{"name": "tempest-secgroup-smoke-1305210155"}], "networks": [{"uuid": "26a5b5ab-d02c-40a4-aa51-02bb8841a1bc"}]}} {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 14:01:27.368487 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.network.neutron [None req-ed81046d-d356-42d0-948e-af6c13b874fc tempest-TestSnapshotPattern-28903087 tempest-TestSnapshotPattern-28903087-project] validate_networks() for [('26a5b5ab-d02c-40a4-aa51-02bb8841a1bc', None, None, None, None, None)] {{(pid=120933) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [None req-ed81046d-d356-42d0-948e-af6c13b874fc tempest-TestSnapshotPattern-28903087 tempest-TestSnapshotPattern-28903087-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d05ffe64-11f6-413c-a9e2-498194f9e00e) Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 14:01:27.565153 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d05ffe64-11f6-413c-a9e2-498194f9e00e) Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.wsgi [None req-ed81046d-d356-42d0-948e-af6c13b874fc tempest-TestSnapshotPattern-28903087 tempest-TestSnapshotPattern-28903087-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ed81046d-d356-42d0-948e-af6c13b874fc tempest-TestSnapshotPattern-28903087 tempest-TestSnapshotPattern-28903087-project] Request method failure captured: Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: Accept: application/json Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: Accept-Encoding: identity Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: Connection: close Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: Content-Length: 325 Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: Content-Type: application/json Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: Host: 10.222.0.52 Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: Openstack-System-Scope: None Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: User-Agent: python-urllib3/1.26.12 Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: X-Auth-Token: gAAAAABjRsiuQdo37ZCt7mKcePbg7Xz_dQoVsTRHE7RUsaeVOVx-nnS_UU23M-ab2ISEQCutPCv6uBj17Rjd7Y8wyXDLupzohjO_CST9w9v_8yksDZoudeQfT59GNt3wSqQwvpUxJQgLcGIG951VT1a7UG6UzCiQq10xUtdcxSULcAATlhkq-ss Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Id: None Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: X-Domain-Name: None Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: X-Identity-Status: Confirmed Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: X-Is-Admin-Project: True Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Id: default Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Domain-Name: Default Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Id: 373c9c9ebe5e434db6034bc4c4971729 Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: X-Project-Name: tempest-TestSnapshotPattern-28903087 Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: X-Role: member,reader Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: X-Roles: member,reader Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/373c9c9ebe5e434db6034bc4c4971729"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_373c9c9ebe5e434db6034bc4c4971729"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/373c9c9ebe5e434db6034bc4c4971729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/373c9c9ebe5e434db6034bc4c4971729"}]}] Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant: tempest-TestSnapshotPattern-28903087 Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Id: 373c9c9ebe5e434db6034bc4c4971729 Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: X-Tenant-Name: tempest-TestSnapshotPattern-28903087 Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: X-User: tempest-TestSnapshotPattern-28903087-project Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Id: default Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: X-User-Domain-Name: Default Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: X-User-Id: b1bac77bdef14929afbcead58aa6e78b Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: X-User-Name: tempest-TestSnapshotPattern-28903087-project Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: {"server": {"name": "tempest-TestSnapshotPattern-server-658757508", "imageRef": "92c34f67-0f72-4439-9fdb-d8567b96935c", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-672108111", "security_groups": [{"name": "tempest-secgroup-smoke-1305210155"}], "networks": [{"uuid": "26a5b5ab-d02c-40a4-aa51-02bb8841a1bc"}]}} Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: method: > Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:01:27.568738 n-d-861076-2 devstack@n-api.service[120933]: Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: action_args: {'body': {'server': {'name': 'tempest-TestSnapshotPattern-server-658757508', 'imageRef': '92c34f67-0f72-4439-9fdb-d8567b96935c', 'flavorRef': '452', 'key_name': 'tempest-TestSnapshotPattern-672108111', 'security_groups': [{'name': 'tempest-secgroup-smoke-1305210155'}], 'networks': [{'uuid': '26a5b5ab-d02c-40a4-aa51-02bb8841a1bc'}]}}} Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._has_extension( Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Oct 12 14:01:27.572400 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d05ffe64-11f6-413c-a9e2-498194f9e00e) Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: ERROR nova.api.openstack.wsgi Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: DEBUG nova.api.openstack.wsgi [None req-ed81046d-d356-42d0-948e-af6c13b874fc tempest-TestSnapshotPattern-28903087 tempest-TestSnapshotPattern-28903087-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: {{(pid=120933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: INFO nova.api.openstack.requestlog [None req-ed81046d-d356-42d0-948e-af6c13b874fc tempest-TestSnapshotPattern-28903087 tempest-TestSnapshotPattern-28903087-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.311612 Oct 12 14:01:27.576007 n-d-861076-2 devstack@n-api.service[120933]: [pid: 120933|app: 0|req: 1091/2155] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Oct 12 14:01:27 2022] POST /compute/v2.1/servers => generated 214 bytes in 313 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 12 14:01:27.804458 n-d-861076-2 devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0f5482b7-5641-4886-8004-509724db0da3 tempest-TestSnapshotPattern-28903087 tempest-TestSnapshotPattern-28903087-project] Calling method '.version_select at 0x7f8aa3e003a0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 14:01:27.887906 n-d-861076-2 devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0f5482b7-5641-4886-8004-509724db0da3 tempest-TestSnapshotPattern-28903087 tempest-TestSnapshotPattern-28903087-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-672108111" status: 202 len: 0 microversion: 2.1 time: 0.090498 Oct 12 14:01:27.888490 n-d-861076-2 devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1065/2156] 10.222.0.52 () {58 vars in 1254 bytes} [Wed Oct 12 14:01:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-672108111 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)